Extracorporeal blood processing system with augmented reality device for checking assembly and with functional testing

Abstract

The present invention relates to a method and a device for activating a function of a device, preferably a medical device, the method comprising the following steps: detecting the actual state of the device by means of a camera, preferably an AR device, preferably AR glasses; comparing the actual state of the device with the expected state of the device by means of a CPU connected to the camera; based on the comparison, transmitting a command for starting the function or a functional test, preferably a functional test, of the device from the CPU to the device; and based on this command, activating the function of the device or the functional test.

Description

Technical Field

[0001] The present disclosure relates to a method and an apparatus for checking the functionality of a medical device. Background Art

[0002] Augmented reality (abbreviated AR) is a computer-assisted extension of the perception of reality. This information addresses all human sensory modalities. However, augmented reality is usually understood to mean only the visual representation of information, i.e. the addition of computer-generated supplementary information or virtual objects to an image or video by superposition / overlay. In football broadcasting, augmented reality is the use of distance superpositions such as circles or lines in the case of free kicks.

[0003] Dialysis equipment / dialysis machines allow patient-specific removal of dissolved substances (e.g., urea, creatinine, vitamin B12 or β2-microglobulin) and, if necessary, removal of a defined water content from the blood in renal replacement therapy. Dialysis equipment is used for hemodialysis and hemodiafiltration. Basically, the dialysis equipment can be divided into the following modules: extracorporeal blood circuit, dialysate circuit, disinfection unit, operating unit and power supply unit. In addition, consumable materials, so-called disposables, are used during the treatment. These disposables are, for example, dialysate cannulas, blood tubing systems, dialyzers, dialysis concentrates, etc.

[0004] A disadvantage of the prior art is that special user training is required for caregivers to use the dialysis apparatus or to properly attach disposables to the dialysis apparatus. Such user training is necessary for each new generation of dialysis machines. Summary of the invention

[0005] The object of the present disclosure is to enable fast, efficient and error-free application of disposables as well as fast and safe self-testing through internal and external information.

[0006] This object is achieved by the technical solution according to the invention. Advantageous embodiments or further developments are explained below.

[0007] The present disclosure relates to a method for activating a function of a device, preferably a medical device, comprising the following steps:

[0008] ● detecting the actual state of the device by means of a camera preferably located on the AR device, preferably AR glasses or AR vision protection panes,

[0009] ● comparing the actual state of the device with the desired / target state of the device via at least one CPU connected to the camera,

[0010] Based on the comparison, a command for starting a function, preferably a functional test, is transmitted from the CPU to the device,

[0011] - Based on the command, activating a function, preferably a functional test, of the device.

[0012] In other words, the at least one CPU / computing unit receiving the image from the camera identifies the status / installation / setup / assembly stage of the medical device, preferably the dialysis machine. In this regard, the camera and, if applicable, the CPU / computing unit may be accommodated or integrated in the AR device, preferably on smart glasses. The at least one CPU / computing unit superimposes the necessary steps to be performed by the user, for example for correctly connecting a disposable to the medical device, into the field of view of the AR device, in particular the smart glasses (preferably, a projector connected to the CPU superimposes the information).

[0013] When the CPU recognizes via the camera arranged on the AR device that the setup has been properly completed, the CPU starts the device for a functional test via a preferably wireless connection, preferably by Bluetooth or WLAN (ZigBee, NFC, mobile radio).

[0014] Alternatively or in addition, the CPU or data transmission device on the AR device is configured and debugged to transmit the image of the camera to another second or fixed CPU. Preferably, this CPU is located in the medical device, but it can also be external to the AR device and / or medical device, for example, in the form of a PC connected to the medical device. This second or fixed CPU preferably has a greater computing power than the first CPU, which, if applicable, is located on the AR device. The second CPU processes the received data and transmits the processed data back to the first CPU or the data transmission device on the AR device, which then causes the information to be displayed in the field of view of the AR device. In other words, the first CPU on the AR device is used to transmit the data and control the display of information, while the second external or fixed CPU is used as a data processing unit and a computing unit for processing the captured image and deriving, for example, action steps therefrom, which the second external or fixed CPU returns to the first CPU as specific information to be displayed, as described above.

[0015] Preferably, the device is a medical device, and more preferably a dialysis apparatus, a dialysis machine, a syringe pump or the like.

[0016] The AR device is preferably a product of the wearable category (wearable computing). Wearables / wearable computers are attached to the user's body or integrated into clothing during use. Preferably, the AR device according to the present disclosure has an optical display integrated in the user's field of view and a CPU and / or a data transmission unit. More preferably, the AR device is a pair of AR glasses, smart glasses, a smart mirror, data glasses or a head-up display. In this context, smart glasses or a smart mirror (or commonly known as: data glasses) are preferably a wearable computer on a pair of glasses that adds information to the user's field of view. More preferably, the glasses also include the camera. In addition or alternatively, the glasses may also have a data transmission unit. The glasses enable augmented reality or mixed reality.

[0017] Preferably, the camera is a digital camera. In addition to discretely displaying information on the display of the AR device, the information can also be combined with captured images of the integrated digital camera. For this purpose, data can be directly obtained and transmitted from the Internet.

[0018] Preferably, the camera is in data connection with the first (AR device integrated) CPU and / or the second fixed or separate CPU, preferably wirelessly, e.g. via Bluetooth, WLAN, etc. Alternatively or additionally, the first CPU on the AR device may be in data connection with a second external CPU, preferably wirelessly, e.g. via Bluetooth, WLAN, etc. Preferably, the CPU on the AR device is in data connection with the medical device, preferably wirelessly, e.g. via Bluetooth, WLAN, etc. The second CPU is preferably a computing unit / CPU already present in the medical device for control purposes.

[0019] Preferably, the comparison between the actual state of the device and the expected state of the device is performed by an image analysis algorithm stored on a storage medium of the CPU, which may be the first CPU on the AR device or at least an optional second CPU in the medical device or outside the AR device and / or the medical device.

[0020] Preferably, the device performs a self-test / functional test / pressure self-test etc. in response to the input of the camera. Here, the functional test may be activated after manual confirmation on the medical device itself, or by a gesture identified by the camera and the CPU, or simply after a predetermined time. For example, a pressure self-test may be started after connecting a pressure sensor. During the pressure self-test, preferably, the connected / mounted disposable on the medical device is pressurized by the medical device. If a predetermined pressure drop is determined by the pressure sensor, there is a leak or a faulty connection and the medical device outputs an error message / signal.

[0021] The actual state represents the current state of the degree of installation of the disposable in the medical device at a first time T1. The desired state represents the completed and correct state of the disposable in the medical device. Preferably, the installation process of the disposable in the medical device is broken down into different sub-steps, which are preferably guided, monitored (comparison between the current actual state of the sub-step and the desired state) and then 'tested' individually or as a whole.

[0022] Transmitting a command for starting a function, preferably a function test, from the CPU to the device based on (or in accordance with) the comparison is preferably performed in the case of a positive comparison, i.e. when the actual state corresponds to the expected state. In the case of a negative comparison, i.e. when the actual state does not correspond to the expected state, in response to the command, a corresponding function is activated, preferably an error message in the AR device or the medical device.

[0023] Preferably, the method is characterized in that it further comprises the step of displaying the functional result in the AR device. In other words, the individual installation steps of the disposable are displayed in the AR device according to a comparison of the actual state with the desired state. Alternatively or additionally, the result of the functional test may be displayed, for example the prevailing pressure in the connected disposable.

[0024] Preferably, the method is characterized in that it further comprises the step of transmitting the functional test result to the CPU and / or superimposing the necessary steps in the AR device, preferably in the form of markings, animations and / or messages, in order to achieve the desired state of the device. In other words, the medical device in which there is, for example, the second or separate or fixed CPU and / or data transmission unit transmits a signal to the first CPU or data transmission unit in the AR device. Similarly, as already explained above, the result of the function (functional result / functional outcome) is then displayed in response to the signal of the medical device.

[0025] Preferably, the method is characterized in that it also comprises the step of blocking further functions in case of a negative function (in case of a negative functional test result). In other words, if the actual state does not match the expected state, the medical device blocks further functions until the comparison is positive.

[0026] Preferably, the method is characterized in that the functional test is a pressure test measuring the built-up (line) pressure in the disposable for testing purposes.

[0027] Preferably, the steps are graphically shown on a display. Preferably, the required steps are shown in the AR device by a graphical representation which may be fully or partially animated and / or by writing into the user's field of view. In other words, markers, animations and / or messages may be projected into the field of view.

[0028] Preferably, the medical device is in data communication with the CPU which may be located in the AR device, the medical device, a PC or externally in other forms.

[0029] The present disclosure also relates to a system for activating a device function, preferably a functional test, comprising: at least one camera; at least one CPU, which is in data connection with the camera; and preferably at least one device, for example a medical device, in particular a dialysis machine, which in turn or can be in data connection with the CPU, which CPU comprises a storage medium or can be in data connection with an external CPU on which the following steps are stored:

[0030] ● identifying the actual state of the device by means of the camera, which is preferably arranged on the AR device,

[0031] ● Comparing the actual state of the device with the desired / target state of the device by the CPU connected to the camera,

[0032] when the actual state corresponds to a predetermined desired state, transmitting a command (from the CPU) to the device for starting a device function, preferably a device function test,

[0033] - Based on the command, activating the device function, preferably the functional test, of the device.

[0034] Preferably, the camera is attached to / in an AR device, which is configured and adjusted to display the results of the functional test and / or installation instructions, preferably according to the display principle of a heads-up display.

[0035] The present disclosure also preferably relates to a method and device for activating a function of a device, preferably a medical device, the method comprising the following steps: identifying the actual state of the device by a camera preferably arranged on an AR device; comparing the actual state of the device with an expected state of the device by a CPU connected to the camera; when the actual state corresponds or appears to correspond to a predetermined expected state according to visual identification, transmitting a command (from the CPU) for starting a device function, preferably a device function test, to the device; and activating the device function, preferably the device function test, in response to (reacting to) the command.

[0036] In summary, the present disclosure relates to a method for activating or performing a functional test of a blood treatment device, preferably a dialysis machine, comprising the following steps: detecting the actual state of the blood treatment device by means of a camera which is preferably arranged or mounted in / on an augmented reality device, preferably augmented reality glasses; comparing the actual state of the blood treatment device with a desired / target state of the blood treatment device by means of a control unit (CPU) connected to the camera; based on the comparison, transmitting a command for starting the functional test from the control unit (CPU) to the blood treatment device; and based on the command, activating the functional test of the blood treatment device.

[0037] Preferably, the method further comprises the following steps: transmitting the function test result to the control unit (CPU); and displaying the function test result in an augmented reality device.

[0038] More preferably, the method further comprises the step of superimposing in the augmented reality device still required steps to be performed in order to achieve the desired state of the blood treatment device, preferably in the form of markers, animations and / or messages.

[0039] Advantageously, the method further comprises the step of preventing further functional tests in the event of a negative functional test result.

[0040] Advantageously, the functional test is a preferably automated self-test of the blood treatment device for checking installation actions performed by a user during installation of the blood treatment device.

[0041] Preferably, the functional test is a pressure test which measures the pressure temporarily built up in a disposable, in particular a fluid line, attached to or arranged in / in the blood treatment apparatus for testing purposes.

[0042] Furthermore, the present disclosure generally relates to a system comprising: at least one camera; at least one control unit (CPU), which is or can be in data connection with the camera; and at least one blood treatment device, in particular a dialysis machine, which in turn is or can be in data connection with the control unit (CPU), the control unit (CPU) being configured to: detect an actual state of the blood treatment device by means of the camera which is preferably arranged or disposed in / on an augmented reality device, in particular augmented reality glasses or augmented reality visual protection panes; compare the actual state of the blood treatment device with an expected / target state of the blood treatment device; based on the comparison, transmit a command for starting a functional test of the blood treatment device to the blood treatment device; and activate the functional test of the blood treatment device based on the command.

[0043] Preferably, the camera is attached to or arranged in / in an augmented reality device, which is configured to display functional test results and / or further steps to be performed by a user.

[0044] More preferably, the functional test is a preferably automated self-test of the blood treatment apparatus for checking installation actions performed by a user during installation of the blood treatment apparatus.

[0045] Advantageously, the functional test is a pressure test which measures the pressure temporarily built up for testing purposes in a disposable, in particular a fluid line, which is attached to or arranged in / in the blood treatment device.

[0046] Hereinafter, the present disclosure will be explained in more detail based on preferred exemplary embodiments with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 A system for activating a function of a device according to the present disclosure is schematically shown.

[0048] Figure 2 A method for activating a function of a device is shown.

[0049] Figure 3 A system for activating a function of a device according to the present disclosure with augmented reality guidance is schematically shown.

[0050] Figure 4 Schematic diagram showing possible interactions between an AR device, a user, and a CPU. DETAILED DESCRIPTION

[0051] Figure 1A system 1 for activating a function or functional test of a medical device according to the present disclosure is shown in a schematic diagram. A camera 4 is attached to / in an AR glasses (AR device) 2 and includes a defined field of view 6. The field of view 6 includes, for example, a dialysis machine 8 as a medical device, the medical device having a disposable 10, the disposable 10 being attached to the medical device and in this case being a line (blood line, dialysate line) intended for replacement and a dialyzer of the dialysis machine 8. In addition, at least one CPU connected to the camera 4 is provided. This CPU may be a fixed, possibly device-specific computing unit or a mobile AR glasses-specific computing unit, in which case the AR glasses may only have a data transmission unit. A CPU (not shown), preferably located in the dialysis machine 8 and / or on the AR glasses 2, identifies the actual arrangement (actual state) of the disposable 10 and compares it with the desired arrangement (desired state) stored in the storage medium of the CPU or retrieved via WLAN by an image analysis algorithm. If the algorithm identifies that the disposable 10 is not correctly / not fully attached, a correction step in the user's field of view corresponding to the field of view 6 of the camera 4 is superimposed in the AR glasses 2. If the algorithm identifies that the disposable 10 is correctly attached, the CPU issues a command to the dialysis machine 8 to perform a function or a function test, preferably via WLAN or Bluetooth, etc. If the function test is positive, this is displayed on the AR glasses 2. If the function test is negative, the corresponding required correction steps are displayed on the AR glasses 2.

[0052] Figure 2 A method for activating a function / functional test of a device (dialysis machine 8 ) is shown taking into account the above system 1 .

[0053] In step 112, the camera 4 identifies the actual state of the dialysis machine 8. In other words, the camera 4 captures one or more images which display / document the current actual state.

[0054] In step 114, the CPU compares the actual state of the dialysis machine 8 with the desired state of the dialysis machine 8. In other words, the image from the camera 4 of step 112 is compared with the stored image on the CPU and pattern recognition is used to determine whether the current state corresponds to the desired state. If such a comparison is not possible, for example due to an unsuitable image, step 112 is performed again until an image showing the actual state is obtained and can be compared with the desired state. This repetitive process or the presence of an unsuitable image can be displayed on the AR device, for example, with a preferred message / correction instruction indicating, for example, that a change in the viewing angle is required. If a comparison of the actual state with the desired state is achieved, the next step is performed.

[0055] In step 116, the CPU transmits a command for starting a functional test to the dialysis machine 8. In other words, once the CPU has made a positive comparison and evaluation, a command is issued to the medical device / dialysis machine instructing a functional / functional test to check whether the components perform in a functionally correct manner.

[0056] In step 118, the dialysis machine 8 performs a function or a function test. In other words, a corresponding action is performed on the dialysis machine 8 in response to a command from the CPU.

[0057] In step 120, the dialysis machine 8 transmits the functional test result to the CPU, or the CPU measures the test result and then displays the result graphically on the AR glasses 2. Here, the result is preferably the pressure / pressure curve prevailing / induced for test purposes in the disposable / line.

[0058] Figure 3 The schematic diagram shows a Figure 2 Augmented reality guided system 1 for activating a function or functional test of a medical device according to the present disclosure. A camera 4 is attached to / on the AR glasses 2 and includes a defined field of view 6. The field of view 6 (corresponding to Figure 3 ) includes, for example, a dialysis machine 8 (medical device) having disposables 10 (e.g., fluid lines, tubing, dialyzers, etc.) attached thereto. Windows 122, 124, and 126 are superimposed in the field of view, as well as arrows representing instructions for processing (e.g., a straight arrow next to window 122 and a semicircular arrow next to window 124). The first window 122 may include instructions such as "Put the tube through the connector." The second window 124 may include instructions such as "Insert the blood collection tube into the blood pump as shown in the video." The size of the third window 126 located at the bottom edge may be different from the size of one of the other windows, for example, larger, and a video, for example, a YouTube video, may be shown in this window.

[0059] Figure 4 A schematic diagram showing possible interactions between an AR device, a user, and a CPU. Figure 4 , the method is divided into method steps performed by the AR device (see column 128), method steps performed by the user (see column 130), and method steps performed by the medical device (see column 132).

[0060] In step 134 , the AR device and the CPU attached thereto identify that the task “Connect Disposables” has been identified.

[0061] In step 136 , the medical device is informed that the task “connect disposables” has been identified.

[0062] In step 138 , the medical device is prepared for functional testing.

[0063] In step 140, the user then installs the pipeline.

[0064] In step 142 , the AR device identifies that a line has been connected, and may additionally or alternatively check for improperly connected lines.

[0065] In step 144, the medical device is notified that the disposable has been installed.

[0066] In step 146 , the medical device performs a functional test of the line.

[0067] In step 148 , the medical device notifies the AR device of a positive test or result.

[0068] In step 150, the result is displayed in the AR device. If the result is negative, the steps of step 142 are repeated.

[0069] If everything goes well, then in step 152 , the next step is displayed in the AR device.

Claims

1. A method for activating or performing a functional test of a blood treatment device (8), comprising the following steps: ● detecting the actual state of the blood treatment device (8) by means of a camera (4), comparing the actual state of the blood treatment device (8) with a target state of the blood treatment device (8) by means of a control unit (CPU) connected to the camera (4), Based on the comparison, a command for starting the functional test is transmitted by the control unit (CPU) to the blood treatment device (8), - Based on the command, activating the functional test of the blood treatment device (8).

2. The method according to claim 1, further comprising the following steps: ● Transmitting the functional test results to the control unit (CPU), ●Displaying the functional test results in the augmented reality device (2).

3. The method according to claim 2, further comprising the following steps: ● Superimposing the necessary steps to be performed in order to achieve the target state of the blood treatment device (8) in the augmented reality device (2).

4. The method according to claim 1, further comprising the following steps: In case of a negative functional test result, further functional testing is prevented.

5. The method according to claim 1, further characterized in that The functional test is a self-test of the blood treatment device (8) for checking installation actions performed by a user during installation of the blood treatment device (8).

6. The method according to claim 1, further characterized in that The functional test is a pressure test which measures the pressure temporarily built up in a disposable attached to or arranged in the blood treatment device (8) for testing purposes.

7. The method according to claim 1, further characterized in that The camera (4) is arranged in or attached to the augmented reality device (2).

8. A system comprising: at least one camera (4); at least one control unit (CPU), which is or can be in data connection with the camera (4); and at least one blood treatment device (8), which in turn is or can be in data connection with the control unit (CPU), characterised in that the control unit (CPU) is configured to ● detecting the actual state of the blood treatment device (8) by means of the camera (4), comparing the actual state of the blood treatment device (8) with a target state of the blood treatment device (8), Based on the comparison, a command for starting a functional test is transmitted to the blood treatment device (8), and - Based on the command, activating the functional test of the blood treatment device (8).

9. The system according to claim 8, characterized in that The camera (4) is attached to or arranged in an augmented reality device (2), which is configured to display functional test results and / or further steps to be performed by a user.

10. The system of claim 8, wherein The functional test is a self-test of the blood treatment device (8) for checking installation actions performed by a user when installing the blood treatment device (8).

11. The system of claim 8, further characterized in that The functional test is a pressure test which measures the pressure temporarily built up in a disposable attached to / or arranged in the blood treatment device (8) for testing purposes.

12. The system of claim 8, further characterized in that The camera (4) is arranged in or attached to the augmented reality device (2).

Images