Method for reading portable electronic devices and machine-readable identifiers

Abstract

This disclosure relates to a portable electronic device (50), comprising: - a camera (52) operable to capture an image (21) of a medical device (1), wherein the medical device (1) is provided with a machine-readable identifier (24); - an electronic reader (54) operable to read a machine-readable identifier (24) when aligned with the machine-readable identifier (24); - an electronic display (56) operable to visualize the captured image (21) of the medical device (1); The present invention relates to a portable electronic device (50) comprising a processor (60) connected to a camera (52) and an electronic display (56), the processor (60) being operable to display the virtual contour (22) on the electronic display (56) such that, when an electronic reader (54) is aligned with a machine-readable identifier (24), the virtual contour (22) of a medical device (1) matches and / or overlaps with a captured image (21) on the electronic display (56). The portable electronic device (50) may further include an electronic device identifier (61) which includes or provides spatial image offset information (71, 72) indicating a spatial offset between the camera (52) and the electronic reader (54), the spatial offset information (71, 72) may be used to calibrate the match of the overlap between the captured image (21) and the virtual contour (22).

Description

Technical Field

[0001] The present disclosure relates to the field of medical devices, particularly to user assistance for using or operating medical devices such as infusion devices. In one aspect, the present disclosure relates to a portable electronic device configured to assist a user in the use of a medical device. In a further aspect, the present disclosure relates to a system including a medical device and a portable electronic device. In yet another aspect, the present disclosure relates to a method of reading a machine-readable identifier provided within or on a medical device and further relates to a computer program for a portable electronic device.

Background Art

[0002] Drug delivery devices that enable multiple administrations of a required dose of a liquid pharmaceutical and further provide administration of such a liquid drug to a patient are well known in the prior art as such. Generally, such devices have substantially the same purpose as that of a normal syringe. Typically, the pharmaceutical to be administered is provided within a cartridge having a movable piston or stopper that mechanically interacts with the piston rod of the drive mechanism of the drug delivery device. By applying a thrust force to the piston, a specific predetermined amount of the pharmaceutical fluid is discharged from the drug container.

[0003] In the field of home medication or self-medication, a user or patient may be provided with a medical device such as an infusion device for performing, for example, an injection procedure. Such a medical device may be implemented purely mechanically or electrically. Some medical devices such as injection pens may be implemented purely mechanically and may be manually operated by a user to inject a dose of a drug. Some infusion devices are implemented as disposable infusion devices. They may comprise a pre-filled drug container. The drug container may be pre-assembled inside the infusion device. Such an infusion device may be distributed to a patient or user in a situation or state where the device is ready for use. Here, the device may represent a combination of a drug device and may be intended or configured to be discarded after use.

[0004] Medical devices configured and intended for home or self-administration of medication through a user or patient may be electronically coupled with external or portable electronic devices, such as smartphones, tablet computers, smartwatches, or so-called auxiliary or add-on devices configured to work with the medical device or infusion device. Such external devices may assist the user, for example, when administering medication in the form of a dose infusion procedure and when monitoring the operation of the infusion device and / or medication administration procedure. Portable electronic devices such as smartphones, tablet computers, or smartwatches may be capable of operating to electronically pair with medical devices, such as infusion devices. In particular, portable electronic devices or add-on devices configured to be detachably attached to a medical device or infusion device may provide automatic or semi-automatic recording or tracking of a large number of dose administration or dose infusion procedures.

[0005] An electronic connection between a portable electronic device and a medical device or infusion device may be useful for recording and / or remembering the single or repeated use of the medical device or infusion device.

[0006] Medical devices such as infusion devices or drug containers may be provided with unique identifiers indicating, for example, the type, quantity, drug management lot number, manufacturing date, manufacturing location, and / or expiration date of the drug placed or stored within each medical device. Some portable electronic devices may provide automatic or semi-automatic retrieval of medical device identifiers to obtain information about the drugs provided or stored within the medical device or drug container.

[0007] The capture or retrieval of information provided by identifiers of medical devices, such as infusion devices, may be provided electronically. Therefore, identifiers of medical devices or drug containers associated with medical devices may be machine-readable or suitable for machine reading and may be autonomously read or captured by portable electronic devices. Automatic or machine-based reading of machine-readable identifiers of medical devices or drug containers may require a fairly specific relative position or orientation between the portable electronic device and the medical device.

[0008] Depending on the technical implementation of machine reading, portable electronic devices may need to be held at a clearly defined position, distance, and / or orientation relative to the medical device in order to enable automatic or machine-based retrieval of information stored in the medical device's machine-readable identifier.

[0009] In particular, in situations where machine-readable identifiers are not directly visible on the exterior of the medical device, or where it may be difficult for the patient or user to correctly orient or position the portable electronic device relative to the medical device, it may be extremely difficult for the user or patient to position or orient the portable electronic device to the medical device in a predetermined position or orientation relative to the medical device in order to enable automatic or machine-based reading. [Overview of the Initiative] [Problems that the invention aims to solve]

[0010] Therefore, it is desirable to provide improvements to portable electronic devices and methods for reading machine-readable identifiers provided in or on medical devices. To enable fast, reliable, and complete reading of machine-readable identifiers provided in or on medical devices, it would be particularly beneficial to simplify the process of correctly aligning, positioning, or orienting portable electronic devices relative to medical devices. To enable automated or machine-based reading of machine-readable identifiers, it would be particularly beneficial to assist users in correctly orienting or positioning portable electronic devices relative to medical devices. [Means for solving the problem]

[0011] In one embodiment, the disclosure relates to a portable electronic device. The portable electronic device includes a camera capable of capturing images of a medical device. The medical device is provided with a machine-readable identifier. The portable electronic device further includes an electronic reader capable of reading the machine-readable identifier when aligned with it. In this regard, the electronic reader is aligned with the machine-readable identifier when the electronic reader is at least one of a predetermined distance from the machine-readable identifier, a predetermined relative orientation to the machine-readable identifier, and a predetermined position relative to the machine-readable identifier. In other words, the electronic reader is capable of reading the machine-readable identifier when the electronic reader is within reading distance and correctly oriented, for example, to a reading orientation relative to the machine-readable identifier. Otherwise, when the electronic reader is outside the reading distance or reading orientation, the electronic reader may not be capable of reading the machine-readable identifier of the medical device.

[0012] The portable electronic device further includes an electronic display. The electronic display is capable of visualizing images captured by the medical device. The portable electronic device also includes a processor connected to the camera and further connected to the electronic display. The processor may be capable of processing image data generated and acquired from the camera and using the image data to visualize images captured by the camera on or within the electronic display.

[0013] The processor is further operable to display a virtual contour on the electronic display such that, when the electronic reader is aligned with a machine-readable identifier, the virtual contour of the medical device matches and / or overlaps with the captured image of the medical device on the electronic display. In other words, the processor is operable to display a virtual contour on the electronic display such that, when the electronic reader is aligned with a machine-readable identifier, the virtual contour of the medical device matches and / or overlaps with the captured image on the electronic display.

[0014] In this way, the portable electronic device is provided with assistive functions used by the camera, processor, and electronic display of the portable electronic device to align the portable electronic device, i.e., to the reading distance and / or reading orientation to a machine-readable identifier, so that when the portable electronic device is correctly aligned with the machine-readable identifier of the medical device, the electronic reader of the portable electronic device can read or capture the machine-readable identifier provided in or on the medical device.

[0015] A fairly intuitive approach is provided for correctly aligning and / or positioning a portable electronic device relative to a medical device, enabling automatic or machine-based data retrieval from machine-readable identifiers by displaying the virtual contour of the medical device on the electronic display of the portable electronic device simultaneously with a captured image of the medical device. Here, the captured image may be captured by the camera of the portable electronic device and represent a live view of the temporary configuration or position of the medical device.

[0016] In other words, the portable electronic device has its simultaneous visual illustration of the virtual contour of the medical device and a captured image of the medical device temporarily captured by the portable electronic device's camera, providing a fairly intuitive approach to help the user correctly align or orient the portable electronic device and the medical device relative to each other.

[0017] In some cases, portable electronic devices provide users with a form of augmented reality. Virtual contours provided on the display of a portable electronic device may represent the target location and / or target direction of a medical device, ensuring that when the medical device is reached, the electronic reader is correctly aligned with the machine-readable identifier of the medical device.

[0018] In some cases, the virtual contours displayed on the electronic display of a portable electronic device are fairly static. These virtual contours can be artificially generated on the electronic display. In other cases, the virtual contours are dynamic and may also be visually altered by changing circumstances or altered relative positions of the medical device and the portable electronic device.

[0019] In some examples, the camera and electronic reader of a portable electronic device are located at different positions on the device. They may be provided and positioned relative to each other with a predetermined spatial offset. To that extent, positioning and aligning the camera of a portable electronic device with respect to a machine-readable identifier may be insufficient to provide the electronic reader of the portable electronic device with the default or required alignment of the machine-readable identifier.

[0020] In another example, a portable electronic device includes an electronic device identifier that includes or provides spatial image offset information indicating the spatial offset between a camera and an electronic reader. The electronic device identifier may be stored in the memory or storage of the portable electronic device. The electronic device identifier may indicate spatial image offset information, and therefore the spatial offset between the camera and the electronic reader of the medical device. The spatial image offset information may also indicate the relative position and / or relative orientation between the camera and the electronic reader, for example, with respect to the contour or housing geometric shape of the portable electronic device.

[0021] Specifically, spatial image offset information represents the hardware-specific configuration of a portable electronic device and may differ between different portable electronic devices. Therefore, in some manufacturers or models of portable electronic devices, the camera and electronic reader may overlap approximately axially. In other manufacturers or models of portable electronic devices, a considerably large spatial offset may exist between the camera and the electronic reader of the portable electronic device. The electronic device identifier includes information about at least the manufacturer and specific type of the portable electronic device. For each unique electronic device identifier, spatial image offset information may be provided indicating the spatial offset and / or relative position or orientation between the camera and the electronic reader of the respective portable electronic device.

[0022] The processor of a portable electronic device may be operable to read and / or process spatial image offset information in order to calibrate the visual guidance functions provided by the processor. Thus, when first spatial image offset information is provided to a first type of portable electronic device having a first electronic device identifier and processed by the processor, a first virtual contour of the medical device is generated at a first position and / or first orientation on the electronic display of the portable electronic device.

[0023] In another portable electronic device, for example, a second portable electronic device of a different type, a second electronic device identifier may be provided that includes or represents second spatial image offset information, which is similarly processable by a processor. Each second spatial image offset information may be processed by the processor of the respective portable electronic device to generate a second virtual contour of the medical device, which may differ on an electronic display from at least one of the size, position, or orientation of a first virtual contour of the medical device.

[0024] Electronic device identifiers enable the implementation of computer programs, software, or software applications, such as apps for portable electronic devices, that can operate on a variety of different types of portable electronic devices, distinguished, for example, by their hardware configuration, particularly by the position, orientation, or distance of the camera relative to the electronic reader. Electronic device identifiers allow each computer program or software executed by a portable electronic device to be universally adaptable to different types of portable electronic devices.

[0025] In other words, based on the electronic device identifier, the processor of each portable electronic device can be individually calibrated for each fairly specific hardware implementation form of the portable electronic device. In this way, an augmented reality guidance function for assisting a user to correctly position or orient a portable electronic device with respect to a medical device can be deployed with various portable electronic devices of different manufacturers or different types.

[0026] According to another example, the portable electronic device includes a memory. The memory is operable or configured to store spatial device offset information indicating a spatial offset between a machine-readable identifier and at least one of a visual mark on the medical device and the contour of the medical device. In some examples, the visual mark and / or contour of the medical device may be recognizable in a captured image visualized on the electronic display of the portable electronic device. Based on further information regarding the spatial offset between the machine-readable identifier and at least one of the visual mark and the contour of the medical device, the visual mark and / or contour of the medical device can be used to define or arrange the machine-readable identifier on or inside the medical device. In other words, using clearly defined or pre-established spatial device offset information indicating the spatial offset between the machine-readable identifier and at least one of the visual mark and the contour or geometric shape of the medical device itself, the machine-readable identifier can be arranged based on recognizing at least one of the visual mark, the contour, and / or the outer geometric shape in the captured image on the electronic display.

[0027] In another example, the processor of a portable electronic device can be operated to display a virtual contour of a medical device on an electronic display with respect to at least one of spatial image offset information and spatial device offset information. Here, at least one of spatial image offset information and spatial device offset information characteristic of the type of portable electronic device and / or the type of medical device may be used, respectively, to provide accurate calibration of the spatial alignment function provided by the portable electronic device. In particular, the virtual contour of a medical device can be correctly displayed or illustrated on an electronic display for different portable electronic devices using their respective spatial image offset information, so that when it matches or overlaps with the captured image on the electronic display, the electronic reader of each portable electronic device is correctly aligned with the machine-readable identifier of the medical device.

[0028] Spatial device offset information may be used in the same or similar manner to provide accurate alignment between an electronic reader and a machine-readable identifier for different types of medical devices. Here, the portable electronic device may be provided with at least general information regarding the spatial device offset information. The portable electronic device is intended to be used with a medical device of a type or class that matches the spatial device offset information stored in the portable electronic device's memory.

[0029] In some examples, a portable electronic device may be configured or pre-configured to be used only with one or more types of medical devices, each of which is assigned the same spatial device offset information between a machine-readable identifier, a visual mark on the medical device, and at least one of the contours of the medical device. If the portable electronic device is always used with this type or class of medical device, the spatial device offset information stored in the memory of the portable electronic device may be used in addition to or instead of the spatial image offset information to provide or establish correct alignment between the machine-readable identifier and the electronic reader based on the spatial overlap or coincidence between the virtual contour of the medical device and the captured image.

[0030] According to another example, a processor is operable to recognize at least one of the position and orientation of at least one of a medical device and an electronic identifier in a captured image as a so-called recognized item. In that regard, the processor may be operable to autonomously or automatically recognize at least one of a medical device, such as the contour or geometric shape of the medical device, and an electronic identifier in the captured image. Such automatic or semi-automatic item recognition may further assist the user in positioning or aligning the portable electronic device with respect to the medical device, and vice versa.

[0031] The automatic, and thus processor-assisted, recognition of at least one of the orientation or position of the electronic identifier and the medical device may be further used by the processor and / or the user to facilitate the process of correctly aligning the portable electronic device with respect to the medical device.

[0032] In some examples, the processor may also be capable of recognizing visual markers provided on the medical device, which may then be further used by the processor and / or the user of the portable electronic device to correctly align the portable electronic device with the medical device, and as a result, the electronic reader may be capable of aligning with the machine-readable identifier in a default manner, enabling it to read information from the machine-readable identifier.

[0033] In a further example, the processor may be configured to modify the appearance of the virtual contour on the electronic display depending on the degree of match and / or overlap between the recognized item and the virtual contour. In this way, the processor may provide further user assistance to facilitate user-performed mutual alignment between portable electronic devices and medical devices.

[0034] The appearance of the virtual contour can be modified in several different ways. Modifying the visual appearance of the virtual contour further helps guide or assist the user in correctly aligning the portable electronic device with the medical device. This provides the user with immediate visual feedback in response to the user's guided movement of the medical device relative to the electronic device.

[0035] Changes in the appearance of the virtual contour may indicate a mismatch in distance and / or orientation between the machine-readable identifier of the medical device and the electronic reader of the portable electronic device. Changes in the distance and / or orientation of the machine-readable identifier relative to the electronic reader, which may be detected through the evaluation of the recognized item by the processor, may induce changes in the appearance of the virtual contour of the medical device on the electronic display. Changes in the appearance of the virtual contour may directly indicate to the user that the degree of match and / or overlap between the electronic reader and the machine-readable identifier has changed significantly, for example, decreased or increased.

[0036] In another example, the processor may be able to operate to change at least one of the structure, color, brightness, contrast, and transient appearance of a virtual contour in response to changes in the degree of match between the recognized item and the virtual contour, and / or changes in overlap. For example, if the degree of match or overlap between the recognized item and the virtual contour is quite low, the virtual contour may appear on the display with a relatively high degree of brightness and / or contrast. As the degree of match or overlap increases, the brightness and / or contrast of the virtual contour may decrease.

[0037] In another example, the color of the virtual contour can also change. For instance, if the degree of match or overlap with the recognized item is relatively low, the virtual contour may be represented by a defined color, such as red. As soon as the degree of match and / or overlap between the recognized item and the virtual contour increases, the color may change toward yellow. Further, near-perfect, or intended match between the recognized item and the virtual contour may cause the color of the virtual contour to change to green, thereby intuitively indicating to the user that the default alignment or orientation of the machine-readable identifier to the electronic reader has been achieved.

[0038] Similarly, the brightness and / or contrast of the virtual contour, as well as its geometric structure, may undergo gradual or continuous changes as the degree of agreement and / or spatial overlap between the recognized item in the captured image and the virtual contour provided on the electronic display changes.

[0039] In another example, the processor of a portable electronic device may be further capable of displaying a virtual image on an electronic display such that, when the electronic reader is aligned with a machine-readable identifier, the transparent or semi-transparent virtual image of the medical device matches and / or overlaps with the captured and reproduced image on the electronic display.

[0040] Transparent or semi-transparent virtual images may further provide a three-dimensional guidance function for the user to position the portable electronic device in a clearly defined and / or predetermined orientation or position relative to the medical device in all three spatial dimensions.

[0041] Transparent or semi-transparent virtual images can also be used to change the three-dimensional position or orientation of a medical device relative to a portable electronic device. In the case of a medical device, and therefore a three-dimensional object including, for example, a pen-type injector, the device housing may be elongated and tubular. Here, the electronic reader may be provided at a clearly defined tangential or circumferential position on the outer circumference of the tubular housing of the medical device. Correct readings of machine-readable identifiers may require a specific orientation of the medical device with respect to its longitudinal axis relative to the portable electronic device, and therefore a specific rotational position.

[0042] Transparent or semi-transparent virtual images, provided that the portable electronic device is required to be used with a specific type or class of medical device, and that the respective spatial device offset information is stored in the memory of the portable electronic device, can be presented on an electronic display simultaneously with the visualization of, for example, a temporarily captured image acquired by the camera of the portable electronic device.

[0043] Transparent or semi-transparent virtual images may also include or reproduce visual marks provided on the exterior of the medical device. Here, for example, based on such visual marks, a user or patient may rotate the medical device as needed relative to a portable electronic device, so that the virtual contour of the medical device overlaps with the recognized item, and therefore the captured image of the medical device, and the medical device is also rotated or oriented in a predetermined manner so that the machine-readable identifier typically faces directly toward the electronic reader of the portable electronic device.

[0044] In some examples, the visual mark may include a transparent or semi-transparent virtual image and may characterize at least one of a medical device and the drug container of the medical device. The visual mark may distinguish the medical device from other medical devices. In the same or similar manner, the visual mark may also distinguish the drug container from other drug containers. Even when housed or positioned inside the casing of a medical device, the drug container may be visible from the outside, at least to the extent that the visual mark provided on the drug container is visible and therefore can be captured by a camera of a portable electronic device.

[0045] External visual markers on medical devices may be configured to overlap with the transparent or semi-transparent virtual visual markers of the transparent or semi-transparent virtual image of the medical device.

[0046] In another example, the electronic reader of a portable device includes a Near Field Communication (NFC) transceiver. The NFC transceiver requires a clearly defined position and / or orientation of the medical device having its machine-readable identifier relative to the electronic reader. Typically, the machine-readable identifier should face directly towards the electronic reader, and vice versa. In some examples, the spatial distance between the electronic reader and the machine-readable identifier should be less than 5 cm, less than 4 cm, less than 3 cm, less than 2 cm, or even less than 1 cm or less than 5 mm.

[0047] The transverse spatial offset between the electronic reader and the machine-readable identifier should be less than 5 cm, less than 4 cm, less than 3 cm, less than 2 cm, or less than 1 cm.

[0048] In this way, when an electronic reader, for example in the form of an NFC transceiver, is within a predetermined distance or range, the electronic reader can accurately and reliably read the electronically stored information of a machine-readable identifier. In an electronic reader including an NFC transceiver, the machine-readable identifier is typically implemented as an NFC tag provided on or inside the casing of a medical device. The machine-readable identifier may be provided on or inside a drug container, such as a cartridge filled with a pharmaceutically active substance.

[0049] In another example, the electronic reader includes an RFID reader, and the machine-readable identifier includes the respective RFID tag.

[0050] Machine-readable identifiers can be implemented as passive machine-readable electronic circuits that do not have their own electrical energy supply.

[0051] In another example, a machine-readable identifier may include an optical code or an optical-readable identifier, where, for example, a two-dimensional visual code on the outer surface of a medical device housing.

[0052] In another aspect, the disclosure relates to a system including the medical device and portable electronic device described above. The medical device includes a housing and a machine-readable identifier on or inside the housing. The machine-readable identifier may be provided on the outer surface of the housing. In some examples, the machine-readable identifier may be located inside the housing and may be concealed by the housing. The machine-readable identifier may not be visible from outside the housing. The portable electronic device includes the electronic reader described above, which is operable to read the machine-readable identifier of the medical device when aligned with the machine-readable identifier.

[0053] Alignment with a machine-readable identifier means that the distance between the machine-readable identifier and the electronic reader is less than or equal to the electronic reader's predetermined transmission range. In some cases, it may also be necessary for the electronic reader to be aligned to a default orientation of the machine-readable identifier. When the electronic reader is implemented as an NFC transceiver, the misalignment between the machine-readable identifier and the electronic reader may be less than 5 cm, less than 4 cm, less than 3 cm, less than 2 cm, less than 1 cm, or less than 5 mm.

[0054] The system includes the portable electronic devices described above. To that extent, all the features, effects, and benefits described above with respect to the portable electronic devices apply equally to the medical devices and the system including the portable electronic devices.

[0055] In a further example of the system, the medical device includes an infusion device. The infusion device may be implemented as a handheld infusion device. The infusion device may include a drug container filled with a liquid drug and may further include an infusion needle fluidly connected inside the drug container. In some examples, the infusion device includes at least one of a plunger and a piston slidably disposed inside the drug container. The drug container may be implemented as a cartridge filled with a liquid drug and include a tubular barrel in which the plunger or piston is longitudinally movable. By displacing the plunger or piston relative to the barrel, a clearly defined amount of drug, for example, a dose of drug, may be discharged, typically through an outlet of the drug container located at or near the distal end of the drug container.

[0056] In some examples, the infusion device includes an infusion pen. The infusion pen may be implemented as a mechanically operated device, and the user needs to drive or bias the plunger or piston distally to provide sufficient dispensing force to dispense a dose of the drug from the drug container.

[0057] In some cases, the medical device or infusion device is implemented as a so-called autoinjector. Here, the user only needs to initiate the dispensing procedure by mechanically bringing the housing of the infusion device into contact with the skin, for example by activating a trigger, and / or by pushing or moving the housing of the infusion device toward or towards the injection site on the patient's skin. With the autoinjector, a needle configured to puncture or penetrate the patient's tissue can automatically advance and enter the patient's skin. With the autoinjector, after puncturing the patient's skin, the autoinfusion procedure can be initiated or continued, thereby injecting a clearly defined amount of drug, i.e., dose, through the injection needle into biological tissue, e.g., the patient's tissue.

[0058] In some examples, the infusion device includes an infusion pen that allows or provides the setting and dispensing of variable-sized doses. In some examples, the infusion device is configured to set and infuse multiple doses of equal or different sizes, and the user can adjust the size of the dose being infused. In other examples, the infusion device is a fixed-dose device. A fixed-dose device may be implemented as a disposable device in which the drug and / or drug container is easily stored and / or assembled inside the housing of the infusion device.

[0059] In a further example, the infusion device is a reusable infusion device that provides replacement of empty product cartridges with drug-filled cartridges or drug containers.

[0060] In some examples, the medical device itself, such as the casing of a medical device configured to receive or house a drug container or cartridge, is provided with a machine-readable identifier. In other examples, the casing is a drug container placed inside a medical device for which a machine-readable identifier is provided. In this way, the information stored or provided by the machine-readable identifier indicates the characteristics of the drug stored therein.

[0061] In another example, a medical device includes a drug container filled with medication. An infusion device or medical device may be implemented as a single-use, disposable medical device intended to be discarded entirely after the consumption or use of the medication initially stored therein.

[0062] In a further aspect, the Disclosure relates to a method for reading machine-readable identifiers provided in or on a medical device using a portable electronic device. Thus, the portable electronic device is used to read machine-readable identifiers provided in or on a medical device, the medical device is typically implemented as an infusion device. The portable electronic device includes a camera, an electronic reader, and an electronic display. The method further includes the steps of capturing an image of the medical device with the camera of the portable electronic device; displaying a virtual outline of the medical device on the electronic display; visualizing the captured image of the medical device on the electronic display; and moving the medical device relative to the portable electronic device on the electronic display to match and / or at least partially overlap the captured image with the virtual outline of the medical device, thereby setting the electronic reader to one of the reading distances or reading orientations for the machine-readable identifier.

[0063] In other words, the virtual contour of the medical device is matched to and / or partially superimposed on the captured image, making the electronic reader one of the reading distances or reading orientations for a machine-readable identifier. Typically, the movement, orientation, or alignment of the portable electronic device relative to the medical device is assisted or guided by displaying the virtual contour of the medical device on the electronic display simultaneously with a temporarily captured image of the medical device. To that extent, the virtual contour displayed on the electronic display provides a kind of augmented reality for making the electronic reader of the portable electronic device one of the reading distances or reading orientations for a machine-readable identifier provided in or on the medical device.

[0064] The method for reading machine-readable identifiers is typically performed on a portable electronic device either after or in conjunction with the system described above. To that extent, all the features, effects, and advantages described above in relation to portable electronic devices and systems apply equally to the method for reading machine-readable identifiers, and vice versa.

[0065] In another example, the method further includes obtaining or acquiring at least one of spatial image offset information and spatial device offset information, where spatial image offset information indicates the spatial offset between the camera and the electronic reader of the electronic device; spatial device offset information then indicates the spatial offset between a machine-readable identifier and at least one of a visual mark on the medical device and the contour of the medical device.

[0066] The method further includes displaying a virtual contour of a medical device on an electronic display with respect to at least one of spatial image offset information and spatial device offset information. The spatial image offset information is typically a characteristic of a particular type or hardware configuration of a portable electronic device actually used in a manner that reads a machine-readable identifier.

[0067] In general, a variety of different configurations of portable electronic devices may be used to read machine-readable identifiers provided within or on medical devices. The position and / or orientation of the machine-readable identifier on the electronic display can be adapted and modified according to the device-specific configuration of the portable electronic device, using spatial image offset information that may be characteristic of each available portable electronic device. Thus, the method can be universally used with a variety of different portable electronic devices, distinguished by their hardware configurations, and particularly by geometric or spatial offsets between the camera and the electronic reader.

[0068] Similarly, or simultaneously, spatial device offset information for a particular medical device may also be used by a method for reading a machine-readable identifier, where the spatial device offset information may indicate the spatial offset between the machine-readable identifier and at least one of a visual mark on the medical device and the contour of the medical device.

[0069] Spatial device offset information, and therefore the spatial offset between a machine-readable identifier and one of the visual marks and contours of a medical device, may be particularly used to provide correct alignment between an electronic reader and a machine-readable identifier. The spatial device offset information may indicate that the machine-readable identifier is provided at a specific position relative to or with respect to the contours and visual marks on the medical device.

[0070] For a given type or class of medical device, spatial device offset information may always be the same, and a portable electronic device may be specifically configured to communicate with or read the machine-readable identifier of this particular type or class of medical device. The spatial device offset information available to the portable electronic device, for example by default or stored in its memory, can provide accurate alignment of the machine-readable identifier for an electronic reader based on the spatial device offset information.

[0071] In another example, the method also includes recognizing at least one location and orientation of a medical device and an electronic identifier in the captured image as a recognized item. Here, the processor may be provided with image processing capabilities, the processor may automatically recognize or track a predetermined spatial pattern of an electronic identifier and / or at least one contour of a medical device, and the recognition of the location or orientation of an electronic identifier and / or a medical device in the captured image may be assigned as a recognized item. In this way, the processor may be operable to identify or recognize a machine-readable identifier, and therefore a class or type of medical device in the captured image, thereby providing enhanced capabilities for appropriately overlaying or matching the captured image of the medical device with a virtual contour simultaneously provided on an electronic display.

[0072] In another example, the method also includes changing the appearance of the virtual contour on an electronic display depending on the degree of match and / or overlap between the recognized item and the virtual contour. The change in the appearance of the virtual contour may be controlled by the degree of match and / or overlap between the recognized item and the virtual contour.

[0073] In a further aspect, the disclosure relates to a computer program including a computer executable instruction that, when executed by the processor of a portable electronic device, causes the processor to capture an image of a medical device with the camera of the portable electronic device. The computer executable instruction further causes the processor to display a virtual outline of the medical device on an electronic display, and simultaneously visualize the captured image of the medical device on the electronic display.

[0074] In some examples, a computer program is executable by the processor of the electronic device described above and is configured to perform or implement the individual steps of the method for reading the machine-readable identifier of the medical device described above. To that extent, all the features, effects and advantages described above relating to portable electronic devices, the medical device and the system including the portable electronic device, and the method for reading the machine-readable identifier provided in or on the medical device apply equally to the computer program along with its computer-executable instructions, and vice versa.

[0075] A computer program may be deployed or installed as an application on a portable electronic device, such as a smartphone, tablet computer, or smartwatch. A computer program may be universally usable on a variety of portable electronic devices, including those provided by various manufacturers and / or with various or different configurations. A computer program may be universally usable or executable by a variety of portable electronic devices distinguished by their hardware and / or software configurations. Therefore, a computer program may be executable by a first type or class of portable electronic device, including a camera and an electronic reader, which are positioned at a first spatial offset relative to each other. Here, the respective spatial image offset information may be provided by the computer program based, for example, on hardware recognition of the portable electronic device.

[0076] Similarly, a computer program may also be executable by a second type or class of portable electronic device, where the electronic reader and camera are positioned at a second spatial offset relative to each other, distinct from the first spatial offset. Here, by obtaining spatial image offset information that indicates a specific hardware implementation of the portable electronic device, the computer program can also be adapted accordingly to correctly display the virtual contour of a medical device on the electronic display of the portable electronic device.

[0077] Generally, the scope of this disclosure is defined by the content of the claims. The portable electronic devices, systems, methods, and computer programs described herein are not limited to any particular embodiment or example, but include any combination of elements of different embodiments or examples. To that extent, this disclosure covers any combination of the claims and any technically feasible combination of features disclosed in connection with different examples or embodiments.

[0078] In this context, the term “distal” or “distal end” refers to the end of the injection device facing the injection site in a human or animal. The term “proximal” or “proximal end” refers to the opposite end of the injection device, which is furthest from the injection site in a human or animal.

[0079] The terms “drug” or “pharmaceutical” are used herein as synonyms and refer to a formulation containing one or more active pharmaceutical ingredients or pharmaceutically acceptable salts or solvates thereof and optionally pharmaceutically acceptable carriers. A pharmacopoeial active ingredient ("API") is, in its broadest sense, a chemical structure that has a biological effect on humans or animals. In pharmacology, drugs or pharmaceuticals are used to treat, cure, prevent or diagnose diseases, or otherwise to improve physical or mental health. Drugs or pharmaceuticals may be used over a limited period or regularly for chronic diseases.

[0080] As described below, drugs or pharmaceuticals may contain at least one API or a combination thereof in various types of formulations for the treatment of one or more diseases. Examples of APIs include small molecules with molecular weights of 500 Da or less, polypeptides, peptides and proteins (e.g., hormones, growth factors, antibodies, antibody fragments and enzymes), carbohydrates and polysaccharides, as well as nucleic acids, double-stranded or single-stranded DNA (including naked and cDNA), RNA, antisense nucleic acids such as antisense DNA and RNA, small interfering RNA (siRNA), ribozymes, genes and oligonucleotides. Nucleic acids may be incorporated into molecular delivery systems such as vectors, plasmids or liposomes. Mixtures of one or more drugs are also possible.

[0081] Drugs or pharmaceuticals may be contained within a primary package or “drug container” adapted for use with a drug delivery device. The drug container may be, for example, a cartridge, syringe, reservoir, or other rigid or flexible vessel configured to provide a chamber suitable for the storage of one or more drugs (e.g., short-term or long-term storage). For example, the chamber may be designed to store drugs for at least one day (e.g., one day to at least 30 days). The chamber may be designed to store drugs for about one month to about two years. Storage may be carried out at room temperature (e.g., about 20°C) or refrigerated temperature (e.g., about -4°C to about 4°C). The drug container may be or include a dual-chamber cartridge configured to store two or more components of the pharmaceutical formulation to be administered (e.g., an API and a diluent or two different drugs) separately, one in each chamber. In such cases, the two chambers of the dual-chamber cartridge may be configured to allow mixing of two or more components before and / or during administration to the body of a human or animal. For example, the two chambers may be configured to be fluidly connected to each other (e.g., by a conduit between the two chambers), allowing the two components to be mixed if desired by the user before administration. Alternatively or additionally, the two chambers may be configured to allow mixing when the components are administered into the body of a human or animal.

[0082] The drugs or agents contained within the drug delivery devices described herein may be used to treat and / or prevent many different types of medical disorders. Examples of disorders include, for example, diabetes mellitus or complications associated with diabetes mellitus, such as diabetic retinopathy, and thromboembolic disorders such as deep vein thromboembolism or pulmonary thromboembolism. Further examples of disorders include acute coronary syndrome (ACS), angina pectoris, myocardial infarction, cancer, macular degeneration, inflammation, hay fever, atherosclerosis, and / or rheumatoid arthritis. Examples of APIs and drugs are listed in the Rote Liste 2014, for example, main group 12 (antidiabetic drugs) or 86 (oncology drugs), and handbooks such as the Merck Index, 15th edition.

[0083] Examples of APIs for the treatment and / or prevention of type 1 or type 2 diabetes mellitus or complications associated with type 1 or type 2 diabetes mellitus include insulin, e.g., human insulin or human insulin analogs or derivatives; glucagon-like peptides (GLP-1), GLP-1 analogs or GLP-1 receptor agonists or their analogs or derivatives; dipeptidyl peptidase-4 (DPP4) inhibitors or their pharmaceutically acceptable salts or solvates or any mixture thereof. As used herein, the terms “analog” and “derivative” refer to polypeptides having a molecular structure that can be formally derived from the structure of a naturally occurring peptide, e.g., human insulin, by deleting and / or substituting at least one amino acid residue in the naturally occurring peptide and / or adding at least one amino acid residue. The amino acid residue added and / or substituted may be an encoding amino acid residue, another naturally occurring residue, or a purely synthetic amino acid residue. Insulin analogs are also referred to as “insulin receptor ligands.” In particular, the term "derivative" refers to a polypeptide having a molecular structure that can be formally derived from the structure of a naturally occurring peptide, such as the structure of human insulin, in which one or more organic substituents (e.g., fatty acids) are bonded to one or more amino acids. Optionally, one or more amino acids present in the naturally occurring peptide may be deleted and / or substituted with other amino acids, including non-coding amino acids, and amino acids including non-coding amino acids may be added to the naturally occurring peptide.

[0084] Examples of insulin analogs include Gly(A21), Arg(B31), Arg(B32) human insulin (insulin glardine); Lys(B3), Glu(B29) human insulin (insulin glulisine); Lys(B28), Pro(B29) human insulin (insulin lispro); Asp(B28) human insulin (insulin aspart); human insulin in which proline at position B28 may be replaced with Asp, Lys, Leu, Val or Ala, and Lys at position B29 may be replaced with Pro; Ala(B26) human insulin; Des(B28-B30) human insulin; Des(B27) human insulin and Des(B30) human insulin.

[0085] Examples of insulin derivatives include, for example, B29-N-myristoyl-des(B30) human insulin, Lys(B29)(N-tetradecanoyl)-des(B30) human insulin (insulin detemir, Levemir®); B29-N-palmitoyl-des(B30) human insulin; B29-N-myristoyl human insulin; B29-N-palmitoyl human insulin; B28-N-myristoylLysB28ProB29 human insulin; B28-N-palmitoyl-LysB28ProB29 human insulin; B30-N-myristoyl-ThrB29LysB30 human insulin These are B30-N-palmitoyl-ThrB29LysB30 human insulin; B29-N-(N-palmitoyl-gamma-glutamyl)-des(B30) human insulin, B29-N-omega-carboxypentadecanoyl-gamma-L-glutamyl-des(B30) human insulin (insulin degludec, Tresiba®); B29-N-(N-litocoryl-gamma-glutamyl)-des(B30) human insulin; B29-N-(ω-carboxyheptadecanoyl)-des(B30) human insulin and B29-N-(ω-carboxyheptadecanoyl) human insulin.

[0086] Examples of GLP-1, GLP-1 analogs, and GLP-1 receptor agonists include, for example, lixisenatide (Lyxumia®), exenatide (Exendin-4, Byetta®, Bydureon®), and Hiramonster (Gila Monster's salivary glands produce a 39-amino acid peptide, liraglutide (Victoza®), semaglutide, taspoglutide, albiglutide (Syncria®), dulaglutide (Trulicity®), r-exendin-4, CJC-1134-PC, PB-1023, TTP-054, langlenatide / HM-11260C (efpeglenatide), HM-15211, CM-3, GLP-1 eligene, ORMD-0901, NN-9423, NN-9709, NN-9924, NN These include -9926, NN-9927, Nodexene, Biador-GLP-1, CVX-096, ZYOG-1, ZYD-1, GSK-2374697, DA-3091, MAR-701, MAR709, ZP-2929, ZP-3022, ZP-DI-70, TT-401 (Pegapamodotide), BHM-034, MOD-6030, CAM-2036, DA-15864, ARI-2651, ARI-2255, Chilzepatide (LY3298176), Bamadutide (SAR425899), Exenatide-XTEN, and Glucagon-XTEN.

[0087] Examples of oligonucleotides include mipomersen sodium (Kynamro®), a cholesterol-lowering antisense drug for the treatment of familial hypercholesterolemia, or RG012 for the treatment of Alport syndrome. Examples of DPP4 inhibitors include linagliptin, vildagliptin, sitagliptin, denagliptin, saxagliptin, and berberine. Examples of hormones include pituitary hormones or hypothalamic hormones or regulatory active peptides such as gonadotropins (follitropin, lutropin, choliongonadotropin, menotropin), somatropin, desmopressin, terlipressin, gonadrelin, triptorelin, leuprorelin, buserelin, nafarelin, and goserelin, and their antagonists.

[0088] Examples of polysaccharides include glucosaminoglycans, hyaluronic acid, heparin, low molecular weight heparin or very low molecular weight heparin or their derivatives, or sulfated forms of the above polysaccharides, such as polysulfated forms and / or pharmaceutically acceptable salts thereof. An example of a pharmaceutically acceptable salt of polysulfated low molecular weight heparin is enoxaparin sodium. Examples of hyaluronic acid derivatives are Hylan GF 20 (Synvisc®) and sodium hyaluronate.

[0089] As used herein, the term "antibody" refers to an immunoglobulin molecule or its antigen-binding portion. Examples of antigen-binding portions of immunoglobulin molecules include F(ab) and F(ab')2 fragments that retain the ability to bind to antigens. Antibodies may be polyclonal antibodies, monoclonal antibodies, recombinant antibodies, chimeric antibodies, deimmunized or humanized antibodies, fully human antibodies, non-human (e.g., mouse) antibodies, or single-chain antibodies. In some embodiments, antibodies may have effector function and be capable of immobilizing complement. In some embodiments, antibodies may have reduced or no ability to bind to Fc receptors. For example, an antibody may be an isotype or subtype, antibody fragment, or mutant having mutations or deletions in the Fc receptor-binding region that do not support binding to the Fc receptor, such as mutations or deletions in the Fc receptor-binding region. The term antibody also includes antigen-binding molecules based on tetravalent bispecific tandem immunoglobulin (TBTI) and / or bivariable region antibody-like binding proteins having crossover binding region orientation (CODV).

[0090] The terms “fragment” or “antibody fragment” refer to polypeptides derived from antibody polypeptide molecules (e.g., antibody heavy and / or light chain polypeptides) that do not contain the full-length antibody polypeptide but still contain at least a portion of a full-length antibody polypeptide capable of binding to an antigen. Antibody fragments may include cleavage portions of full-length antibody polypeptides, but the term is not limited to such cleavage fragments. Examples of antibody fragments useful in the present invention include Fab fragments, F(ab')2 fragments, scFv (single-stranded Fv) fragments, linear antibodies, monospecific or multispecific antibody fragments, e.g., bispecific, trispecific, quadrispecific and multispecific antibodies (e.g., diabodies, triabodies, tetrabodies), monovalent or multivalent antibody fragments, e.g., bivalent, trivalent, quadrivalent and multivalent antibodies, minibodies, chelated recombinant antibodies, tribodies or vibodies, intrabodies, nanobodies, small module immunopharmaceuticals (SMIPs), binding domain immunoglobulin fusion proteins, camelized antibodies, and VHH-containing antibodies. Additional examples of antigen-binding antibody fragments are known in the art.

[0091] The term “complementarity-determining region,” or “CDR,” refers to a short polypeptide sequence within the variable region of both heavy and light chain polypeptides, primarily responsible for mediating specific antigen recognition. The term “framework region,” rather than the CDR sequence itself, refers to an amino acid sequence within the variable region of both heavy and light chain polypeptides, primarily responsible for maintaining the proper arrangement of the CDR sequence to enable antigen binding. While the framework region itself is typically not directly involved in antigen binding, as is well known in the art, certain residues within the framework region of a particular antibody may be directly involved in antigen binding or may influence the ability of one or more amino acids in the CDR to interact with the antigen. Examples of antibodies include anti-PCSK-9 mAbs (e.g., alirocumab), anti-IL-6 mAbs (e.g., sarilumab), and anti-IL-4 mAbs (e.g., dupilumab). Any pharmaceutically acceptable salt of any API described herein is intended for use in drugs or pharmaceuticals within drug delivery devices. Pharmaceutically acceptable salts include, for example, acid addition salts and basic salts.

[0092] Those skilled in the art will understand that modifications (additional and / or deletions) of various components of the APIs, formulations, apparatus, methods, systems, and embodiments described herein can be made without departing from the full scope and spirit of the invention, including any or all of such modifications and their equivalents.

[0093] Exemplary drug delivery devices may include needle-based infusion systems, such as those described in Table 1 of Section 5.2 of ISO 11608-1:2014(E). As described in ISO 11608-1:2014(E), needle-based infusion systems can be broadly classified into multi-dose container systems and single-dose (with partial or full discharge) container systems. Containers may be replaceable or integrated non-replaceable containers.

[0094] As further described in ISO 11608-1:2014(E), a multi-dose container system may involve a needle-based infusion device with replaceable containers. In such a system, each container holds multiple doses, and its size may be fixed or variable (pre-set by the user). Another multi-dose container system may involve a needle-based infusion device with an integrated non-replaceable container. In such a system, each container holds multiple doses, and its size may be fixed or variable (pre-set by the user).

[0095] As further described in ISO 11608-1:2014(E), a single-dose container system may be accompanied by a needle-based infusion device with replaceable containers. In one example of such a system, each container holds a single dose, and the entire deliverable volume is dispensed (total discharge). In a further example, each container holds a single dose, and a portion of the deliverable volume is dispensed (partial discharge). As also described in ISO 11608-1:2014(E), a single-dose container system may be accompanied by a needle-based infusion device with an integrated, non-replaceable container. In one example of such a system, each container holds a single dose, and the entire deliverable volume is dispensed (total discharge). In a further example, each container holds a single dose, and a portion of the deliverable volume is dispensed (partial discharge).

[0096] The following sections describe in more detail, with reference to the drawings, numerous examples of portable electronic devices that work in conjunction with medical devices, and methods for reading machine-readable identifiers of medical devices. [Brief explanation of the drawing]

[0097] [Figure 1] A schematic example of a portable electronic device is shown below. [Figure 2] This indicates a user using a portable electronic device to read a machine-readable identifier provided on or inside a medical device. [Figure 3]This shows an electronic display of a portable electronic device in a first stage in which an electronic reader is oriented or aligned relative to a machine-readable identifier. [Figure 4] Figure 3 shows the electronic display in the second stage of mutual alignment between the machine-readable identifier and the electronic reader. [Figure 5] Further steps in the alignment procedure when the electronic reader is correctly aligned with the machine-readable identifier are shown. [Figure 6] Further configuration of a portable electronic device having an electronic display in the first stage of alignment with a medical device is shown. [Figure 7] This represents a further step in the alignment between medical devices and portable electronic devices. [Figure 8] A schematic representation of the first configuration of a portable electronic device is shown below. [Figure 9] This shows another configuration of a different portable electronic device. [Figure 10] A schematic example of a label attached to or attachable to the housing of a medical device is shown. [Figure 11] Here is another example of a label for attaching to the housing of a medical device. [Figure 12] Further examples of portable electronic devices during alignment procedures are shown. [Figure 13] This is a side view of a portable electronic device and a medical device in the first stage of alignment. [Figure 14] Figure 13 shows an example of the second stage of alignment. [Figure 15] This is a block diagram of a portable electronic device. [Figure 16] This is a block diagram of the data structure of data stored in the memory of a portable electronic device. [Figure 17] This is a flowchart showing how to read machine-readable identifiers. [Figure 18] Here is another flowchart for reading machine-readable identifiers. [Modes for carrying out the invention]

[0098] Figure 1 shows an example of a portable electronic device 50. The electronic device 50 includes, for example, a housing 51, a camera 52 typically provided on the bottom or back surface, and an electronic display 56 typically provided on the opposite front surface, as shown in Figures 8 and 9.

[0099] The electronic device 50 may be implemented as a portable electronic device. The portable electronic device may be implemented as a smartphone, smartwatch, or tablet computer. In particular, as shown in Figure 2, the electronic device 50 may be implemented as a handheld mobile electronic device 50. An input section 3 may be provided on the electronic display 56, where the user can tap confirmation areas where they can enter their respective commands. Typically, the electronic display 56 is implemented as a touch-sensitive display. It may include, for example, a dedicated display section 2 or display window on which specific information about the medical device 1 can be visually displayed.

[0100] Camera 52 may be connected to an electronic display 56 via, for example, a processor 60 in a signal transfer method. The processor 60 may include an image or graphics processor such that electronic signals generated by or obtainable from camera 52 and processed by the processor 60 cause a visual camera image to be generated on the electronic display 56, for example, in a camera window 7 on the electronic display 56.

[0101] In particular, as shown in Figure 1, the electronic display 56 is operable to reproduce the image 21 of the medical device 1, i.e., when the medical device 1 is captured by the camera 52. Typically, the camera 52, processor 60, and electronic display 56 are operable to provide a live image 21 of the medical device 1 on the display 56.

[0102] Medical device 1 may include an infusion device 12. The infusion device 12 includes a housing 10 having a contour 11. The housing 10 may house, for example, a drug container 14 sealed toward the exit by a closure such as a septum, in the form of a cartridge including a tubular barrel. The drug container may be provided with a piston that is slidably received inside the tubular barrel of the drug container 14. The infusion device 12 may include a drive mechanism (not shown) that is operable to apply distally directed pressure on the piston of the drug container to dispense a clearly defined amount of drug, i.e., a dose of drug from the drug container through an infusion needle into a portion of the user's or patient's skin punctured or penetrated by the infusion needle.

[0103] The injection device 12, particularly its injection port, may be equipped with a protective cap 15 that needs to be disassembled to expose the injection needle.

[0104] At least one of the drug container 14 and the housing 10 of the infusion device 12 is provided with a machine-readable identifier 24. The machine-readable identifier 24 may include an NFC tag 26. The portable electronic device 50 may include a corresponding electronic reader 54 that is capable of reading the information stored in the machine-readable identifier 24. Thus, the electronic reader may be implemented as an NFC reader or an NFC transceiver. In order to read information from the machine-readable identifier 24, the portable electronic device 50 must be aligned to a clearly defined or predetermined position and / or orientation relative to the medical device 1.

[0105] The electronic reader 54 of the portable electronic device 50 can read the information stored in the machine-readable identifier 24 only when the electronic reader 54 is within the reading distance or reading alignment or reading orientation for the machine-readable identifier 24.

[0106] The portable electronic device 50 has or is provided with a guidance function or user assistance function, and is therefore operable to assist or guide the user in correctly aligning the portable electronic device 50 with the medical device 1 so that the electronic reader 54 is correctly aligned with the machine-readable identifier 24 and reaches an interaction, position, or orientation in which the information stored in the machine-readable identifier can be read.

[0107] The medical device 1 and the electronic device 50 belong to or constitute a system 80 that is operable to provide assisted alignment of the machine-readable identifier 24 and the corresponding electronic reader 54.

[0108] In some examples, the information stored in a machine-readable identifier includes at least one of the following: drug name, drug type, drug quantity, drug manufacturing date, drug manufacturing location, drug expiration date, drug substance, and drug management lot number.

[0109] The portable electronic device 50 may assist or direct the user when using the medical device 1 or the infusion device 12. A computer program, and therefore software or software app deployed or installed with the electronic device 50, may be capable of recording and / or monitoring the one-time or repeated use of the medical device 1 or the infusion device 12, automatically or through interaction with the user. Thus, the user may simply indicate, for example, by touching the input section 3, that they intend to infuse a dose of medication by using the infusion device 12.

[0110] By automatically reading the data stored in the machine-readable identifier 24, the portable electronic device 50 can accurately store and collect data that was being used or is currently being used by the user or patient at that time.

[0111] As is evident from the two configurations shown in Figures 8 and 9, the position of the electronic reader 54 can be distinguished from the position of the camera 52 with respect to the geometric shape of the housing 51 of the electronic device 50. As shown in Figure 8, the electronic reader 54 may be positioned at first and second transverse offsets 71, 72 from the camera 52. A two-dimensional spatial image offset 71, 72 may be provided between the position of the camera 52 and the position of the electronic reader 54 relative to the housing 51 of the electronic device 50.

[0112] The configuration of the electronic device 50' in Figure 9 may result in different positions for both the camera 52 and the electronic reader 54 compared to the configuration of the electronic device 50 in Figure 8. The electronic device 50' shown in Figure 9 may be a different electronic device from the electronic device 50 shown in Figure 8. The electronic devices 50 and 50' shown in Figures 8 and 9 may be supplied by different manufacturers or may represent different types or configurations of portable electronic devices 50.

[0113] Therefore, the electronic device 50 shown in Figure 8 may provide spatial image offset information 71 indicating the spatial distance or spatial offset between the electronic reader 54 and the camera 52 relative to each other or to the housing 51. Specifically, the camera 52 may be offset by a distance 71' from the reader along a first direction and by a distance 71'' from the reader along a second direction, where the first and second directions are perpendicular to each other.

[0114] In the electronic device 50' shown in Figure 9, the spatial image offset information 72 reflects different configurations of spatial offset or spatial arrangement between the electronic reader 54 and the camera 52, and is typically provided on or on the planar back surface of the housing 51 opposite the electronic display 56.

[0115] In order to establish or enable the reading of information from a machine-readable identifier 24 provided inside or on the housing 10 of a medical device 1 or an infusion device 12, it may be necessary to align the electronic reader 54 and the machine-readable identifier 24 with each other and / or position them in close proximity.

[0116] The position of the electronic reader 54 may not be directly visible to the user of the electronic device 50, and the position of the electronic reader 54 may vary depending on the specific model or type of the portable electronic device 50. Therefore, obtaining the correct alignment that enables or allows reading of the information stored in the machine-readable identifier 24 can be quite difficult.

[0117] The portable electronic device 50, camera 52, electronic display 56, and processor 60 can be operated in particular to provide alignment and user guidance functions, for example, by an example schematically shown in the sequence of Figures 3 to 5.

[0118] The portable electronic device 50 and the associated computer program of the software application executed by the processor 60 of the portable electronic device 50 are used with or configured to be used with a specific type of medical device 1 known to the user. In other words, the portable electronic device is set up to read data of a machine-readable identifier 24 provided on a specific default type of medical device 1 or infusion device 12. Thus, the software application executed by the processor 60 is deployed, calibrated, or adjusted for the specific type of medical device 1.

[0119] The processor 60 is connected to the camera 52 and the electronic display 56. The processor 60 is operable to visualize the captured image 21 of the medical device 1 when the medical device 1 is captured by the camera 52 of the portable electronic device 50.

[0120] Simultaneously, the processor 60 is operable to display a virtual contour of the medical device 1, and therefore a target position or target orientation, on the electronic display. The virtual contour 22 may be separately provided on the electronic display 56 to define or visualize a default target position and / or default target orientation of the captured image 21 of the medical device 1.

[0121] In the configuration shown in Figure 3, the camera 52 captures the injection device 12 or a portion of the medical device 1, but these are still not properly aligned and are therefore oriented at a specific angle with respect to the elongation direction of the virtual contour 22 of the medical device 1.

[0122] In a further diagram of Figure 4, the user rotated and / or oriented the medical device 1 to such an extent that the captured image 21' of at least a portion of the medical device 1 substantially coincided with the virtual contour 22' simultaneously provided on the electronic display 56. As is immediately apparent from Figure 4, the structure and / or geometric shape, and therefore the periphery, of the captured image 21' is still somewhat smaller compared to the virtual contour 22' of the medical device 1. This indicates that the distance between the housing 51 and the medical device 1 is still too large.

[0123] When the medical device 1 or the infusion device 12 is brought close to the housing 51 of the portable electronic device 50, each captured image 21'' on the electronic display 56 is increased until the captured image 21'' matches the virtual contour 22''. When a substantial overlap is reached between the captured image 21'' and the virtual contour 22'', the machine-readable identifier 24 is correctly aligned with the electronic reader 54. In this configuration, as shown in Figure 5, for example, the data or information stored in the machine-readable identifier 24 can be read, and the electronic reader 54 can actually read the respective information.

[0124] In some examples, the virtual contour 22 is visually displayed on the electronic display 56 simultaneously with the live image from the camera 52. In this way, the user is provided with direct and immediate feedback on how to position the medical device 1 relative to the portable electronic device 50 to obtain, for example, the substantially overlapping configuration shown in Figure 5.

[0125] In some examples, the processor 60 may be operable to recognize at least one of the position and orientation of the medical device 1 in the captured image 21. For example, as shown in Figure 4, the processor 60 may be operable to recognize a so-called recognized item 25 in the image 21', as shown on the electronic display 56 in Figure 4. The processor 60 may also be operable to evaluate whether the recognized item 25 still does not coincide with the virtual contour 22'. To that extent, the processor may be further operable not only to recognize a default item 25 in the image 21, but also to determine the degree of overlap between the recognized item 25 and the virtual contour 22.

[0126] Simultaneously with the recognition of the medical device 1 as item 25 in the captured image 21, the processor 60 may be able to operate to change the visual appearance of the virtual contour 22. For example, in the situation shown in Figure 3, if the captured image 21 is still not recognized as medical device 1 or injection device 12, the virtual contour 22 is represented by a dotted line structure. When the recognized item 25 is recognized, the virtual contour 22 may switch to virtual contour 22' as shown in Figure 4. Here, in response to the recognition of the recognized item 25, the processor 60 may be able to operate to change the visual appearance of the virtual contour 22 from a dashed-dotted line structure as shown in Figure 3 to a dashed line structure as shown in Figure 4.

[0127] Furthermore, if an effective overlapping configuration is reached, for example, as shown in Figure 5, the processor 60 may be further capable of modifying the visual appearance of the virtual contour 22' toward the virtual contour 22'' shown in Figure 5. Here, the structure of the virtual contour 22' shown in Figure 4 is transformed into the virtual contour 22'' which is reproduced as a dotted line structure.

[0128] In Figures 3 to 5, the different appearances of the virtual contours 20, 22', and 22'' can assist and guide the user in performing and achieving predetermined relative alignment of the electronic reader 54 with respect to the machine-readable identifier 24.

[0129] The different appearances of virtual contours 20, 22', and 22'' can be reflected by changes in brightness or contrast, and by different colors of the virtual contours with respect to their temporary appearance. Therefore, the different appearances of virtual contours 20, 22', and 22'' shown in Figures 3 to 5 can also be reflected by a constant or intermittent appearance or a kind of flashing of virtual contours 22, 22', and 22''.

[0130] Here, changes in the frequency of appearance and disappearance of virtual contours 22, 22', and 22'' may also indicate to the user that the degree of match and / or overlap between the recognized item 25 and the virtual contours 22 is increasing or decreasing.

[0131] For example, as shown in Figure 5, once correct or default alignment is achieved, the electronic reader 54 is operable to read data or information stored in the machine-readable identifier 24. Each piece of information, such as drug type, drug quantity, prescription information, manufacturing date, manufacturing location, lot number, and expiration date, can be visualized within the information windows 4 and 5 of the display section 2, so as to be provided on the electronic display 56. A confirmation unit 6, which can be emulated by a processor 60 on the touch-sensitive electronic display 56, may be further provided. Here, the user can simply touch the confirmation unit 6 to prompt or confirm that the data stored in the machine-readable identifier 24 has been successfully captured by the electronic device 50.

[0132] The representation of the virtual contour 22 on the electronic display 56 may depend heavily on the software or hardware configuration of the portable electronic device 50. This may depend heavily on the relative position or orientation of the electronic reader 54 and the camera 52, as shown in two examples in Figures 8 and 9. For example, the scenario shown in the sequence of Figures 3 to 5 may be captured with the portable electronic device 50 shown in Figure 8, which has a first spatial image offset 71 between the camera 52 and the machine-readable identifier 54.

[0133] In another configuration of the portable electronic device 50' shown in Figure 9, a virtual contour 22 shown in Figure 6 may be provided. Here, compared to the configurations shown in Figures 3 to 5, the desired or intended orientation and / or position of the captured image 21 is considerably different. Here, for example, the longitudinal axis of the tubular infusion device 12 or medical device 1 needs to be rotated by about 90° relative to the housing 51 of the electronic device 50' compared to the configurations shown in Figures 3 to 5. Here, the type of augmented reality provided within the display window 7 of the electronic display 56 also means that the user has little difficulty in correctly matching the captured image 21 with the virtual contour 22 provided within the camera window 7.

[0134] In the configuration shown in Figure 6, it is immediately apparent to the user that the medical device 1 needs to be rotated counterclockwise by approximately 90° to 115°, and that the distance between the housing 51 and the medical device 1 needs to be reduced. Finally, as shown in Figure 7, if substantial spatial and virtual overlap is provided between the captured image 21' and the virtual contour 22', wireless readout of each machine-readable identifier 24 can be provided.

[0135] Similarly, as already described in relation to Figure 5, the respective pieces of information 4 and 5 may be displayed within the display section 2 or information window of the electronic display 56.

[0136] Figures 10 and 11 show two examples of labels 40 that may be provided to or adhered to at least one of the drug container 14 and housing 10 of the medical device 1. The labels 40 may include a planar, flexible or pliable substrate 41, such as a bendable or pliable foil. The substrate 41 may include an adhesive foil that can be fixedly attached to the housing 10 and one of the drug containers 14 housed inside the housing 10.

[0137] Label 40 may be provided with a visual mark 30 that includes or provides a number of visual pieces of information 31, 32, 33. The information 31, 32, 33 may be provided in printed or visual form on the surface of the visual mark 30. The visual mark 30 may be a printed label that is adhered to or attached to a substrate 41.

[0138] Label 40 is further provided with a machine-readable identifier 24 which may include an NFC tag 26 or an RFID tag. Typically, a tag processor 42 and an antenna 44 electrically connected to the tag processor 42 may be provided. The machine-readable identifier 24, for example, an NFC tag 26, may be implemented as a passive transceiver, which is operable to draw electrical energy from the RF field of an electronic reader 54 of an electronic device 50, and thus power the tag processor 42, enabling it to exchange or transmit data to the electronic reader 54.

[0139] In the example of label 40 shown in Figure 10, the machine-readable identifier 24 is positioned below and / or next to the visual mark 30. A further configuration of label 40 shown in Figure 11 provides another configuration or arrangement of the visual mark 30 and the machine-readable identifier 24, where the machine-readable identifier 24 is positioned above and / or next to the visual mark 30. In effect, the positions of the visual mark 30 and the machine-readable identifier 24 in the example of Figure 10 are swapped with the respective positions of the visual mark 30 and the machine-readable identifier 24 in the example shown in Figure 11.

[0140] The portable electronic device 50 and / or computer program executed by the processor 60 may provide information of the type of label 40 expected to be provided on or inside the housing 10 of the medical device 1 or the infusion device 12. With this information, it is further conceivable that the processor 60 will not only provide a virtual outline 22 of the medical device 1 on the electronic display 56. Rather, the processor 60 may be able to operate to similarly or alternatively visualize a captured image 21 of the medical device 1 simultaneously with a transparent or semi-transparent virtual image 23 of the medical device 1 on the electronic display 56.

[0141] Visual marks 30, such as those provided on the housing 12, may also be used to correctly align and / or orient the medical device 1 to the electronic reader 54, using a transparent or semi-transparent virtual image 23 provided simultaneously with the captured image 21 of the medical device 1.

[0142] Furthermore, as shown in Figure 12, the captured image 21 of the medical device 1 shows only the visual mark 30 and / or identifier 24 on the captured image 21. The transparent or translucent virtual image 23 of the medical device 1 is not only configured to substantially overlap the captured image 21 with the virtual contour 22, but also to indicate to the user that the medical device 1 needs to be rotated by a predetermined angle with respect to its longitudinal axis (z) as its axis of rotation, so that the visual mark 30 substantially matches or overlaps with the visual mark 30 of the transparent or translucent virtual image 23 restored or provided on the electronic display 56. In this way, three-dimensional alignment between the electronic reader 54 and the machine-readable identifier 24 can be enabled and even provided.

[0143] Figures 13 and 14 show, in side views, the process of correctly aligning the portable electronic device 50 with respect to the medical device 1. In the configuration of Figure 13, there is a specific alignment mismatch, at least horizontally, between the machine-readable identifier 24 and the electronic reader 54 of the electronic device 50. The camera 52 is operable to at least visualize a visual mark 30 that may subsequently appear in the center of the electronic display 56, for example.

[0144] In the configuration shown in Figure 13, the processor 60 is operable to indicate the respective alignment mismatches on the electronic display 56. Here, the captured image 21 of the medical device 1 can be visualized with a certain offset from the virtual contour 22 of the medical device 1. This offset visualization provided by the electronic display 56 can instruct the user to move the electronic device 50 horizontally relative to the medical device 1 until a matching configuration is obtained that reflects the intended alignment of the machine-readable identifier 24 of the medical device 1 to the electronic reader 54 of the portable electronic device 50, as shown in Figure 14.

[0145] Figure 15 schematically shows, as an example, a number of hardware components of a portable electronic device 50. The portable electronic device 50 includes a housing 51 and a display 56 provided, for example, on one side of the housing 51. A camera 52 is typically provided on the opposite side of the housing, for example, on the bottom or underside of the housing 51. Optionally, an electronic reader 54 may also be provided on or near the underside. The electronic reader 54 may be implemented as an NFC transceiver 57.

[0146] Optionally, the electronic device 50 may include a short-range transceiver 55, for example, in the form of a Bluetooth or Wi-Fi transceiver, thereby enabling the electronic device 50 to set up another communication link with further communication hardware or communication infrastructure.

[0147] The electronic device 50 further includes a processor 60 and a battery 53 for supplying power to transceivers 55, 57. The processor 60 may be provided with an electronic device identifier 61. The electronic device identifier 61 is particularly operable to store and / or provide spatial image offset information 71, 72 indicating the spatial offset between the camera 52 and the electronic reader 54. Insofar as these methods are implemented in a computer program that can be installed on different types of electronic devices (e.g., different types of smartphones), the spatial image offset information 71, 72 may be selected from a database (e.g., stored on the electronic device or elsewhere) and / or embodied in a computer program that includes spatial offset information for various electronic devices. In this way, an app or computer program suitable for various different electronic devices, e.g., different smartphones, may include spatial offset information for each type of electronic device. Depending on the type of electronic device on which the app or computer program is installed or deployed, spatial offset information associated with a particular electronic device or smartphone may be selected and used to properly calibrate the electronic device.

[0148] Alternatively, the electronic device identifier 61 may be provided in the non-volatile portion of the memory 58. The memory 58 may further comprise memory blocks of either volatile or non-volatile type. The memory 58 is operable to store information or data obtained by reading at least the machine-readable identifier 24 provided by the electronic reader 54.

[0149] Figure 16 visually shows a number of data or data structures that can be stored in memory 58. Here, spatial image offset information 71 may indicate the transceiver position TA and camera position CA either relative to each other or relative to the housing 51 of the first electronic device A50.

[0150] For example, in another electronic device 50' provided by a different manufacturer or a different type of electronic device 50', the spatial image offset in formation 72 may indicate the transceiver position TB and camera position CB either relative to each other or relative to the housing 51 of a further electronic device B 50'.

[0151] In the same or similar manner, spatial device offset information 73, 74 may be provided to memory 58, the device offset information 73, 74 indicating the spatial offset between a machine-readable identifier 24 and at least one of a visual mark 30 on the medical device 1 and the contour 11 of the medical device 1. Here, the first spatial device offset information 73 may indicate the label position LA and / or identifier position IA of the first medical device A1 or the first infusion device A12.

[0152] The spatial device offset information 74 shown in Figure 16 may indicate a different label position LB and a different identifier position Ib for another drug B, such as one provided to another drug container 14 or another medical device 1' or infusion device 12'.

[0153] A further example of spatial device offset information 73 is shown in Figure 2, where a machine-readable identifier 24 is implemented as an NFC tag 26 and provided on the outer surface of the housing 10 of the injection device 12. It is positioned at a predetermined longitudinal distance 73' from the proximal end of the housing 10 and at a predetermined tangential distance 73'' from the side edge or characteristic portion of the housing 10 (e.g., a ridge-like marking or physical feature).

[0154] When initializing the portable electronic device 50 and / or using each computer program deployed for the first time by the portable electronic device 50, the computer program may be able to operate to obtain or read the electronic device identifier 61, thereby obtaining the respective spatial offset information 71, 72 indicating the spatial offset between the camera 52 and the electronic reader 54.

[0155] In this way, the portable electronic device 50 can be properly calibrated or adjusted for use with a particular type of medical device 1. In the same or similar manner, if, for example, not only the virtual contour 11 but also the visual mark 30 provided on the outside of the medical device 1 should be used for alignment between the electronic reader 54 and the machine-readable identifier 24, it is particularly beneficial to provide or select spatial device offset information 73, 74 stored or provided by a computer program for any type of available medical device 1 to be used with the portable electronic device 50.

[0156] Figure 18 shows a flowchart of a method for reading a machine-readable identifier 24 provided in or on a medical device 1 as described herein. Here, in the first step 100, the user may determine or select a particular type of medical device 1 to be used with a portable electronic device 50. In the subsequent step 102, the camera 52 is activated and the camera image is reproduced in the camera window 7 of the electronic display 56. Simultaneously, a virtual contour 22 is displayed in the camera window 7 by the processor 60.

[0157] In step 104, the captured image 21 of the medical device 1 acquired by the camera 52 is checked to see if it overlaps with or matches the virtual contour 22 and the distance between them. If the degree of overlap is insufficient, the method returns to step 102 and repeats steps 102-104 until the captured image 21 of the medical device 1 properly overlaps with the virtual contour 22 on the electronic display 56. In the subsequent step 106, user feedback may be optionally provided to indicate to the user that a sufficient degree of overlap has been achieved between the captured image 21 and the virtual contour 22, for example, by changing the appearance of the virtual contour 22. In the subsequent step 108, a machine-readable identifier 24, such as an electronic label, is read by the electronic reader 54. Simultaneously or afterward, the respective information is displayed on the electronic display 56.

[0158] A further flowchart shown in Figure 18 schematically illustrates a number of steps for reading the machine-readable identifier 24 and setting up or deploying the portable electronic device 50 to assist the user in correctly aligning the portable electronic device 50 and the medical device 1. Here, in the first step 110, the electronic device identifier 61, which indicates the hardware configuration and, in particular, the spatial offset information 71, 72 indicating the spatial offset between the camera 52 and the electronic reader 54 of each portable electronic device 50, is read by, for example, the processor 60.

[0159] Subsequently, in step 112, a type of calibration of the guidance and assistance functions is performed based on the offset information between the camera 52 and the electronic reader 54. Optionally, in step 114, a relationship is derived between the spatial offset between the machine-readable identifier 24 and at least one of the visual marks 30 and contours 11 of the medical device 1.

[0160] In accordance with the derivation of the respective spatial relationships between the camera 52, the electronic reader 54, and the visual mark 30, the machine-readable identifier 24 is aligned with the electronic reader 54 in step 116 in the manner described above in relation to steps 112 and 114. Here, the user moves the portable electronic device 50 with respect to the medical device 1 as necessary and as guided by the enhanced visualization on the electronic display 56 until the electronic reader 54 is correctly aligned with the machine-readable identifier 24 in step 118. [Explanation of symbols]

[0161] 1. Medical devices 2 Display Sections 3. Input Section 4. Information 5 Information 6. Verification Section 7 Camera window 10 cabinets 11 Outline 12 Injection devices 14. Medication container 15 caps 21 images 22 Virtual contour 23 Virtual Images 24 Identifiers 25 recognized items 26 NFC tags 30 Visual Marks 31 Information 32 Information 33 Information 40 labels 41 Base material 42 Tag Processors 44 Antennas 50 Electronic Devices 51 cabinets 52 Cameras 53 batteries 54 Electronic Readers 55 Local Range Transceiver 56 displays 57 NFC Transceivers 58 memory 60 processors 61 Electronic device identifier 80 Systems

Claims

1. A portable electronic device (50), - A camera (52) capable of capturing an image (21) of a medical device (1), wherein the medical device (1) is provided with a machine-readable identifier (24), and the camera (52) - An electronic reader (54) that is operable to read the machine-readable identifier (24) when it is aligned with the machine-readable identifier (24), - An electronic display (56) that is operable to visualize the captured image (21) of the medical device (1), - A processor (60) connected to the camera (52) and the electronic display (56), wherein the processor (60) is operable to display the virtual contour (22) on the electronic display (56) such that when the electronic reader (54) is aligned with the machine-readable identifier (24), the virtual contour (22) of the medical device (1) matches and / or overlaps with the captured image (21) on the electronic display (56). A portable electronic device (50) including the following.

2. The portable electronic device (50) according to claim 1, further comprising an electronic device identifier (61) that includes or provides spatial image offset information (71, 72) indicating a spatial offset between the camera (52) and the electronic reader (54).

3. A portable electronic device (50) according to claim 1 or 2, further comprising a memory (58) operable to store spatial device offset information (73, 74) indicating a spatial offset between the machine-readable identifier (24) and at least one of the visual marks (30) on the medical device (1) and the contour (11) of the medical device (1).

4. The portable electronic device (50) according to claim 2 or 3, wherein the processor (60) is operable to display the virtual contour (22) of the medical device (1) on the electronic display (56) with respect to at least one of the spatial image offset information (71, 72) and the spatial device offset information (73, 74).

5. The portable electronic device (50) according to any one of claims 1 to 4, wherein the processor (60) is operable to recognize at least one of at least one position and orientation of the medical device (1) and the electronic identifier (24) in the captured image (21) as a recognized item (25).

6. The portable electronic device (50) according to claim 5, wherein the processor (60) is operable to change the appearance of the virtual contour (22) on the electronic display (56) in accordance with the degree of agreement and / or overlap between the recognized item (25) and the virtual contour (22).

7. The portable electronic device (50) according to claim 6, wherein the processor (60) is operable to modify at least one of the structure, color, brightness, contrast and temporary appearance of the virtual contour (22) in response to changes in the degree of match and / or overlap between the recognized item (25) and the virtual contour (22).

8. Portable electronic device (50) according to any one of claims 1 to 7, wherein the processor (60) is further operable to display the virtual image (23) on the electronic display (56) such that the transparent or semi-transparent virtual image (23) of the medical device (1) matches and / or overlaps the captured image (21) on the electronic display (56) when the electronic reader (54) is aligned with the machine-readable identifier (24).

9. The electronic reader (54) is a portable electronic device (50) according to any one of claims 1 to 8, which includes a short-range wireless communication NFC transceiver.

10. System (80), - A medical device (1) including a housing (10) and a machine-readable identifier (24) on or inside the housing (10), - A portable electronic device (50) according to any one of claims 1 to 9, comprising an electronic reader (54) which is operable to read the machine-readable identifier (24) of the medical device (1) when aligned with the machine-readable identifier. A system including (80).

11. The system (80) according to claim 10, wherein the medical device (1) includes an injection device (12).

12. A method for reading a machine-readable identifier (24) provided in or on a medical device (1) using a portable electronic device (50), wherein the portable electronic device (50) includes a camera (52), an electronic reader (54), and an electronic display (56), and the method is - A step of capturing an image (21) of the medical device (1) with the camera (52) of the portable electronic device (50), - A step of displaying the virtual contour (22) of the medical device (1) on the electronic display (56), - A step of visualizing the captured image (21) of the medical device (1) on the electronic display, - The step of moving the medical device (1) relative to the portable electronic device (50) in order to match the captured image (21) with the virtual contour (22) of the medical device (1) and / or at least partially overlap it, thereby setting the electronic reader (54) to one of the reading distances or reading orientations for the machine-readable identifier (24). Methods that include...

13. - A step of obtaining or acquiring at least one of spatial image offset information (71, 72) and spatial device offset information (73, 74), wherein the spatial image offset information (71, 72) indicates a spatial offset between the camera (52) and the electronic reader (54), and the spatial device offset information (73, 74) indicates a spatial offset between the machine-readable identifier (24) and at least one of the visual mark (30) on the medical device (1) and the contour (11) of the medical device (1), - With respect to at least one of the spatial image offset information (71, 72) and the spatial device offset information (73, 74), the steps include displaying the virtual contour (22) of the medical device (1) on the electronic display (56) and The method according to claim 12, further comprising:

14. - Recognizing at least one of the positions and orientations of the medical device (1) and the electronic identifier (24) in the captured image (21) as a recognized item (25). The method according to claim 13, further comprising:

15. A computer program including computer executable instructions, which, when executed by the processor (60) of a portable electronic device (50) according to any one of claims 1 to 9, causes the processor to: - Capture an image (21) of the medical device (1) with the camera (52) of the portable electronic device (50), - Displaying the virtual outline (22) of the medical device (1) on the electronic display (56), - Visualizing the captured image (21) of the medical device (1) on the electronic display simultaneously with the virtual contour (21) of the medical device (1). A computer program that performs the following action.

Images