Portable electronic device and method of reading machine-readable identifier
By capturing images of medical devices with a camera on a portable electronic device and displaying virtual outlines, the problem of user alignment difficulties is solved, enabling fast and reliable identification reading.
Patent Information
- Application Number
- CN202480029996.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-05-05
- Filing Date
- 2024-05-02
- Publication Date
- 2025-11-28
AI Technical Summary
In existing technologies, it is difficult for users to correctly align portable electronic devices with the machine-readable identifiers of medical devices, resulting in difficulties in reading information.
Images of medical devices are captured by the camera of a portable electronic device and displayed as virtual outlines on a monitor to help the user align the electronic device with the medical device, enabling the electronic reader to align with the machine-readable identifier at a predefined distance and orientation.
It provides an intuitive method to help users quickly and reliably read machine-readable identifiers on medical devices, improving reading efficiency and accuracy.
Smart Images

Figure CN121039746A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to the field of medical devices and, in particular, to user assistance in using or operating a medical device, such as an injection device. In one aspect, the present disclosure relates to a portable electronic device configured to assist a user in using a medical device. In another aspect, the present disclosure relates to a system comprising a medical device and a portable electronic device. In yet other aspects, the present disclosure relates to a method of reading a machine-readable identifier provided in or on a medical device and further to a computer program for a portable electronic device. BACKGROUND
[0002] Drug delivery devices allowing multiple dosing of a liquid drug and further providing administration of such liquid drug to a patient are well known in the art. Typically, such devices have essentially the same purpose as a common syringe. Typically, the drug to be administered is provided in a cartridge having a movable piston or bung that mechanically interacts with a piston rod of a drive mechanism of the drug delivery device. By applying a pushing force to the piston, a predefined amount of the medicinal fluid is expelled from the cartridge.
[0003] In the field of home medication or self-medication, a user or patient can be provided with a medical device, such as an injection device, for example for performing an injection procedure. Such medical devices can be implemented in a purely mechanical way or in an electromechanical way. Some medical devices, such as injection pens, can be implemented in a purely mechanical way and can be manually operated by a user to inject a dose of a medicament. Some injection devices are implemented as disposable injection devices. These disposable injection devices can be equipped with a pre-filled medicament container. The medicament container can be pre-assembled inside the injection device. Such injection devices can be distributed to a patient or user in a condition or state in which the device is ready to use. Herein, the device can denote a drug-device combination and can be intended or configured to be disposed of after use.
[0004] Medical devices configured for and intended for home medication or self-medication by a user or patient can be electronically coupled with an external or portable electronic device, such as a smartphone, a tablet computer, a smartwatch or a so-called assistance or additional device configured to cooperate with the medical device or injection device. Such external devices can assist a user in administering a medicament, for example in the form of a dose injection procedure, and in monitoring the operation of the injection device and / or the medicament administration injection procedure. A portable electronic device, such as a smartphone, a tablet computer or a smartwatch, can be operated for electronically pairing with a medical device, for example with an injection device. In particular, a portable electronic device or additional device configured for detachably fastening to a medical device or injection device can provide for an automated or semi-automated recording or tracking of multiple dose administrations or dose injection procedures.
[0005] An electronic coupling between a portable electronic device and a medical device or an injection device can be beneficial for recording and / or storing single or repeated uses of the medical device or injection device.
[0006] A medical device or a medicament container, such as an injection device, can be provided with a unique identifier, for example indicating a type, amount, medicament fill batch number, production date, production location and / or best before date of a medicament located or stored in the respective medical device. Some portable electronic devices can provide for an automated or semi-automated read-out of the identifier of the medical device in order to obtain respective information about the medicament provided with or stored in the medical device or medicament container.
[0007] Capturing or obtaining information provided by an identifier of a medical device, such as an injection device, can be provided electronically. Thus, the identifier of the medical device or of a medicament container associated with the medical device can be operable or suitable for machine reading and can be read out or captured autonomously by the portable electronic device. The automated read-out or machine-based read-out of the machine-readable identifier of the medical device or medicament container can require a rather specific relative arrangement or orientation between the portable electronic device and the medical device.
[0008] Depending on the technical implementation of the machine reading, the portable electronic device can need to be held in a well-defined position, distance and / or orientation relative to the medical device in order to enable the automated or machine-based read-out of the information stored in the machine-readable identifier of the medical device.
[0009] Especially in case the machine-readable identifier is not directly apparent on the outer surface of the medical device or in case the patient or user can have difficulties to correctly orientate or position the portable electronic device relative to the medical device in order to enable the automated or machine-based read-out, it can be difficult for the user or patient to place or arrange the portable electronic device in a predefined position or orientation relative to the medical device.
[0010] It is therefore desirable to provide improvements to portable electronic devices and methods of reading machine-readable identifiers provided in or on a medical device. It would be particularly beneficial to simplify the process of correctly aligning, positioning or orientating a portable electronic device relative to a medical device in order to enable a quick, reliable and complete read-out of a machine-readable identifier provided in or on the medical device. It would be particularly beneficial to assist a user in correctly orientating or positioning a portable electronic device relative to a medical device in order to enable an automated or machine-based read-out of a machine-readable identifier. SUMMARY
[0011] In one aspect, the disclosure relates to a portable electronic device. The portable electronic device comprises a camera operable to capture an image of a medical device. The medical device is provided with a machine-readable identifier. The portable electronic device further comprises an electronic reader operable to read the machine-readable identifier when aligned with the machine-readable identifier. In the present context, the electronic reader is aligned with the machine-readable identifier when the electronic reader fulfils at least one of being at a predefined distance relative to the machine-readable identifier, being at a predefined relative orientation relative to the machine-readable identifier, and being at a predefined position relative to the machine-readable identifier. In other words, the electronic reader is operable to read the machine-readable identifier when the electronic reader is within a reading distance and oriented correctly (e.g. in a reading orientation relative to the machine-readable identifier). Otherwise, and when the electronic reader is outside the reading distance or the reading orientation, the electronic reader can not be operable to read the machine-readable identifier of the medical device.
[0012] The portable electronic device further comprises an electronic display. The electronic display is operable to visualize the captured image of the medical device. The portable electronic device also comprises a processor connected to the camera and further connected to the electronic display. The processor can be operable to process image data generated and obtained from the camera and use the image data to visualize the image captured by the camera on or in the electronic display.
[0013] The processor is further operable to display a virtual contour of the medical device on the electronic display such that the virtual contour is aligned with and / or overlaps the captured image of the medical device on the electronic display when the electronic reader is aligned with the machine-readable identifier. In other words, the processor is operable to display a virtual contour of the medical device on the electronic display such that the virtual contour is aligned with and / or overlaps the captured image on the electronic display when the electronic reader is aligned with the machine-readable identifier.
[0014] In this way, the portable electronic device is provided with an assistive function by which the camera, the processor and the electronic display of the portable electronic device are used to align the portable electronic device, i.e. at a reading distance and / or a reading orientation relative to the machine-readable identifier, such that the electronic reader of the portable electronic device is able to read or capture the machine-readable identifier as provided in or on the medical device when the portable electronic device is correctly aligned with the machine-readable identifier of the medical device.
[0015] By simultaneously showing the virtual outline of the medical device on the electronic display of the portable electronic device and the captured image of the medical device, a rather intuitive approach is provided to correctly align and / or correctly arrange the portable electronic device with respect to the medical device in order to be able to read out data from the machine-readable identifier automatically or based on a machine. Here, the captured image is captured by a camera of the portable electronic device and can represent a real-time view of the instantaneous configuration or position of the medical device.
[0016] In other words, the simultaneous visual presentation of the portable electronic device and its virtual outline of the medical device and the captured image of the medical device (instantaneously captured by the camera of the portable electronic device) provides a rather intuitive approach to assist the user to correctly align or orient the portable electronic device and the medical device with respect to each other.
[0017] In some examples, the portable electronic device provides an augmented reality to the user. The virtual outline provided on the display of the portable electronic device can represent a target position and / or a target orientation of the medical device, which ensures that the electronic reader is correctly aligned with the machine-readable identifier of the medical device when the medical device reaches the target position and / or the target orientation.
[0018] In some examples, the virtual outline displayed on the electronic display of the portable electronic device is rather static. The virtual outline can be artificially generated on the electronic display. In other examples, the virtual outline is a dynamic virtual outline, which can also be visually modified due to changes in the scene or changes in the mutual arrangement of the medical device with respect to the portable electronic device.
[0019] In some examples, the camera and the electronic reader of the portable electronic device are located at different positions of the portable electronic device. The camera and the electronic reader can be provided and arranged at a predefined spatial offset with respect to each other. In this case, arranging the camera of the portable electronic device and aligning the camera with the machine-readable identifier can not be sufficient to reach a predefined or required alignment of the electronic reader of the portable electronic device with the machine-readable identifier.
[0020] According to another example, the portable electronic device comprises an electronic device identifier, which contains or provides spatial image offset information, which is indicative of the spatial offset between the camera and the electronic reader. The electronic device identifier can be stored in a memory or storage of the portable electronic device. The electronic device identifier can be indicative of the spatial image offset information and, thus, of the spatial offset between the camera and the electronic reader of the medical device. The spatial image offset information can also be indicative of the relative position and / or the relative orientation between the camera and the electronic reader, e.g. also in relation to the outline or housing geometry of the portable electronic device.
[0021] In particular, the spatial image offset information represents a hardware-specific configuration of the portable electronic device and can differ between different portable electronic devices. Thus, for some manufacturers of portable electronic devices or for some models of portable electronic devices, the camera and the electronic reader can almost axially overlap. For other manufacturers or models of portable electronic devices, there can be a considerable spatial offset between the camera and the electronic reader of the portable electronic device. The electronic device identifier contains at least information about the manufacturer and the specific type of the portable electronic device. For each unique electronic device identifier, a corresponding spatial image offset information can be provided which is indicative of the spatial offset and / or the relative position or orientation between the camera and the electronic reader of the respective portable electronic device.
[0022] The processor of the portable electronic device can be operative to read and / or process the spatial image offset information in order to calibrate the visual guidance function provided by the processor. Thus, for a first type of portable electronic device having a first electronic device identifier, a first spatial image offset information is provided which, when processed by the processor, causes a first virtual outline of the medical device to be generated on the electronic display of the portable electronic device in a first position and / or a first orientation.
[0023] For another portable electronic device, e.g. a second portable electronic device of a different type, a second electronic device identifier can be provided which contains or represents a second spatial image offset information which is likewise processable by the processor. The corresponding second spatial image offset information can be processed by the processor of the respective portable electronic device to generate a second virtual outline of the medical device which can differ in at least one of the size, the position or the orientation on the electronic display compared to at least one of the size, the position or the orientation of the first virtual outline of the medical device.
[0024] The electronic device identifier enables the implementation of a corresponding computer program, software or software application (e.g. an app for the portable electronic device) which is operable with a wide variety of different types of portable electronic devices, e.g. with portable electronic devices which differ by their hardware configuration, in particular by the position, the orientation or the distance of the camera relative to the electronic reader. By means of the electronic device identifier, the corresponding computer program or software executed by the portable electronic device can be universally adapted to different types of portable electronic devices.
[0025] In other words, and by way of the electronic device identifier, the processor of the respective portable electronic device can be individually calibrated for the respective and rather specific hardware implementation of the portable electronic device. In this way, the augmented reality guidance functionality for assisting a user in correctly positioning or aligning the portable electronic device relative to the medical device can be deployed with a wide variety of portable electronic devices of different manufacturers or different types.
[0026] According to another example, the portable electronic device comprises a memory. The memory can be operable for or configured to store spatial device offset information indicating a spatial offset between the machine-readable identifier and at least one of a visual marker on the medical device and a contour of the medical device. In some examples, the visual marker and / or the contour of the medical device can be identified in the captured image visualized on the electronic display of the portable electronic device. With further information on the spatial offset between the machine-readable identifier and at least one of the visual marker and the contour of the medical device, the machine-readable identifier on or inside the medical device can be defined or located using the visual marker and / or the contour of the medical device. In other words, a well-defined or predefined spatial device offset information indicating a spatial offset between the machine-readable identifier and at least one of a visual marker and a contour or geometry of the medical device itself can be used to locate the machine-readable identifier based on identifying at least one of the visual marker, the contour and / or the outer geometry of the medical device in the captured image on the electronic display.
[0027] According to another example, the processor of the portable electronic device can be operable for displaying a virtual contour of the medical device on the electronic display with respect to at least one of the spatial image offset information and the spatial device offset information. Here, at least one of the spatial image offset information and the spatial device offset information characterizing the type of the portable electronic device and / or the type of the medical device, respectively, can be used to provide an accurate calibration for the spatial alignment functionality provided by the portable electronic device. In particular, and for different portable electronic devices, the respective spatial image offset information can be used to correctly display or render the virtual contour of the medical device on the electronic display such that, when aligned or overlaid with the captured image on the electronic display, the electronic reader of the respective portable electronic device is correctly aligned with the machine-readable identifier of the medical device.
[0028] In the same or a similar way, the spatial device offset information can be used to provide a correct alignment between the electronic reader and the machine-readable identifier for different types of medical devices. Here, the portable electronic device can be provided with at least general information on the spatial device offset information. The portable electronic device is intended to be used with a type or class of medical devices matching the spatial device offset information stored in the memory of the portable electronic device.
[0029] In some examples, the portable electronic device can be configured or preconfigured for use with only one or several types of medical devices, each of which is assigned the same spatial device offset information between the machine-readable identifier and at least one of a visual marker on the medical device and a profile of the medical device. In case the portable electronic device is always used with such type or class of medical devices, the spatial device offset information stored in the memory of the portable electronic device can be used in addition or instead of the spatial image offset information in order to provide or establish the correct alignment between the machine-readable identifier and the electronic reader based on the spatial overlap or alignment between the virtual profile of the medical device and the captured image.
[0030] According to another example, the processor is operable to identify at least one of a position and an orientation of at least one of the medical device and the electronic identifier in the captured image as a so-called identified item. In this case, the processor can be operable to identify at least one of the medical device (e.g. a profile or geometry of the medical device) and the electronic identifier in the captured image autonomously or automatically. By this automated or semi-automated item identification, the user can be further assisted in arranging or aligning the portable electronic device with respect to the medical device; or vice versa.
[0031] The processor and / or the user can further use the automatic and thus processor- assisted identification of at least one of the electronic identifier of the medical device and the orientation or position to facilitate the process of correctly aligning the portable electronic device with respect to the medical device.
[0032] In some examples, the processor can be further operable to identify a visual marker as provided on the medical device, which the processor and / or the user of the portable electronic device can then further use to correctly align the portable electronic device with respect to the medical device such that the electronic reader is aligned with the machine-readable identifier in a predefined manner in which the electronic reader is operable to read information from the machine-readable identifier.
[0033] According to another example, the processor is operable to modify an appearance of the virtual profile on the electronic display depending on a degree of alignment and / or overlap between the identified item and the virtual profile. In this way, the processor can provide further user assistance to facilitate the mutual alignment of the portable electronic device and the medical device by the user.
[0034] The appearance of the virtual contour can be modified in a number of different ways. The modification of the visual appearance of the virtual contour further aids in guiding or assisting the user in correctly aligning the portable electronic device with respect to the medical device. The modification provides immediate visual feedback to the user in response to movement of the medical device with respect to the electronic device caused by the user.
[0035] The modification of the appearance of the virtual contour can indicate that the distance and / or orientation mismatch between the machine-readable identifier of the medical device and the electronic reader of the portable electronic device. Changing the distance and / or changing the orientation of the machine-readable identifier with respect to the electronic reader (which changes can be detected by the processor evaluating the identified item) can cause a modification of the appearance of the virtual contour of the medical device on the electronic display. The modification of the appearance of the virtual contour can directly indicate to the user that the degree of alignment and / or degree of mutual overlap between the electronic reader and the machine-readable identifier has changed, e.g. decreased or increased.
[0036] According to another example, the processor is operable to modify at least one of the structure, color, brightness, contrast and temporal appearance of the virtual contour in response to a change in the degree of alignment and / or overlap between the identified item and the virtual contour. For example, and in the case of a relatively low degree of alignment or overlap between the identified item and the virtual contour, the virtual contour can appear on the display with a relatively high degree of brightness and / or contrast. As the degree of alignment or overlap increases, the brightness and / or contrast of the virtual contour can decrease.
[0037] In another example, the color of the virtual contour can also be modified. For example, in the case of a relatively low degree of alignment or overlap with the identified item, the virtual contour can be represented in a predefined color, e.g. red. Once the degree of alignment and / or overlap between the identified item and the virtual contour increases, its color can gradually change to yellow. In the case of a further and almost perfect or intended alignment between the identified item and the virtual contour, the color of the virtual contour can change to green, thereby intuitively indicating to the user that the predefined alignment or orientation of the machine-readable identifier with respect to the electronic reader has been achieved.
[0038] In the same way, the brightness and / or contrast and geometry of the virtual contour can also change stepwise or continuously as the degree of alignment and / or spatial overlap between the identified item in the captured image and the virtual contour provided on the electronic display changes.
[0039] According to another example, the processor of the portable electronic device can be further operative to display a transparent or translucent virtual image of the medical device on the electronic display such that the virtual image aligns with and / or overlaps the captured and reproduced image on the electronic display when the electronic reader is aligned with the machine-readable identifier.
[0040] With the transparent or translucent virtual image, the user can even be provided with a three-dimensional guidance function to arrange the portable electronic device in a well-defined and / or predefined orientation or position relative to the medical device in all three spatial dimensions.
[0041] With the transparent or translucent virtual image, it is also possible to modify the three-dimensional position or orientation of the medical device relative to the portable electronic device. For medical devices, and thus for three-dimensional objects (e.g., including pen-type injectors), the housing of the device can have an elongated tubular shape. Here, the electronic reader can be arranged at a well-defined tangential or circumferential position on the circumference of the tubular housing of the medical device. A correct reading of the machine-readable identifier can require that the medical device is in a specific orientation, and thus in a specific rotational position, relative to the portable electronic device about its longitudinal axis.
[0042] In the case of the transparent or translucent virtual image, and in the case where the portable electronic device is required to be used with a specific type or class of medical device, the transparent or translucent virtual image can thus be rendered on the electronic display, e.g., simultaneously with the visualization of the instantaneously captured image obtained by the camera of the portable electronic device, when corresponding spatial device offset information is stored in the memory of the portable electronic device.
[0043] The transparent or translucent virtual image can also include or reproduce a visual marker arranged on the outside of the medical device. Here, and e.g., based on such a visual marker, the user or patient can perform a desired rotation of the medical device relative to the portable electronic device such that not only the virtual outline of the medical device overlaps the identified item, and thus the captured image of the medical device, but also the medical device is rotated or oriented in a predefined manner such that the machine-readable identifier generally faces directly the electronic reader of the portable electronic device.
[0044] In some examples, the visual marker can be included in the transparent or translucent virtual image and can characterize at least one of the medical device and a medicament container of the medical device. With the visual marker, the medical device can be distinguished from other medical devices. In the same or similar manner, and by their visual markers, the medicament container can also be distinguished from other medicament containers. The medicament container can be visible from the outside, at least to the extent that the visual marker arranged on the medicament container is visible and thus can be captured by the camera of the portable electronic device, even when housed or located inside the housing of the medical device.
[0045] It can be provided that the visual marking outside the medical device shall be in an overlapping configuration with the respective transparent or semi-transparent virtual visual marking of the transparent or semi-transparent virtual image of the medical device.
[0046] According to another example, the electronic reader of the portable device comprises a near field communication (NFC) transceiver. The near field communication transceiver requires the medical device and its machine-readable identifier to be in a well-defined position and / or orientation relative to the electronic reader. Typically, the machine-readable identifier shall be directly facing the electronic reader; and vice versa. In some examples, the spatial distance between the electronic reader and the machine-readable identifier shall be less than 5 cm, less than 4 cm, less than 3 cm, less than 2 cm or even less than 1 cm or less than 5 mm.
[0047] Furthermore, the lateral spatial offset between the electronic reader and the machine-readable identifier shall be less than 5 cm, 4 cm, 3 cm, 2 cm or less than 1 cm.
[0048] In this way, and when the electronic reader, e.g. in the form of a NFC transceiver, is within a predefined distance or range, the electronic reader can accurately and reliably read the electronically stored information of the machine-readable identifier. In case the electronic reader comprises a NFC transceiver, the machine-readable identifier is typically implemented as a NFC tag, which is provided on or inside the housing of the medical device. It can be provided on or inside a medicament container, like a cartridge filled with a pharmaceutical active.
[0049] In another example, the electronic reader comprises an RFID reader and the machine-readable identifier comprises a respective RFID tag.
[0050] The machine-readable identifier can be implemented as a passive machine-readable electronic circuit, which does not have its own power supply.
[0051] In another example, the machine-readable identifier can comprise an optical code or an optically readable identifier. Here, the machine-readable identifier can comprise a two-dimensional visual code, e.g. located on an outer surface of the housing of the medical device.
[0052] In another aspect, the disclosure relates to a system comprising a medical device as described above and a portable electronic device. The medical device comprises a housing and a machine-readable identifier located on or inside the housing. The machine-readable identifier can be provided on an outer surface of the housing. In some examples, the machine-readable identifier can be located inside the housing and can be shielded by the housing. It can not be visible from outside the housing. The portable electronic device comprises an electronic reader as described above, which is operable to read the machine-readable identifier when aligned with the machine-readable identifier of the medical device.
[0053] Alignment with the machine-readable identifier means that the distance between the machine-readable identifier and the electronic reader is less than or equal to the predefined transmission range of the electronic reader. In some examples, a predefined orientation of the electronic reader with the machine-readable identifier can also be required for alignment. In case the electronic reader is implemented as an NFC transceiver, the alignment mismatch between the machine-readable identifier and the electronic reader can be less than 5 cm, less than 4 cm, less than 3 cm, less than 2 cm, less than 1 cm or even less than 5 mm.
[0054] The system comprises a portable electronic device as described above. In this case, all features, effects and benefits as described above with respect to the portable electronic device equally apply to the system comprising the medical device and the portable electronic device.
[0055] In another example of the system, the medical device comprises an injection device. The injection device can be implemented as a handheld injection device. It can comprise a medicament container filled with a liquid medicament and can further comprise an injection needle in fluid connection with the interior of the medicament container. In some examples, the injection device comprises at least one of a plunger and a piston slidably arranged inside the medicament container. The medicament container can be implemented as a cartridge filled with a liquid medicament and comprising a tubular barrel within which the plunger or the piston is longitudinally movable. By displacing the plunger or the piston relative to the barrel, a defined amount of medicament, e.g. a dose of medicament, can be expelled through an outlet of the medicament container, which is usually located at or near the distal end of the medicament container.
[0056] In some examples, the injection device comprises an injection pen. The injection pen can be implemented as a fully mechanically operated device, wherein a user has to exert a sufficient dispensing force to drive or push the plunger or the piston in a distal direction in order to expel a dose of medicament from the medicament container.
[0057] In some examples, the medical device or injection device is embodied as a so-called auto-injector. Here, the user can only have to bring the housing of the injection device into mechanical contact with the skin and initiate the dispensing procedure, for example by activating a trigger and / or by moving the housing of the injection device against or towards the injection site on the patient's skin. In the case of an auto-injector, a needle configured to puncture or pierce the patient's tissue can be automatically advanced and can enter the patient's skin. With an auto-injector and after the patient's skin has been pierced, an automatic injection procedure can be started or continued by which a well-defined amount of medicament, i.e. a dose, is injected into the biological tissue, for example into the patient's tissue, through the injection needle.
[0058] In some examples, the injection device comprises an injection pen which allows or provides for variable size dose setting and dispensing. In some examples, the injection device is configured for setting and injecting a plurality of doses of equal or different size, wherein the size of the dose to be injected can be adjusted by the user himself. In other examples, the injection device is a fixed dose device. The fixed dose device can be embodied as a disposable device, wherein the medicament and / or the medicament container is easily stored and / or assembled inside the housing of the injection device.
[0059] In further examples, the injection device is a reusable injection device which provides for allowing replacing an empty product cartridge by a cartridge or medicament container filled with a medicament.
[0060] In some examples, the medical device itself, for example the housing of the medical device configured to receive or accommodate the medicament container or cartridge, is provided with a machine readable identifier. In other examples, the medicament container is arranged inside the medical device which is provided with a machine readable identifier. In this way, the information stored or provided by the machine readable identifier is indicative of the properties of the medicament stored therein.
[0061] According to another example, the medical device comprises a medicament container filled with a medicament. The injection device or the medical device can be embodied as a disposable medical device which is intended for single or multiple use and which is intended to be disposed of as a whole after the medicament originally stored therein has been consumed or used.
[0062] According to another aspect, the disclosure relates to a method of reading a machine-readable identifier arranged in or on a medical device with a portable electronic device. Thus, the portable electronic device is used for reading a machine-readable identifier as arranged in or on a medical device, wherein the medical device is typically embodied as an injection device. The portable electronic device comprises a camera, an electronic reader and an electronic display. The method further comprises the steps of capturing an image of the medical device with the camera of the portable electronic device, displaying a virtual outline of the medical device on the electronic display, visualizing the captured image of the medical device on the electronic display, and moving the medical device relative to the portable electronic device to align and / or at least partially overlap the captured image with the virtual outline of the medical device on the electronic display, thereby bringing the electronic reader into one of a reading distance or a reading orientation relative to the machine-readable identifier.
[0063] In other words, the virtual outline of the medical device is aligned and / or partially overlaid with the captured image to bring the electronic reader into one of a reading distance or a reading orientation relative to the machine-readable identifier. Typically, the movement, orientation or alignment of the portable electronic device relative to the medical device is assisted or guided by simultaneously displaying the virtual outline of the medical device with the instantaneously captured image of the medical device on the electronic display. In this case, the virtual outline displayed on the electronic display provides an augmented reality for bringing the electronic reader of the portable electronic device into a reading distance or a reading orientation relative to the machine-readable identifier as arranged in or on the medical device.
[0064] The method of reading a machine-readable identifier is typically performed with the portable electronic device after or in conjunction with the system as described above. In this case, all features, effects and benefits as described above in connection with the portable electronic device and the system apply equally to the method of reading a machine-readable identifier; and vice versa.
[0065] According to another example, the method further comprises the step of obtaining or acquiring at least one of spatial image offset information and spatial device offset information. Here, the spatial image offset information is indicative of a spatial offset between the camera of the electronic device and the electronic reader. The spatial device offset information in turn is indicative of a spatial offset between the machine-readable identifier and at least one of a visual marker on the medical device and an outline of the medical device.
[0066] The method further comprises the step of displaying the virtual outline of the medical device on the electronic display in relation to at least one of the spatial image offset information and the spatial device offset information. The spatial image offset information is typically a characteristic of the specific type or hardware configuration of the portable electronic device actually used with the method of reading a machine-readable identifier.
[0067] Generally, the machine-readable identifier, as provided in or on the medical device, can be read using a variety of portable electronic devices configured in different ways. With spatial image offset information, which can be a characteristic of each available portable electronic device, the position and / or orientation of the machine-readable identifier on the electronic display can be adapted and modified according to the device-specific configuration of the portable electronic device. In this way, the method can be universally used with a variety of different portable electronic devices, which are distinguished by their hardware configuration and, in particular, by the geometric or spatial offset between the camera and the electronic reader.
[0068] In the same way or simultaneously, the method of reading the machine-readable identifier can also use spatial device offset information of the specific medical device. There, the spatial device offset information can indicate a spatial offset between the machine-readable identifier and at least one of a visual marker on the medical device and a contour of the medical device.
[0069] The spatial device offset information and thus the spatial offset between the machine-readable identifier and one of a visual marker of the medical device and a contour of the medical device can in particular be used to provide a correct alignment between the electronic reader and the machine-readable identifier. The spatial device offset information can indicate that the machine-readable identifier is provided in a specific position relative to or in relation to the contour of the medical device and the visual marker on the medical device.
[0070] For a given type or category of medical device, the spatial device offset information can always be the same and the portable electronic device can in particular be configured to communicate with or read out the machine-readable identifier of such a specific type or category of medical device. In case the spatial device offset information is available to the portable electronic device, e.g. provided by default or stored in a memory of the portable electronic device, an exact alignment of the machine-readable identifier relative to the electronic reader can be provided based on the spatial device offset information.
[0071] In another example, the method further comprises the step of identifying at least one of a position and an orientation of at least one of the medical device and the electronic identifier in the captured image as an identified item. Here, the processor can be provided with image processing capabilities and can automatically identify or track at least one of a predefined spatial pattern of the electronic identifier and / or a contour of the medical device and can assign the identification of the electronic identifier and / or the identification of the position or orientation of the medical device in the captured image as the identified item. In this way, the processor can be operative to identify or recognize the machine-readable identifier and thus the class or type of the medical device in the captured image and can thus provide an enhanced functionality to achieve a suitable overlap or alignment of the captured image of the medical device with the virtual contour provided on the electronic display simultaneously.
[0072] According to another example, the method further comprises the step of modifying the appearance of the virtual outline of the electronic display depending on the degree of alignment and / or the degree of overlap between the recognized item and the virtual outline. The modification of the appearance of the virtual outline can be controlled by the degree of alignment and / or the degree of overlap between the recognized item and the virtual outline.
[0073] According to another aspect, the disclosure relates to a computer program comprising computer executable instructions which, when executed by a processor of a portable electronic device, cause the processor to capture an image of a medical device with a camera of the portable electronic device. The computer executable instructions further cause the processor to display a virtual outline of the medical device on the electronic display and to visualize the captured image of the medical device and the virtual outline of the medical device on the electronic display simultaneously.
[0074] In some examples, the computer program is executable by a processor of an electronic device as described above and is configured to perform or conduct the individual steps of the method of reading a machine-readable identifier of a medical device as described above. In this case, all features, effects and advantages as described above in connection with the portable electronic device, the system comprising the medical device and the portable electronic device, and the method of reading a machine-readable identifier as provided in or on a medical device as described above apply equally to the computer program and its computer executable instructions; and vice versa.
[0075] The computer program can be deployed or installed on a portable electronic device, such as a smartphone, a tablet computer or a smartwatch, as an app. The computer program can be universally usable with a wide variety of portable electronic devices, for example provided by a wide variety of manufacturers and / or comprising a wide variety of different or differently configured portable electronic devices. The computer program can be universally usable or executable by a wide variety of portable electronic devices, which are distinguished by their hardware and / or software configuration. Thus, the computer program can be executable by a first type or class of portable electronic devices, which comprises a camera and an electronic reader arranged with a first spatial offset relative to each other. Here, the respective spatial image offset information can be provided by the computer program, for example based on a hardware identification of the portable electronic device.
[0076] Likewise, the computer program can also be executed by a second type or class of portable electronic device, wherein the electronic reader and the camera are arranged with a second spatial offset relative to each other, which is different from the first spatial offset. Also here, and by obtaining the spatial image offset information indicative of the particular hardware implementation of the portable electronic device, the computer program can be adapted accordingly in order to correctly display the virtual outline of the medical device on the electronic display of the portable electronic device.
[0077] Generally, the scope of the disclosure is to be defined by the contents of the claims. The portable electronic device, system, method and computer program as described herein are in no way limited to the particular embodiments or examples but comprise any combination of elements of different embodiments or examples. To some extent, the disclosure also encompasses any possible combination of claims and features disclosed herein in any technical combination.
[0078] In the present context, the term 'distal' or 'distally' relates to the end of the injection device facing the injection site of a human or animal. The term 'proximal' or 'proximally' relates to the opposite end of the injection device, which is furthest away from the injection site of a human or animal.
[0079] The terms 'drug' or'medicament' are used synonymously herein and describe a pharmaceutical formulation containing one or more active pharmaceutical ingredients or pharmaceutically acceptable salts or solvates thereof, and optionally a pharmaceutically acceptable carrier. In the broadest sense, an active pharmaceutical ingredient ("API") is a chemical structure that has a biological effect on humans or animals. In pharmacology, a drug or medicament is used in the treatment, cure, prevention, or diagnosis of disease or used to otherwise enhance physical or mental well-being. The drug or medicament can be used for a limited duration, or on a regular basis for chronic disorders.
[0080] As described below, the drug or medicament can include at least one API or combinations thereof, in different types of formulations, for the treatment of one or more diseases. Examples of APIs can include small molecules having a molecular weight of 500 Da or less; polypeptides, peptides and proteins (e.g. hormones, growth factors, antibodies, antibody fragments, and enzymes); carbohydrates and polysaccharides; and nucleic acids, double or single stranded DNA (including naked and cDNA), RNA, antisense nucleic acids such as antisense DNA and RNA, small interfering RNA (siRNA), ribozymes, genes, and oligonucleotides. Nucleic acids can be incorporated into molecular delivery systems such as vectors, plasmids, or liposomes. Mixtures of one or more drugs are also contemplated.
[0081] A drug or medicament can be contained within a primary package or "drug container" suitable for use with a drug delivery device. The drug container can be, for example, a cartridge, a syringe, a reservoir, or other rigid or flexible vessel configured to provide a suitable chamber for storage (e.g., short- or long-term storage) of one or more drugs. For example, in some cases, the chamber can be designed to store a drug for at least one day (e.g., 1 day to at least 30 days). In some cases, the chamber can be designed to store a drug for about 1 month to about 2 years. Storage can occur at room temperature (e.g., about 20°C) or refrigerated temperatures (e.g., about -4°C to about 4°C). In some cases, the drug container can be or can include a dual-chamber cartridge configured to separately store two or more components of a pharmaceutical preparation to be administered (e.g., an API and a diluent, or two different drugs), one in each chamber. In such cases, the two chambers of the dual-chamber cartridge can be configured to allow mixing between the two or more components prior to and / or during dispensing into the human or animal body. For example, the two chambers can be configured such that they are in fluid communication with each other (e.g., by a conduit between the two chambers), and allow the user to mix the two components when desired prior to dispensing. Alternatively, or additionally, the two chambers can be configured to allow mixing upon dispensing of the components into the human or animal body.
[0082] The drugs or medicaments contained within the drug delivery devices as described herein can be used for the treatment and / or prophylaxis of many different types of medical disorders. Examples of disorders include, for example, diabetes mellitus or complications associated with diabetes mellitus (such as diabetic retinopathy), thromboembolic disorders (such as deep vein or pulmonary thromboembolism). Further examples of disorders are acute coronary syndrome (ACS), angina, myocardial infarction, tumors, macular degeneration, inflammation, hay fever, atherosclerosis, and / or rheumatoid arthritis. Examples of APIs and drugs are examples as described in the following handbooks: such as the Rote Liste 2014 (for example, but not limited to, section 12 (Antidiabetika) or 86 (Oncologische
[0083] Examples of APIs used in the treatment and / or prophylaxis of diabetes mellitus type 1 or type 2 or complications associated with diabetes mellitus type 1 or type 2 include an insulin, e.g., human insulin, or a human insulin analogue or derivative, a glucagon-like peptide 1 (GLP-1), GLP-1 analogues or GLP-1 receptor agonists such as Liraglutide, Exenatide and Lixisenatide, or a pharmaceutically acceptable salt or solvate thereof, or any mixture thereof. As used herein, the terms “analogue” and “derivative” refer to a polypeptide which has a molecular structure which can formally be derived from the structure of a naturally occurring peptide, e.g., the structure of human insulin, by deleting and / or exchanging at least one amino acid residue occurring in the naturally occurring peptide and / or by adding at least one amino acid residue. The added and / or exchanged amino acid residue can be a codable amino acid residue or other naturally occurring residue or a purely synthetic amino acid residue. Insulin analogues are also referred to as “insulin receptor ligands”. In particular, the term “derivative” refers to a polypeptide which has a molecular structure which can formally be derived from the structure of a naturally occurring peptide, e.g., the structure of human insulin, in which one or more organic substituent, e.g., a fatty acid, is bound to one or more amino acids. Alternatively, one or more amino acids occurring in the naturally occurring peptide can have been deleted and / or replaced by other amino acids, including non-codable amino acids, or amino acids, including non-codable amino acids, have been added to the naturally occurring peptide.
[0084] Examples of insulin analogues are Gly(A21 ), Arg(B31 ), Arg(B32) human insulin (insulin glargine); Lys(B3), Glu(B29) human insulin (insulin glulisine); Lys(B28), Pro(B29) human insulin (insulin lispro); Asp(B28) human insulin (insulin aspart); human insulin, wherein proline in position B28 is replaced by Asp, Lys, Leu, Val or Ala and wherein in position B29 Lys can be replaced by Pro; Ala(B26) human insulin; Des(B28-B30) human insulin; Des(B27) human insulin and Des(B30) human insulin.
[0085] Examples of insulin derivatives are, for example, B29-N-myristoyl-des(B30) human insulin, Lys(B29) (N- tetradecanoyl)-des(B30) human insulin (insulin detemir, Levemir®); B29-N-palmitoyl-des(B30) human insulin; B29-N-myristoyl human insulin; B29-N-palmitoyl human insulin; B28-N-myristoyl Lys B28Pro B29 human insulin; B28-N-palmitoyl-Lys B28Pro B29 human insulin; B30-N-myristoyl-Thr B29Lys B30 insulin; B30-N-palmitoyl-Thr B29Lys B30 insulin; B29-N-(N-palmitoyl-Y-glutamyl)-des(B30) human insulin, B29-N-ooxocarboxypentadecanoyl-Y-glutamyl-des(B30) human insulin (insulin degludec, Tresiba®); B29-N- (N-lithocholyl-Y-glutamyl)-des(B30) human insulin; B29-N-(ooxocarboxyheptadecanoyl)-des(B30) and B29-N- (ooxocarboxyheptadecanoyl) human insulin.
[0086] Examples of GLP-1, GLP-1 analogues and GLP-1 receptor agonists are, for example, Lyxumia®, Exendin-4, Byetta®, Bydureon®, a 39 amino acid peptide produced in the salivary gland of the Gila monster, Liraglutide (Victoza®), Semaglutide, Taspoglutide, Albiglutide (Syncria®), Dulaglutide (Trulicity®), rExendin-4, CJC-1134-PC, PB-1023, TTP-054, Langlenatide / HM-11260C (Efpeglenatide), HM-15211, CM-3, GLP-1 Eligen, ORMD-0901, NN-9423, NN-9709, NN-9924, NN-9926, NN-9927, Nodexen, Viador-GLP-1, CVX-096, ZYOG-1, ZYD-1, GSK-2374697, DA-3091, MAR-701, MAR 709, ZP-2929, ZP-3022, ZP-DI-70, TT-401 (Pegapamodtide), BHM-034. MOD-6030, CAM-2036, DA-15864, ARI-2651, ARI-2255, Tidelpar (LY3298176), Bamadutide (SAR425899), Exenatide-XTEN and Glucagon-Xten.
[0087] Examples of oligonucleotides are, for example: Kynamro®, a cholesteryl-reducing antisense therapeutic for the treatment of familial hypercholesterolemia or RG012 for the treatment of Alport syndrome. Examples of DPP4 inhibitors are Linagliptin, Vildagliptin, Sitagliptin, Dapagliptin, Saxagliptin, Berberine.
[0088] Examples of hormones include pituitary or hypothalamic hormones or regulatory active peptides and antagonists thereof, such as gonadotropins (follicle-stimulating hormone, luteinizing hormone, chorionic gonadotropin, menotropin), somatotropin (growth hormone), desmopressin, tesidolum, goserelin, triptorelin, leuprolide, buserelin, nafarelin and goserelin.
[0089] Examples of polysaccharides include glucosaminoglycans, hyaluronic acid, heparin, low molecular weight heparin or ultra-low molecular weight heparin or derivatives thereof, or sulfated polysaccharides (e.g. polysulfated forms of the above polysaccharides), and / or pharmaceutically acceptable salts thereof. An example of a pharmaceutically acceptable salt of polysulfated low molecular weight heparin is enoxaparin sodium. An example of a hyaluronic acid derivative is Hylan G-F 20 (Synvisc®), a sodium hyaluronate.
[0090] The term "antibody", as used herein, refers to an immunoglobulin molecule or an antigen binding portion thereof. Examples of antigen binding portions of immunoglobulin molecules include F(ab) and F(ab')2 fragments, which retain the ability to bind antigen. The antibody can be a polyclonal antibody, a monoclonal antibody, a recombinant antibody, a chimeric antibody, a de-immunized antibody or a humanized antibody, a fully human antibody, a non-human, e.g., murine, antibody, or a single chain antibody. In some embodiments, the antibody has effector function and can fix complement. In some embodiments, the antibody has reduced or no ability to bind the Fc receptor. For example, the antibody can be of an isotype or a subtype, an antibody fragment or mutant, which does not support binding to an Fc receptor, e.g., which has a Fc receptor binding region mutagenized or deleted. The term "antibody" also includes antigen binding molecules based on tetravalent bispecific tandem immunoglobulins (TBTI) and / or dual variable region antibody-like binding proteins with cross-over binding region orientation (CODV).
[0091] The term "fragment" or "antibody fragment" refers to polypeptides derived from an antibody polypeptide molecule (e.g., an antibody heavy and / or light chain polypeptide) that do not comprise a full-length antibody polypeptide, but that still comprise at least a portion of a full- length antibody polypeptide that is capable of binding to an antigen. Antibody fragments can comprise a cleaved portion of a full-length antibody polypeptide, although the term is not limited to such cleaved fragments. Antibody fragments useful in the present application include, for example, Fab fragments, F(ab')2 fragments, scFv (single-chain Fv) fragments, linear antibodies, monospecific or multispecific antibody fragments (such as bispecific, trispecific, tetraspecific and multispecific antibodies (e.g., diabodies, triabodies, tetrabodies), monovalent or multivalent antibody fragments (such as bivalent, trivalent, tetravalent and multivalent antibodies), minibodies, chelating recombinant antibodies, tribodies or bibodies, intrabodies, nanobodies, small modular immunopharmaceuticals (SMIP), binding-domain immunoglobulin fusion proteins, camelized antibodies, and VHH containing antibodies. Additional examples of antigen-binding antibody fragments are known in the art.
[0092] The term "complementarity determining region" or "CDR" refers to short polypeptide sequences within the variable region of both heavy and light chain polypeptides that are primarily responsible for mediating specific antigen recognition. The term "framework region" refers to amino acid sequences within the variable region of both heavy and light chain polypeptides that are not CDR sequences, and are primarily responsible for maintaining correct positioning of the CDR sequences to permit antigen binding. Although framework regions themselves typically do not directly participate in antigen binding, as is known in the art, certain residues within the framework regions of certain antibodies can directly participate in antigen binding or can affect the ability of one or more amino acids in CDRs to interact with an antigen.
[0093] Examples of antibodies are anti-PCSK-9 mAbs (e.g., Alirocumab), anti-IL-6 mAbs (e.g., Sarilumab), and anti-IL-4 mAbs (e.g., Dupilumab).
[0094] Pharmaceutically acceptable salts of any of the APIs described herein are also contemplated for use in a drug or medicament in a drug delivery device. Pharmaceutically acceptable salts are, for example, acid addition salts and basic salts.
[0095] Those skilled in the art will appreciate that modifications (additions and / or removals) can be made to the different components of the APIs, formulations, devices, methods, systems, and embodiments described herein (without departing from the scope and spirit of the disclosure) and such modifications (and any and all equivalents) are intended to be within the scope of the disclosure.
[0096] Example drug delivery devices can involve needle-based injection systems as described in Table 1 of Section 5.2 of ISO 11608-1 :2014(E). As described in ISO 11608-1 :2014(E), needle-based injection systems can be broadly classified into multi-dose container systems and single-dose (partially or completely emptying) container systems. The container can be a replaceable container or an integrated non-replaceable container.
[0097] As further described in ISO 11608-1 :2014(E), multi-dose container systems can involve needle-based injection devices with replaceable containers. In such systems, each container holds multiple doses, which can be of fixed or variable (pre-set by the user) size. Another multi-dose container system can involve needle-based injection devices with integrated non-replaceable containers. In such systems, each container holds multiple doses, which can be of fixed or variable (pre-set by the user) size.
[0098] As further described in ISO 11608-1 :2014(E), a single-dose container system can involve a needle-based injection device with replaceable containers. In one example of such a system, each container contains a single dose, whereby the entire deliverable volume is expelled (full emptying). In a further example, each container contains a single dose, whereby a portion of the deliverable volume is expelled (partial emptying). As also described in ISO 11608-1 :2014(E), a single-dose container system can involve a needle-based injection device with integrated non-replaceable containers. In one example of such a system, each container contains a single dose, whereby the entire deliverable volume is expelled (full emptying). In a further example, each container contains a single dose, whereby a portion of the deliverable volume is expelled (partial emptying). BRIEF DESCRIPTION OF DRAWINGS
[0099] In the following, a number of examples of a portable electronic device for cooperating with a medical device and a method of reading a machine-readable identifier of a medical device will be described in more detail by reference to the accompanying drawings, in which:
[0100] Figure 1 An example of a portable electronic device is schematically illustrated,
[0101] Figure 2 A user is shown using the portable electronic device to read a machine-readable identifier as provided on or in a medical device,
[0102] Figure 3 An electronic display of the portable electronic device is shown at a first stage of mutual orientation or alignment of the electronic reader relative to the machine-readable identifier,
[0103] Figure 4 An electronic display of the portable electronic device is shown at a second stage of mutual alignment between the machine-readable identifier and the electronic reader, Figure 3 and
[0104] Figure 5 A further stage of the alignment procedure is shown, at which the electronic reader is in correct alignment with the machine-readable identifier,
[0105] Figure 6 A further configuration of the portable electronic device is shown, in which the electronic display is in a first stage of alignment relative to the medical device,
[0106] Figure 7 A further stage of alignment between the medical device and the portable electronic device is shown,
[0107] Figure 8 A first configuration of the portable electronic device is schematically illustrated,
[0108] Figure 9 Another configuration of another portable electronic device is shown,
[0109] Figure 10 An example of a sticker attached or attachable to a housing of a medical device is schematically illustrated,
[0110] Figure 11 Another example of a sticker for attachment to a housing of a medical device is shown,
[0111] Figure 12 Another example of a portable electronic device during an alignment procedure is shown,
[0112] Figure 13 A side view of a portable electronic device and a medical device in a first alignment stage is shown,
[0113] Figure 14 An example of a portable electronic device in a second alignment stage is shown, Figure 13
[0114] Figure 15 is a block diagram of a portable electronic device,
[0115] Figure 16 is a block diagram of a data structure of data to be stored in a memory of a portable electronic device,
[0116] Figure 17 A flowchart of a method of reading a machine-readable identifier is shown, and
[0117] Figure 18 Another flowchart of a method of reading a machine-readable identifier is shown. DETAILED DESCRIPTION
[0118] In Figure 1 , an example of a portable electronic device 50 is shown. The electronic device 50 comprises a housing 51, a camera 52, typically arranged on the lower or back side (e.g. as shown in Figure 8 Figure 9 and an electronic display 56, typically arranged on the opposite front side.
[0119] The electronic device 50 can be implemented as a portable electronic device. It can be implemented as a smartphone, a smartwatch or a tablet computer. As Figure 2 Specifically shown, the electronic device 50 can be implemented as a handheld mobile electronic device 50. An input section 3 can be provided on the electronic display 56, in which the user can tap to confirm the location where the user can input a corresponding command. Typically, the electronic display 56 is implemented as a touch-sensitive display. It may include a dedicated display section 2 or display window, in which specific information, such as information about the medical device 1, can be displayed visually.
[0120] Camera 52 may be connected to electronic display 56, for example, via processor 60 in a signal transmission manner. Processor 60 may include an image processor or a graphics processor, such that electronic signals generated by or available from camera 52 and processed by processor 60 cause a visual camera image to be generated on electronic display 56 (e.g., in camera window 7 on electronic display 56).
[0121] like Figure 1 As specifically shown, the electronic display 56 is operable to reproduce the image 21 of the medical device 1, i.e., when the medical device 1 is captured by the camera 52. Typically, the camera 52, the processor 60, and the electronic display 56 are operable to provide the live image 21 of the medical device 1 on the display 56.
[0122] Medical device 1 may include an injection device 12. The injection device 12 includes a housing 10 having a profile 11. The housing 10 may house a medication container 14, which is, for example, in the form of a cartridge comprising a tubular tube and sealed toward an outlet by a closure (such as a diaphragm). The medication container may be provided with a piston slidably received within the tubular tube of the medication container 14. The injection device 12 may include an actuation mechanism operable to apply distal pressure to the piston of the medication container to expel a defined amount of medication (i.e., a dose of medication) from the medication container through an injection needle into a portion of the user's or patient's skin punctured or penetrated by the injection needle (not shown).
[0123] The injection device 12, in particular its injection outlet, may be equipped with a protective cap 15, which needs to be removed to expose the injection needle.
[0124] At least one of the medicament container 14 of the injection device 12 and the housing 10 is provided with a machine-readable identifier 24. The machine-readable identifier 24 can comprise an NFC tag 26. The portable electronic device 50 can be equipped with a corresponding electronic reader 54 which is operable for reading information stored in the machine-readable identifier 24. Thus, the electronic reader can be implemented as an NFC reader or an NFC transceiver. In order to read information from the machine-readable identifier 24, it is necessary to align the portable electronic device 50 to a well-defined or predefined position and / or orientation with respect to the medical device 1.
[0125] Only when the electronic reader 54 of the portable electronic device 50 is in a reading distance or a reading alignment or a reading orientation with respect to the machine-readable identifier 24, it is possible for the electronic reader 54 to read information stored in the machine-readable identifier 24.
[0126] The portable electronic device 50 is equipped or provided with a guidance function or a user assistance function and is thus operable for assisting or guiding a user in correctly aligning the portable electronic device 50 with respect to the medical device 1 to a mutual configuration, position or orientation in which the electronic reader 54 is correctly aligned with the machine-readable identifier 24 and in which configuration information stored in the machine-readable identifier can be read out.
[0127] The medical device 1 and the electronic device 50 belong to or constitute a system 80 which is operable for providing an assisted alignment of the machine-readable identifier 24 and the corresponding electronic reader 54.
[0128] In some examples, the information stored in the machine-readable identifier comprises at least one of the following: medicament name, medicament type, medicament amount, production date of the medicament, production location of the medicament, best before date of the medicament, drug substance of the medicament, medicament production fill batch number.
[0129] The portable electronic device 50 can assist or guide a user in using the medical device 1 or the injection device 12. The computer program and thus the software or software app deployed or installed with the electronic device 50 can be operable for recording and / or monitoring a single or repeated use of the medical device 1 or the injection device 12, either automatically or by interaction with the user. Thus, the user can simply indicate, e.g. via the touch input section 3, that he is about to inject a dose of medicament by using the injection device 12.
[0130] By automatically reading out the data stored in the machine-readable identifier 24, the portable electronic device 50 can precisely gather and collect data on which medicament a user or patient has used or is currently using when and how.
[0131] As from the above, it is clear that the present application provides a medical device 1 and a portable electronic device 50 which are operable for providing an assisted alignment of a machine-readable identifier 24 and a corresponding electronic reader 54.Figure 8 and Figure 9 As becomes apparent in the two configurations shown, the position of the electronic reader 54 can be distinguished from the position of the camera 52 relative to the geometry of the housing 51 of the electronic device 50. For example... Figure 8 As shown, the electronic reader 54 can be located at a first lateral offset 71 and a second lateral offset 72 from the camera 52. The two-dimensional spatial imaging offsets 71 and 72 can be set relative to the housing 51 of the electronic device 50 between the position of the camera 52 and the position of the electronic reader 54.
[0132] use Figure 9 The configuration of the electronic device 50', and according to Figure 8 Compared to the configuration of electronic device 50, the positions of camera 52 and electronic reader 54 can be different. Figure 8 Compared to the electronic device 50 shown, such as Figure 9 The electronic device 50' shown can be different electronic devices. For example... Figure 8 and Figure 9 The electronic devices 50, 50' shown may be supplied by different manufacturers, or may represent different types or configurations of portable electronic devices 50.
[0133] Therefore, as Figure 8 The illustrated electronic device 50 may be provided with spatial image offset information 71, which indicates the spatial distance or spatial offset between the electronic reader 54 and the camera 52 relative to each other or relative to the housing 51. Specifically, the camera 52 may be offset from the reader by a distance 71' along a first direction and may be offset from the reader by a distance 71'' along a second direction, wherein the first direction and the second direction are perpendicular to each other.
[0134] For example Figure 9 The electronic device 50' shown has spatial image offset information 72 that reflects different configurations of spatial offset or spatial arrangement between the electronic reader 54 and the camera 52, which are typically located on or on the planar back side of the housing 51 opposite to the electronic display 56.
[0135] In order to establish or enable reading information from a machine-readable identifier 24 disposed in or on the housing 10 of a medical device 1 or an injection device 12, it may be necessary to align the electronic reader 54 and the machine-readable identifier 24 with each other and / or bring them close together.
[0136] As the position of the electronic reader 54 can not be directly visible for the user of the electronic device 50 and as the position of the electronic reader 54 can vary depending on the specific model or type of the portable electronic device 50, it can be rather difficult to obtain a correct alignment to enable or allow reading the information stored in the machine-readable identifier 24.
[0137] The portable electronic device 50, the camera 52, the electronic display 56 and the processor 60 are in particular operable to provide an alignment and user guidance function, for example, in a sequence of Figures 3 to 5 is schematically illustrated.
[0138] The portable electronic device 50 and the associated computer program of the software application executed by the processor 60 of the portable electronic device 50 are configured to be used with a specific type of medical device 1 known to the user. In other words, the portable electronic device is set up for data read-out of a machine-readable identifier 24 provided on a specific and predefined type of medical device 1 or injection device 12. Accordingly, the software application executed by the processor 60 needs to be deployed, calibrated or tuned for the specific type of medical device 1.
[0139] The processor 60 is connected to the camera 52 and the electronic display 56. The processor is operable to visualize the captured image 21 of the medical device 1 when the medical device 1 is captured by the camera 52 of the portable electronic device 50.
[0140] At the same time, the processor 60 is operable to display a virtual contour of the medical device 1 on the electronic display and, thus, a target position or a target orientation of the medical device. The virtual contour 22 can be provided on the electronic display 56 separately and can define or visualize a predefined target position and / or a predefined target orientation of the captured image 21 of the medical device 1.
[0141] In the configuration as Figure 3 illustrated, the camera 52 captures a portion of the injection device 12 or medical device 1 which is not yet correctly aligned and, thus, is oriented at an angle with respect to the extension of the virtual contour 22 of the medical device 1.
[0142] In a further illustration of Figure 4 , the user has turned and / or re-oriented the medical device 1 to such an extent that the captured image 21' of at least a portion of the medical device 1 is substantially co-aligned with the virtual contour 22' provided on the electronic display 56 at the same time. As from Figure 4The structure and / or geometry of the captured image 21'and thus the outer periphery is still slightly smaller compared to the virtual contour 22' of the medical device 1 directly apparent. This indicates that the distance between the housing 51 and the medical device 1 is still too large.
[0143] Bringing the medical device 1 or the injection device 12 closer to the housing 51 of the portable electronic device 50 causes the captured image 21'' on the electronic display 56 to increase accordingly until the captured image 21'' matches the virtual contour 22''. When a substantial overlap between the captured image 21'' and the virtual contour 22' is reached, the machine-readable identifier 24 is correctly aligned with the electronic reader 54. In the case shown in Fig. 6, for example, the captured image 21'' and the virtual contour 22' are substantially overlapping. Figure 5 In this configuration shown, the readout of the data or information stored in the machine-readable identifier 24 is achieved and the electronic reader 54 can actually read out the respective information.
[0144] In some examples, the virtual contour 22 is visually presented on the electronic display 56 simultaneously with the live image of the camera 52. This way, the user is provided with direct and immediate feedback on how to arrange the medical device 1 with respect to the portable electronic device 50 to obtain a substantially overlapping configuration as shown in Fig. 6, for example. Figure 5
[0145] In some examples, the processor 60 can be operative to identify at least one of a position and an orientation of the medical device 1 in the captured image 21. For example, and as shown in Fig. 7, the processor 60 can be operative to identify the so-called identified item 25 in the image 21' presented on the electronic display 56 as shown in Fig. 6. Moreover, the processor 60 can be operative to assess that the identified item 25 has not yet matched the virtual contour 22'. Figure 4 Figure 4 In this case, the processor can not only identify the predefined item 25 in the image 21 but can further be operative to determine the degree of overlap between the identified item 25 and the virtual contour 22.
[0146] While identifying the medical device 1 as the identified item 25 in the captured image 21, the processor 60 can be operative to modify the visual appearance of the virtual contour 22. In the case shown in Fig. 7, for example, the virtual contour 22 is represented in a dotted line structure at this point in time when the captured image 21 has not yet been identified as the medical device 1 or the injection device 12. Upon identifying the identified item 25, the virtual contour 22 can switch to the virtual contour 22' as shown in Fig. 8. Here and in response to identifying the identified item 25, the processor 60 can be operative to modify the visual appearance of the virtual contour 22 from a dot-dash line illustration as shown in Fig. 7 towards a dotted line structure of the virtual contour 22 as shown in Fig. 8. Figure 3 Figure 4 Figure 3 Figure 4
[0147] Furthermore, when reaching an effective overlap configuration, e.g. as shown in Figure 5 the processor 60 can be further operative to change the visual appearance of the virtual contour 22' towards a virtual contour 22" as shown in Figure 5 . Here, the structural change of the virtual contour 22' as shown in Figure 4 is changed to a virtual contour 22" reproduced in a dotted line structure.
[0148] In the inventive illustration of Figures 3 to 5 the different appearances of the virtual contours 20, 22', 22" can help and guide the user to perform and achieve a predefined mutual alignment of the electronic reader 54 with respect to the machine-readable identifier 24.
[0149] The different illustrations of the virtual contours 20, 22', 22" can be reflected by a change in color, brightness or contrast of the virtual contours as well as by a dynamic appearance with respect to the virtual contours 22, 22', 22". Thus, the different illustrations of the virtual contours 20, 22', 22" as shown in Figures 3 to 5 may also be reflected by a constant or intermittent appearance of the virtual contours 22, 22', 22" or by some kind of flickering of these virtual contours.
[0150] Also here, a change in frequency of the appearance and disappearance of the virtual contours 22, 22', 22" can indicate to the user an increase or decrease in the degree of alignment and / or the degree of overlap between the identified item 25 and the virtual contours 22.
[0151] Once the correct or predefined alignment is achieved, the electronic reader 54 can be operative to read out the data or information stored in the machine-readable identifier 24, e.g. as shown in Figure 5 . The respective information, such as the type of medication, the amount of medication, prescription information, date of manufacture, place of manufacture, batch number, best before date, can be visualized in information windows 4, 5 of a display section 2 as provided on the electronic display 56. A confirmation section 6 can be further provided, which can be simulated by the processor 60 on the touch-sensitive electronic display 56. Here, the user can simply touch the confirmation 6 to prompt or confirm that the data stored in the machine-readable identifier 24 has been successfully captured by the electronic device 50.
[0152] The illustration of the virtual contour 22 on the electronic display 56 can largely depend on the software or hardware configuration of the portable electronic device 50. It can largely depend on the relative position or orientation of the electronic reader 54 and the camera 52, as e.g. shown in the two examples of Figure 8 and Figure 9 . For example, the scenario as shown in the sequence of Figures 3 to 5 may be used as an example for the illustration of the virtual contour 22 on the electronic display 56.Figure 8 The portable electronic device 50 as shown obtains a first spatial image offset 71 between the camera 52 and the machine-readable identifier 54.
[0153] For the configuration of the portable electronic device 50 as shown in Figure 9 a virtual contour 22 as shown in Figure 6 may be provided. Here and in contrast to the configuration as shown in Figures 3 to 5 the desired or intended orientation and / or position of the captured image 21 has changed significantly in comparison to the configuration as shown in Figures 3 to 5 Here and in contrast to the configuration as shown in Figures 3 to 5 the longitudinal axis of the tubular injection device 12 or the medical device 1 has to be rotated about 90° with respect to the housing 51 of the electronic device 50'. Also here and due to this augmented reality provided in the display window 7 of the electronic display 56, the user will have almost no difficulties in correctly aligning the captured image 21 with the virtual contour 22 provided in the camera window 7.
[0154] In the configuration according to Figure 6 it is directly apparent to the user that the medical device 1 has to be rotated counterclockwise about 90° to 115° and the distance between the housing 51 and the medical device 1 has to be reduced. Finally, when a substantial spatial and virtual overlap between the captured image 21' and the virtual contour 22' as shown in Figure 7 a corresponding wireless readout of the machine-readable identifier 24 can be provided.
[0155] Similarly and as already explained in connection with Figure 5 a corresponding information 4, 5 can be displayed in the display section 2 or information window of the electronic display 56.
[0156] In Figure 10 and Figure 11 two examples of a sticker 40 are shown, which can be provided or adhered to at least one of the medicament container 14 and the housing 10 of the medical device 1. The sticker 40 can comprise a planar and flexible or soft substrate 41, such as a bendable or flexible foil. The substrate 41 can comprise an adhesive foil, which can be fixedly attached to one of the housing 10 and the medicament container 14 contained inside the housing 10.
[0157] The sticker 40 can be provided with a visual marker 30, which comprises or provides a number of visual information 31, 32, 33. The information 31, 32, 33 can be provided in printed or visual form on a surface of the visual marker 30. The visual marker 30 can be a printed sticker adhered or attached to the substrate 41.
[0158] The sticker 40 is further provided with a machine-readable identifier 24, which can comprise an NFC tag 26 or an RFID tag. The NFC tag is typically provided with a tag processor 42 and an antenna 44 electrically connected to the tag processor 42. The machine-readable identifier 24, e.g. the NFC tag 26, can be implemented as a passive transceiver, which is operable to draw power from an RF field of an electronic reader 54 of the electronic device 50, thereby allowing the tag processor 42 to be powered and to exchange data with or transmit data to the electronic reader 54.
[0159] In the example of the sticker 40 according to Figure 10 the machine-readable identifier 24 is located below and / or next to the visual marking 30. In another configuration of the sticker 40 according to Figure 11 the visual marking 30 and the machine-readable identifier 24 are provided in another configuration or mutual arrangement. There, the machine-readable identifier 24 is arranged above and / or next to the visual marking 30. In fact, compared to the respective positions of the visual marking 30 and the machine-readable identifier 24 of the example as shown in Figure 11 the positions of the visual marking 30 and the machine-readable identifier 24 in the example according to Figure 10 have been interchanged.
[0160] The portable electronic device 50 and / or the computer program to be executed by the processor 60 can be provided with respective information to indicate which type of sticker 40 is expected to be provided on or inside the housing 10 of the medical device 1 or the injection device 12. With this information, it is even conceivable that the processor 60 not only provides the virtual outline 22 of the medical device 1 on the electronic display 56. Rather, the processor 60 can also or alternatively be operable to visualize on the electronic display 56 both the captured image 21 of the medical device 1 and the transparent or semi-transparent virtual image 23 of the medical device 1 at the same time.
[0161] In case the transparent or semi-transparent virtual image 23 and the captured image 21 of the medical device 1 are provided at the same time, the visual marking 30 as provided on the housing 12 can also be used to correctly align and / or correctly orient the medical device 1 with respect to the electronic reader 54.
[0162] Further, and as Figure 12As shown, the captured image 21 of the medical device 1 only shows the visual marker 30 and / or the identifier 24 on the captured image 21. The transparent or semi-transparent virtual image 23 of the medical device 1 indicates to the user that the medical device 1 has to be rotated with respect to its longitudinal axis (z) as axis of rotation not only to bring the captured image 21 into a substantially overlapping configuration with the virtual contour 22, but also to rotate the medical device 1 by a predefined angle such that the visual marker 30 substantially aligns or overlaps with the visual marker 30 of the transparent or semi-transparent virtual image 23 as reproduced or provided on the electronic display 56. This way, even a three-dimensional alignment between the electronic reader 54 and the machine-readable identifier 24 can be achieved and provided.
[0163] In Figure 13 and Figure 14 the process of correctly aligning the portable electronic device 50 with respect to the medical device 1 is shown in a side view. In the configuration of Figure 13 there is a certain alignment mismatch between the machine-readable identifier 24 and the electronic reader 54 of the electronic device 50 at least with respect to the horizontal direction. The camera 52 can be operable to at least visualize the visual marker 30, which can then be shown in the middle of the electronic display 56, for example.
[0164] In the configuration of Figure 13 the processor 60 will be operable to show the respective alignment mismatch on the electronic display 56. Here, the captured image 21 of the medical device 1 can be visualized in a way that there is a certain offset to the virtual contour 22 of the medical device 1. This offset visualization provided by the electronic display 56 can indicate to the user to move the electronic device 50 with respect to the medical device 1 in the horizontal direction until a respective matching configuration is obtained, which reflects the intended alignment of the machine-readable identifier 24 of the medical device 1 with respect to the electronic reader 54 of the portable electronic device 50 as shown in Figure 14 .
[0165] In Figure 15 and by way of example, a number of hardware components of the portable electronic device 50 are schematically illustrated. The portable electronic device 50 comprises a housing 51 and a display 56, which is provided, for example, on one side of the housing 51. On the opposite side of the housing, for example, at the bottom or bottom side of the housing 51, typically a camera 52 is provided. Optionally, an electronic reader 54 can also be provided at or in the vicinity of the lower side. The electronic reader 54 can be embodied as an NFC transceiver 57.
[0166] Optionally, the electronic device 50 comprises a short-range transceiver 55, for example in the form of a Bluetooth or Wi-Fi transceiver, through which the electronic device 50 can establish another communication link with further communication hardware or communication infrastructure.
[0167] The electronic device 50 further comprises a battery 53 for providing power to the processor 60 and the transceivers 55, 57. The processor 60 can be provided with an electronic device identifier 61. The electronic device identifier 61 is in particular operable for storing and / or providing spatial image offset information 71, 72 indicative of a spatial offset between the camera 52 and the electronic reader 54. In this case, the spatial image offset information 71, 72 can be selected from a database (stored on the electronic device for example or elsewhere) and / or can be embodied in the computer program comprising spatial offset information for various electronic devices, as long as the methods are implemented in a computer program that can be installed on different types of electronic devices (e.g. different types of smartphones). In this way, an app or computer program suitable for various different electronic devices (e.g. different smartphones) can contain spatial offset information for each type of electronic device. Depending on the type of electronic device the app or computer program is installed or deployed on, the spatial offset information relevant for the particular electronic device or smartphone can be selected and used for properly calibrating the electronic device.
[0168] Alternatively, the electronic device identifier 61 can be provided in a non-volatile portion of the memory 58. The memory 58 can further be provided with memory blocks of volatile or non-volatile type. The memory 58 is operable for storing at least information or data as obtained by reading out the machine-readable identifier 24 provided by the electronic reader 54.
[0169] In Figure 16 In this case, the spatial image offset information 71 can be indicative of the transceiver position TA and the camera position CA relative to each other or relative to the housing 51 of the first electronic device A 50.
[0170] For another electronic device 50' provided by another manufacturer for example or for a different type of electronic device 50', the spatial image offset information 72 can be indicative of the transceiver position TB and the camera position CB relative to each other or relative to the housing 51 of the other electronic device B 50'.
[0171] In the same or similar way, the memory 58 can be provided with spatial device offset information 73, 74 indicative of a spatial offset between the machine-readable identifier 24 and at least one of the visual marking 30 on the medical device 1 and the outline 11 of the medical device 1. Here, the first spatial device offset information 73 can be indicative of the label position LA and / or the identifier position IA of the first medical device A 1 or the first injection device A 12.
[0172] As Figure 16The indicated spatial device offset information 74 can indicate another label position LB and another identifier position IB of another medicament B as provided in another medicament container 14 or another medical device 1'or injection device 12'.
[0173] Figure 2 Another example of spatial device offset information 73 is shown in Fig. 3. There, the machine-readable identifier 24 is embodied as an NFC tag 26 and is provided on an outer surface of the housing 10 of the injection device 12. The machine-readable identifier is located at a predefined longitudinal distance 73' from the proximal end of the housing 10 and is arranged at a predefined tangential distance 73'' from a lateral edge or a feature portion (e.g. a marking or a physical feature like a ridge) of the housing 10.
[0174] Upon initialization of the portable electronic device 50 and / or upon first use of a respective computer program deployed by the portable electronic device 50, the computer program can be operative to obtain or read the electronic device identifier 61 and thereby obtain the respective spatial offset information 71, 72 indicative of the spatial offset between the camera 52 and the electronic reader 54.
[0175] In this way, the portable electronic device 50 can be properly calibrated or adjusted for use with a particular type of medical device 1. In the same or a similar way and when, for example, not only the virtual contour 11 is to be used but also a visual marker 30 as provided on the exterior of the medical device 1 is to be used for the alignment between the electronic reader 54 and the machine-readable 24, it is particularly beneficial to provide or select the spatial device offset information 73, 74, which is generally stored or provided by the computer program for all types of available medical devices 1 to be used with the portable electronic device 50.
[0176] In Figure 18 In Fig. 4, a flowchart of a method of reading a machine-readable identifier 24 provided in or on a medical device 1 as described herein is demonstrated. Therein and in a first step 100, the user can determine or select a particular type of medical device 1 to be used with the portable electronic device 50. In a subsequent step 102, the camera 52 is activated and the camera image is reproduced in the camera window 7 of the electronic display 56. At the same time, the virtual contour 22 is demonstrated in the camera window 7 by the processor 60.
[0177] In step 104, it is checked whether the captured image 21 of the medical device 1 obtained by the camera 52 overlaps or aligns with the virtual contour 22 and to what extent. As long as the extent of overlap is insufficient, the method returns to step 102 and repeats steps 102 and 104 until the captured image 21 of the medical device 1 properly overlaps with the virtual contour 22 on the electronic display 56. In a subsequent step 106, and after a suitable extent of overlap has been reached, a user feedback can optionally be provided (e.g. by changing the appearance of the virtual contour 22), thereby indicating to the user that a sufficient extent of overlap between the captured image 21 and the virtual contour 22 has been obtained. In a subsequent step 108, the machine-readable identifier 24, e.g. an electronic label, is read out by the electronic reader 54. Simultaneously or thereafter, corresponding information is presented on the electronic display 56.
[0178] In a further flowchart as Figure 18 presented, a number of steps are schematically presented in which the portable electronic device 50 is set up or deployed to read the machine-readable identifier 24 and to assist the user in properly aligning the portable electronic device 50 and the medical device 1. Here, and in a first step 110, an electronic device identifier 61 is read out, e.g. by the processor 60, which is indicative of the hardware configuration and in particular of spatial offset information 71, 72 which is indicative of the spatial offset between the camera 52 and the electronic reader 54 of the respective portable electronic device 50.
[0179] Thereafter and in step 112, a kind of calibration of the guiding and assisting function is made based on the offset information between the camera 52 and the electronic reader 54. Optionally, and in step 114, a relationship between the machine-readable identifier 24 and the spatial offset between the visual marker 30 and at least one of the contour 11 and the visual marker 30 of the medical device 1 is derived.
[0180] Depending on the derivation of the respective spatial relationship between the camera 52, the electronic reader 54 and the visual marker 30, in step 116, the machine-readable identifier 24 is aligned with respect to the electronic reader 54 in the manner as described above in connection with steps 112, 114. Here, the user moves the portable electronic device 50 with respect to the medical device 1 as long as needed and guided by the augmented visualization on the electronic display 56 until the electronic reader 54 is properly aligned with the machine-readable identifier 24 in step 118.
[0181] Reference signs
[0182] 1 medical device
[0183] 2 display section
[0184] 3 input section
[0185] 4 information
[0186] 5 information
[0187] 6 confirmation
[0188] 7 camera window
[0189] 10 housing
[0190] 11 profile
[0191] 12 injection device
[0192] 14 medicament container
[0193] 15 cap
[0194] 21 image
[0195] 22 virtual profile
[0196] 23 virtual image
[0197] 24 identifier
[0198] 25 identified item
[0199] 26 NFC tag
[0200] 30 visual marker
[0201] 31 information
[0202] 32 information
[0203] 33 information
[0204] 40 sticker
[0205] 41 substrate
[0206] 42 tag processor
[0207] 44 antenna
[0208] 50 electronic device
[0209] 51 housing
[0210] 52 camera
[0211] 53 battery
[0212] 54 electronic reader
[0213] 55 local-range transceiver
[0214] 56 display
[0215] 57 NFC transceiver
[0216] 58 memory
[0217] 60 processor
[0218] 61 electronic device identifier
[0219] 80 system.
Claims
1. A portable electronic device (50), comprising: - Camera (52), which is operable to capture images (21) of a medical device (1), wherein the medical device (1) is provided with a machine-readable identifier (24). - An electronic reader (54) that is operable to read the machine-readable identifier (24) when aligned with the machine-readable identifier (24). - An electronic display (56) capable of visualizing images (21) captured by the medical device (1), and - A processor (60) connected to the camera (52) and the electronic display (56) is operable to display a virtual outline (22) of the medical device (1) on the electronic display (56) such that when the electronic reader (54) is aligned with the machine-readable identifier (24), the virtual outline (22) is aligned with and / or overlapped with the captured image (21) on the electronic display (56).
2. The portable electronic device (50) according to claim 1, further comprising an electronic device identifier (61) that includes or provides spatial image offset information (71, 72) indicating the spatial offset between the camera (52) and the electronic reader (54).
3. The portable electronic device (50) according to claim 1 or 2 further includes a memory (58) operable for storing spatial device offset information (73, 74) indicating the spatial offset between the machine-readable identifier (24) and at least one of a visual mark (30) on the medical device (1) and the outline (11) of the medical device (1).
4. The portable electronic device (50) according to claim 2 or 3, wherein, The processor (60) is capable of displaying a virtual outline (22) of the medical device (1) on the electronic display (56) with respect to at least one of the spatial image offset information (71, 72) and the spatial device offset information (73, 74).
5. The portable electronic device (50) according to any one of the preceding claims, wherein, The processor (60) is operable to identify at least one of the positions and orientations of the medical device (1) and the electronic identifier (24) in the captured image (21) as an identified item (25).
6. The portable electronic device (50) according to claim 5, wherein, The processor (60) is capable of modifying the appearance of the virtual contour (22) on the electronic display (56) based on the degree of alignment and / or overlap between the identified item (25) and the virtual contour (22).
7. The portable electronic device (50) according to claim 6, wherein, The processor (60) is capable of modifying at least one of the structure, color, brightness, contrast and dynamic appearance of the virtual contour (22) in response to changes in the alignment and / or overlap between the identified item (25) and the virtual contour (22).
8. The portable electronic device (50) according to any one of the preceding claims, wherein, The processor (60) is further operable to display a transparent or semi-transparent virtual image (23) of the medical device (1) on the electronic display (56) such that when the electronic reader (54) is aligned with the machine-readable identifier (24), the virtual image (23) is aligned with and / or overlapped with the captured image (21) on the electronic display (56).
9. The portable electronic device (50) according to any one of the preceding claims, wherein, The electronic reader (54) includes a near-field communication (NFC) transceiver.
10. A system (80) comprising: - A medical device (1) comprising a housing (10) and a machine-readable identifier (24) located on or inside the housing (10). - The portable electronic device (50) according to any one of the preceding claims includes the electronic reader (54) which is operable to read the machine-readable identifier when aligned with the machine-readable identifier (24) of the medical device (1).
11. The system (80) according to claim 10, wherein, The medical device (1) includes an injection device (12).
12. A method for reading a machine-readable identifier (24) disposed in or on a medical device (1) using a portable electronic device (50), wherein, The portable electronic device (50) includes a camera (52), an electronic reader (54), and an electronic display (56), and the method includes the following steps: -The camera (52) of the portable electronic device (50) captures an image (21) of the medical device (1). - A virtual outline (22) of the medical device (1) is displayed on the electronic display (56). - The images (21) captured by the medical device (1) are visualized on the electronic display. - Move the medical device (1) relative to the portable electronic device (50) so that the captured image (21) is aligned with and / or at least partially overlapped with the virtual outline (22) of the medical device (1), thereby placing the electronic reader (54) at either a reading distance or a reading orientation relative to the machine-readable identifier (24).
13. The method of claim 12, further comprising the following steps: - Obtain or acquire at least one of spatial image offset information (71, 72) and spatial device offset information (73, 74), wherein the spatial image offset information (71, 72) indicates the spatial offset between the camera (52) and the electronic reader (54), and wherein the spatial device offset information (73, 74) indicates the spatial offset between the machine-readable identifier (24) and at least one of the visual mark (30) on the medical device (1) and the outline (11) of the medical device (1), and - The virtual outline (22) of the medical device (1) is displayed on the electronic display (56) with respect to at least one of the spatial image offset information (71, 72) and the spatial device offset information (73, 74).
14. The method of claim 13, further comprising the following steps: - Identify at least one of the medical device (1) and the electronic identifier (24) in the position and orientation of the captured image (21) as an identified item (25).
15. A computer program comprising computer-executable instructions that, when executed by a processor (60) of a portable electronic device (50) according to any one of claims 1 to 9, cause the processor to: -The camera (52) of the portable electronic device (50) captures an image (21) of the medical device (1). - A virtual outline (22) of the medical device (1) is displayed on the electronic display (56). - Simultaneously visualize the captured image (21) of the medical device (1) and the virtual outline (21) of the medical device (1) on the electronic display.