A computer program for assisting a user to align the spray nozzle of an eye drop sprayer with an eye

Abstract

According to the present invention there is provided a computer program, for assisting a user to align the spray nozzle (3) of an eye drop sprayer device (2) with an eye, stored on a portable electronic device (4), the portable electronic device having a processor (6) and a camera (5a,5b); and wherein the portable electronic device (4) can connect with an eye drop sprayer device (2) which has a spray nozzle (3) to form an eye drop assembly (1), wherein the portable electronic device (4) and the eye drop sprayer device (2) are in a predefined orientation with respect to one another when connected to form the eye drop assembly (1); and wherein the eye drop sprayer device (2) holds a fluid; and wherein the computer program which when executed by a processor (6) will cause the processor (6) to, use an captured by the camera (5a,5b) of the portable electronic device (4), wherein at least a portion of the image depicts an eye, to determine the direction to move the eyedrop assembly (1) so that the spray nozzle (3) is aligned with said eye; prompt the user to move the eyedrop assembly (1) in said determined direction. There is further provided a portable electronic device having a memory which stores a computer program.

Description

YNB23P06PC1A computer program for assisting a user to align the spray nozzle of an eye drop sprayer with an eyeField of the invention

[0001] The present invention concerns a computer program for assisting a user to align the spray nozzle of an eye drop sprayer with an eye. The computer program is stored on a portable electronic device which has a processor and a camera; the portable electronic device can connect with an eye drop sprayer device which has a spray nozzle to form an eye drop assembly. There is further provided a portable electronic device having said computer program stored in a memory of the portable electronic device.Background to the invention

[0002] Self-administration of fluids (such as eye drops or other ophthalmic medications) to an eye poses many difficulties: Typically, the fluids come in a plastic bottle having a dispensing nozzle; the user is required tilt their head backwards, align the dispensing nozzle of the bottle with their eye, and remain in this position until the fluid drops from the nozzle fall into the eye. Often users lack the mobility to tilt their head backwards; and / or often users lack the dexterity or fine motor skills to accurately align the dispending nozzle with their eye; consequently, the fluid drops are not delivered successfully into the user's eye.

[0003] Not only can failure to deliver the fluid drop to the user's eye result in an under dosage, but it also results in a high amount of wasted fluid.

[0004] Furthermore, there is the risk that the user will move the bottle too close to their eye so that the dispensing nozzle touches their eye or eyelid, causing injury to the eye or eyelid and / or causing contamination ofEYENEB-1-EPthe eye. If the dispensing nozzle touches the eye or eyelid of the user this can also result in contamination of the dispensing nozzle.

[0005] Moreover, the user is required count the number of drops which are dispensed from nozzle to ensure that a precise number of drops are administered to the eye to ensure a correct dosage of fluid is delivered to the eye. Often a user can lose count of the number of drops dispensed from the nozzle resulting in an incorrect dosage of fluid being administered to the eye.

[0006] Furthermore, the rate at which the drops are dispensed from nozzle is typically dictated by how much the user squeezes the plastic bottle; if the user squeezes the bottle too much this can result in many drops being quickly dispensed from the nozzle resulting in too many drops of fluid (i.e. an over dosage) being administered to the eye. Depending on the type of the fluid (e.g. the composition of the ophthalmic medication) administering too many drops / too high volume of fluid to the eye can result in discomfort a / or pain in the eye of the user, or in the worst case can result in damage to the eye of the user.

[0007] Additionally, for some fluids it is required that the fluid be delivered into the pupil, iris or sclera of the eye; this means that, for successfully administration the fluid drops which are dispensed from the nozzle must be delivered into an open eye. For such fluids the timing of the dispensing of the fluid drops from the nozzle is critical because the eyelid must be open at the time the drops arrive at the eye. Delivering the drops into an open eye is difficult, especially for those users that lack manual dexterity or fine motor skills. Added to that is the fact that some users may have very a sensitive or exaggerated blink reflex making it even more difficult to deliver the drops into their open eye. Other users may suffer from eyelid spasms or reflex tearing which can make it even more difficult to deliver the drops into their open eye, or result in the retention of the fluid drops within the eye.EYENEB-1-EP

[0008] In other cases the user is delivering fluid to an eye of another person / animal. For example, care givers (such as parents, nurses, carers, and / or doctors etc) often need to deliver fluid to an eye of a child, patient, or elderly person. Delivering fluid to an eye of another person / animal can be even more difficult using the existing manual techniques because the care giver has no control over the other person's / animal's eye and also cannot anticipate the reaction or activity of the other person's / animal's eye.

[0009] 'Smart' fluid sprayers in which fluid sprayer device is linked, by Bluetooth for example, to a portable electronic device, are known. These smart fluid sprayers transmit data captured by the smart fluid sprayer to a remote server. Automatic triggering of the sprayer to spray fluid after successful alignment of the sprayer with the eye is also known. However, none of these existing technologies teach using a camera and processor of a portable electronic device (such as a smartphone) which is connected to the sprayer device, to assist the user to align a nozzle of the sprayer device with the eye.

[0010] It is an aim of the present invention to mitigate, or obvious, at least some of the problems that arise in the manual techniques which are currently practiced to administer fluid to an eye. In particular it is one aim of the present invention to provide a computer program, provided on a portable electronic device (such as a smartphone) which connects with the sprayer device, that assists a user to achieve alignment of the nozzle of a sprayer device with an eye.Short disclosure of the invention

[0011] According to the present invention relates to a computer program having the features recited in independent claim 1.

[0012] In the present invention the computer program is provided on a portable electronic device (such as a smartphone) which connects with the eye drop sprayer device to form an eye drop assembly; the computerEYENEB-1-EPprogram when executed by the processor causes the processor of the portable electronic device to use images (preferably images of a face) captured by the camera of the portable electronic device to determine in which direction the eyedrop assembly should be moved to align the spray nozzle of the eye drop sprayer device with an eye; and to prompt the user to move the eye drop assembly in said determined direction, thus achieving the above-mentioned aim of assisting a user to achieve alignment of the nozzle of a sprayer device with an eye.

[0013] The dependent claims recite optional features of various embodiments of the invention. It should be understood that any of the subsequently described features may be optional features of any of embodiments described in the present disclosure. Even if a feature is described in the present disclosure as being a feature of an embodiment, it should be understood that that feature could be an optional feature of any of the other embodiments of the present invention. Any embodiment disclosed in the present disclosure may have any one or more of the features of any of the other embodiments disclosed in the present disclosure.

[0014] In one preferred embodiment the computer program when executed by the processor causes the processor to initiate the eye drop sprayer device to spray fluid through the spray nozzle, when the spray nozzle of the eye drop sprayer device has been aligned with the eye. The computer program when executed by the processor may cause the processor to detect when the spray nozzle of the eye drop sprayer device has been aligned with the eye; and in response to detecting the spray nozzle of the eye drop sprayer device has been aligned with the eye, initiate the eye drop sprayer device to spray fluid through the spray nozzle. Advantageously, in this preferred embodiment, the fluid will be administered to the eye at the moment when the spray nozzle is aligned with the eye.EYENEB-1-EP

[0015] According to an embodiment of the present invention there is provided a computer program, for assisting a user to align the spray nozzle of an eye drop sprayer device with an eye, stored on a portable electronic device, the portable electronic device having a processor and a camera; and wherein the portable electronic device can connect with an eye drop sprayer device which has a spray nozzle to form an eye drop assembly, wherein the portable electronic device and the eye drop sprayer device are in a predefined orientation with respect to one another when connected to form the eye drop assembly; and wherein the eye drop sprayer device holds a fluid; and wherein the computer program which when executed by a processor will cause the processor to, use an captured by the camera of the portable electronic device, wherein at least a portion of the image depicts an eye, to determine the direction to move the eyedrop assembly so that the spray nozzle is aligned with said eye; prompt the user to move the eyedrop assembly in said determined direction.

[0016] In an embodiment the computer program which when executed by a processor will cause the processor to, use the image to determine the position of the spray nozzle relative to the eye; and use the determined position of the spray nozzle relative to the eye to determine said direction to move the eyedrop assembly so that the spray nozzle is aligned with the eye.

[0017] In an embodiment the portable electronic device comprises a touchscreen, and wherein the eye drop sprayer comprises a stylus which has a tip which is in a predefined fixed location relative to the sprayer nozzle, and wherein the stylus contacts the touchscreen of the portable electronic device when the portable electronic device and the eye drop sprayer device are connected to form the eye drop assembly, and wherein the computer program which when executed by a processor will cause the processor to further, receive, as an input, the location on the touchscreen where the tip of the stylus contacts the touchscreen; use said input and said image, to determine the position of the sprayer nozzle relative to the eye; use said determined position of the sprayer nozzle relative to the eye to determineEYENEB-1-EPsaid direction to move the eyedrop assembly so that the spray nozzle is aligned with said eye.

[0018] In an embodiment the portable electronic device comprises a memory having stored therein the predefined fixed location of the tip of the stylus relative to the sprayer nozzle, and wherein the computer program which when executed by a processor will cause the processor to determine the position of the sprayer nozzle relative to the eye by, determining first position data, which is the position of the tip of the stylus relative to the camera, using said input; retrieving from a memory of the portable electronic device the predefined fixed location of the tip of the stylus relative to the sprayer nozzle; determining second position data, which is the position of the sprayer nozzle relative to the camera, using the first position data and said retrieved predefined fixed location of the tip of the stylus relative to the sprayer nozzle; determining third position data, which is the position of the camera relative to the eye, using the image; determining the position of the sprayer nozzle relative to the eye, using the second position data and third position data.

[0019] In an embodiment the computer program which when executed by a processor will cause the processor to, use the image to determine the position of the camera relative to the eye; and use the determined position of the camera relative to the eye to determine said direction to move the eyedrop assembly so that the spray nozzle is aligned with the eye

[0020] In an embodiment the portable electronic device comprises a touchscreen, and wherein the eye drop sprayer comprises a stylus which has a tip which is in a predefined fixed location relative to the sprayer nozzle, and wherein the stylus contacts the touchscreen of the portable electronic device when the portable electronic device and the eye drop sprayer device are connected to form the eye drop assembly, and wherein the computer program which when executed by a processor will cause the processor to further, receive, as an input, the location on the touchscreen where the tip of the stylus contacts the touchscreen; use said input and said image, toEYENEB-1-EPdetermine the position of the camera relative to the eye; use said determined position of the camera relative to the eye to determine said direction to move the eyedrop assembly so that the spray nozzle is aligned with said eye.

[0021] In an embodiment the portable electronic device comprises a memory having stored therein the predefined fixed location of the tip of the stylus relative to the sprayer nozzle, and wherein the computer program which when executed by a processor will cause the processor to, determine first position data, which is the position of the tip of the stylus relative to the camera, using said input; retrieving from a memory of the portable electronic device the predefined fixed location of the tip of the stylus relative to the sprayer nozzle; determine second position data, which is the position of the sprayer nozzle relative to the camera, using the first position data and said retrieved predefined fixed location of the tip of the stylus relative to the sprayer nozzle; use the second position data to determine a reference position, wherein the reference position is a relative position of the camera relative to the eye at which the sprayer nozzle would be aligned with the eye; determine third position data using the image captured by the camera, wherein the third position data is the position of the camera relative to the eye; compare said third position data to said reference position to determine the direction to move the eyedrop assembly so that the camera is brought to the reference position, and the spray nozzle is aligned with the eye.

[0022] In an embodiment the portable electronic device comprises a display screen, and wherein when the eye drop sprayer device is connected to the portable electronic device in a first predefined configuration the spray nozzle is pointing in the same direction as the direction that that the display screen is facing.

[0023] In an embodiment the eye is an eye belonging to a third party; and wherein the portable electronic device comprises a touchscreen, and wherein the eye drop sprayer comprises a stylus which has a tip which is inEYENEB-1-EPa predefined fixed location relative to the sprayer nozzle, and wherein the stylus contacts the touchscreen of the portable electronic device when the eye drop sprayer device is connected to the portable electronic device in a first predefined configuration wherein the eye drop sprayer device is connected to the portable electronic device such that the spray nozzle is pointing in the same direction as the direction that that the display screen is facing, and wherein the computer program which when executed by a processor will cause the processor to further, receive, as an input, the location on the touchscreen where the tip of the stylus contacts the touchscreen; determine first position data, using the input and said retrieved predefined fixed location of the tip of the stylus relative to the sprayer nozzle, wherein the first position data is the position the sprayer nozzle will have relative to the camera if the eye drop sprayer device and portable electronic device are connect in a second predefined configuration, wherein in said second predefined configuration the eye drop sprayer device is connected to the portable electronic device such that the spray nozzle is pointing in the opposite direction as the direction that that the display screen is facing; use the first position data to determine a reference position, wherein the reference position is a relative position of the camera relative to the eye at which the sprayer nozzle would be aligned with the eye; determine second position data using an image captured by the camera when the eye drop sprayer device and portable electronic device are connected in the second predefined configuration, wherein the image depicts the eye of a third party, wherein the second position data is the position of the camera relative to the eye of the third party; compare said second position data to said reference position to determine the direction to move the eyedrop assembly so that camera brought to the reference position and the spray nozzle is aligned with the eye of the third party.

[0024] In an embodiment the eye is an eye belonging to a third party; and wherein the portable electronic device comprises a touchscreen, and wherein the eye drop sprayer comprises a stylus which has a tip which is in a predefined fixed location relative to the sprayer nozzle, and wherein the stylus contacts the touchscreen of the portable electronic device when theEYENEB-1-EPeye drop sprayer device is connected to the portable electronic device in a first predefined configuration wherein the eye drop sprayer device is connected to the portable electronic device such that the spray nozzle is pointing in the same direction as the direction that that the display screen is facing, and wherein the computer program which when executed by a processor will cause the processor to further, receive, as an input, the location on the touchscreen where the tip of the stylus contacts the touchscreen; determine first position data, using the input and said retrieved predefined fixed location of the tip of the stylus relative to the sprayer nozzle, wherein the first position data is the position the sprayer nozzle will have relative to the camera if the eye drop sprayer device and portable electronic device are connect in a second predefined configuration, wherein in said second predefined configuration the eye drop sprayer device is connected to the portable electronic device such that the spray nozzle is pointing in the opposite direction as the direction that that the display screen is facing; determine second position data using an image captured by the camera when the eye drop sprayer device and portable electronic device are connected in the second predefined configuration, wherein the image depicts the eye of a third party, wherein the second position data is the position of the camera relative to the eye of the third party; determine third position data, which is the position of the sprayer nozzle relative to the eye belonging to the third party, using the first position data and second position data; use said determined position of the sprayer nozzle relative to the eye to determine the direction to move the eyedrop assembly so that the spray nozzle is aligned with said eye of the third party.

[0025] In an embodiment the computer program which when executed by a processor will cause the processor to further prompt the user to connect the portable electronic device and eye drop sprayer device in the second predefined configuration after the first position data has been determined.

[0026] In an embodiment the computer program which when executed by a processor will cause the processor to, detect when the when the eyeEYENEB-1-EPdrop sprayer device and portable electronic device and are connected in the second predefined configuration.

[0027] In an embodiment the computer program which when executed by a processor will cause the processor to, receive as input an indication of whether the fluid is to be administered to the user's own eye, or, if the fluid is to be administered to an eye of a third party.

[0028] In an embodiment the computer program which when executed by a processor will cause the processor to further, initiate the eye drop sprayer device to spray fluid from the spray nozzle when the spray nozzle is aligned with the eye.

[0029] In an embodiment the computer program which when executed by a processor will cause the processor to further, receive as input at least a second image captured by the camera of the portable electronic device, wherein at least a portion of the captured second image depicts the eye; detect using the at least second image when the spray nozzle is aligned with the eye.

[0030] In an embodiment the computer program which when executed by a processor will cause the processor to, detect if the user fails to align the spray nozzle with the eye within a predefined time period; and in response to detecting that the user failed to align the spray nozzle with the eye within a predefined time period, send an alert to a remote server or platform.

[0031] In an embodiment the computer program which when executed by a processor will cause the processor to further, receive as input at least a second image depicting the eye, captured by the camera of the portable electronic device when the eyedrop assembly is in a position in which the spray nozzle is aligned with the users eye; determine from the received at least second image when the eye is open; and initiate the eye drop sprayer device to spray fluid from the spray nozzle when the eye is open.EYENEB-1-EP

[0032] In an embodiment the computer program which when executed by a processor will cause the processor to, receive as input a plurality of images captured by the camera of the portable electronic device; and determine a blinking frequency of the eye from said input; use the determined blinking frequency to determine a time instant when the eye is due to be open; and initiate the eye drop sprayer device to spray fluid at said determined time instant so that the fluid is sprayed from the spray nozzle when the eye is due to be open.

[0033] In an embodiment the computer program when executed by a processor will cause the processor to further, receive as input at least a third image depicting the eye, captured by the camera at a time instant corresponding to when the eye drop sprayer device was initiated to spray fluid from the spray nozzle; determine from the at least third image if user's eye was closed when the fluid reached the eye.

[0034] In an embodiment the computer program is when executed by a processor will cause the processor to further, prompt the user to align the spray nozzle with the eye if it is determined from the at least third image that the eye was closed when the fluid reached the eye.

[0035] In an embodiment the computer program which when executed by a processor will cause the processor to further, receive as input at least a second image depicting the eye, captured by the camera of the portable electronic device when the eyedrop assembly is in a position in which the spray nozzle is aligned with the users eye; determine from the received at least second image when the eye is closed; and initiate the eye drop sprayer device to spray fluid from the spray nozzle when the eye is closed.

[0036] In an embodiment the computer program when executed by a processor will cause the processor to further, receive as input at least a third image depicting the eye, captured by the camera at a time instant corresponding to when the eye drop sprayer device was initiated to sprayEYENEB-1-EPfluid from the spray nozzle; determine from the at least third image if user's eye was open when the fluid reached the eye.

[0037] In an embodiment the computer program is when executed by a processor will cause the processor to further, prompt the user to align the spray nozzle with the eye if it is determined from the at least third image that the eye was open when the fluid reached the eye.

[0038] In an embodiment the computer program which when executed by a processor will cause the processor to further, receive from the eye drop sprayer device a signal indicating if the fluid is to be administered to an open eye or to a closed eye; or receive an input from a user indicating if the fluid is to be administered to an open eye or to a closed eye.

[0039] In an embodiment the computer program which when executed by a processor will cause the processor to further, carry out any of the steps mentioned above if the signal received indicates that the fluid is to be administered to an open eye or if the user input indicates that the fluid is to be administered to an open eye; and / or carry out any of the steps mentioned above if the signal received indicates that the fluid is to be administered to a closed eye or if the user input indicates that the fluid is to be administered to a closed eye.

[0040] In an embodiment the computer program which when executed by a processor will cause the processor to further, receive as input at least a second image, captured by the camera, when the eyedrop assembly is in a position in which the spray nozzle is aligned with the eye, process the received at least second image to detect if there is an obstacle overlaying the eye.

[0041] In an embodiment the computer program which when executed by a processor will cause the processor to further, provide a prompt to remove the obstacle if it is detected that there is an obstacle overlaying the eye.EYENEB-1-EP

[0042] In an embodiment the obstacle comprises at least one of glasses, eye patch, and / or a bandage.

[0043] In an embodiment the received image depicts the face of a user, and wherein the computer program which when executed by a processor will cause the processor to, apply a mesh model to the image captured by the camera.

[0044] In an embodiment the computer program which when executed by a processor will further cause the processor to, use the mesh model to determine the location of the depiction of the eye in the captured image; and use the determined location of the depiction of eye in the captured image to determine the position of the camera relative to the eye of the user.

[0045] In an embodiment the computer program which when executed by a processor will cause the processor to further, process the image captured by the camera to determine a distance between a predefined reference and the eye; prompt the user to move the eyedrop assembly closer to the eye, or prompt the user to move the eyedrop assembly away from the eye, until the distance between the predefined reference and the eye is equal to a predefined distance.

[0046] In an embodiment the predefined reference is the spray nozzle through which fluid is sprayed.

[0047] In an embodiment the predefined reference is the camera.

[0048] In an embodiment the portable electronic device comprises a time-of-flight camera.

[0049] In an embodiment the predefined reference is the time-of-flight camera.EYENEB-1-EP

[0050] In an embodiment the computer program which when executed by a processor will cause the processor to further, process the image captured by the camera to determine an offset between a predefined reference axis and an optical axis of the eye; determine from the determined offset, the direction to adjust the tilt of the eyedrop assembly to bring the predefined reference axis parallel to the optical axis of the eye; prompt the user to move the eyedrop assembly in said determined direction.

[0051] In an embodiment the predefined reference axis is an optical axis of the camera.

[0052] In an embodiment the predefined reference axis is an axis of the spray nozzle which extends in the direction of spray of the spray nozzle.

[0053] In an embodiment the predefined reference axis is an axis of the spray nozzle, which extends from a centre of an opening of the spray nozzle through which fluid is sprayed, in the direction of spray of the spray nozzle.

[0054] In an embodiment the computer program which when executed by a processor will cause the processor to further, process the image captured by the camera to determine a rotation of the portable electronic device and / or the eyedrop assembly about a predefined reference axis; determine from the determined rotation a direction to rotate the eyedrop assembly to bring the portable electronic device and / or the eyedrop assembly into a predefined orientation; prompt the user to move the eyedrop assembly in said determined direction.

[0055] In an embodiment the predefined orientation is a vertical orientation.EYENEB-1-EP

[0056] In an embodiment the predefined reference axis is an optical axis of the camera.

[0057] In an embodiment the portable electronic device comprises an accelerometer, and wherein the computer program which when executed by a processor will cause the processor to, receive an output of the accelerometer which indicates a tilt of the portable electronic device and / or a tilt of the eyedrop assembly about one or more reference axes; determine from the received output of the accelerometer a direction to move the eyedrop assembly so that portable electronic device and / or the eyedrop assembly is parallel to a coronal plane of a face depicted in the image captured by the camera; prompt the user to move the eyedrop assembly in said determined direction.

[0058] In an embodiment the image captured by the camera depicts a face, and wherein the computer program which when executed by a processor will cause the processor to, process the captured image to determine an angle between a plane of the portable electronic device and a coronal plane of the face depicted in the image; determine from the determined angle a direction to move the eyedrop assembly so that the plane of the portable electronic device is parallel to the coronal plane of the face depicted in the image; prompt the user to move the eyedrop assembly in said determined direction.

[0059] In an embodiment the portable electronic device comprises a depth sensor, and wherein the image captured by the camera depicts a face, and wherein the computer program which when executed by a processor will cause the processor to, receive an output of the depth sensor which indicates the distance of the camera to a plurality of points depicted in the image; determine from the received output of the depth sensor an angle between a plane of the portable electronic device and a coronal plane of the face; determine from the determined angle a direction to move the eyedrop assembly so that the plane of the portable electronicEYENEB-1-EPdevice is parallel to the coronal plane of the face; prompt the user to move the eyedrop assembly in said determined direction.

[0060] In an embodiment the computer program which when executed by a processor will cause the processor to, carry out segmentation of the image captured by the camera, to form a segmented image.

[0061] In an embodiment the computer program which when executed by a processor will cause the processor to, use the segmented image to identify predefined regions of the eye.

[0062] In an embodiment the computer program which when executed by a processor will cause the processor to, select a predefined region of the eye, or, receive as an input a selection of a predefined region of the eye; and determine from the image the direction to move the eyedrop assembly so that the spray nozzle is aligned with said selected predefined region of the eye.

[0063] In an embodiment the computer program which when executed by a processor will cause the processor to, prompt the user in which direction to move the eyedrop assembly so that the spray nozzle is aligned with the selected predefined region of the eye.

[0064] In an embodiment the predefined regions comprise at least one or more of, the iris, pupil, sclera.

[0065] In an embodiment the portable electronic device comprises a plurality of cameras, and wherein the computer program which when executed by a processor will cause the processor to, selectively operate one of the plurality of cameras to capture an image of the eye.

[0066] In an embodiment the computer program which when executed by a processor will cause the processor to, operate a first camera of theEYENEB-1-EPportable electronic device to capture one or more images of the eye until the eyedrop assembly has been moved to a position in which the spray nozzle is aligned with the eye; and operate a second camera to capture one or more images of the eye after the spray nozzle has been aligned with the eye.

[0067] In an embodiment the computer program which when executed by a processor will cause the processor to operate a second camera to capture one or more images of the eye, after the spray nozzle has been aligned with the eye, and during when the processor initiates the eye drop sprayer device to spray fluid from the spray nozzle.

[0068] In an embodiment the the plurality of cameras comprise one or more of, a wide angle camera, a video camera for monitoring the eye image, a time of flight camera, an infrared camera.

[0069] In an embodiment the prompt is a prompt for the user to move the eyedrop assembly to the left or to the right.

[0070] In an embodiment the prompt is a prompt for the user to move the eyedrop assembly further away, or closer to the eye.

[0071] In an embodiment the prompt is a prompt for the user to rotate eyedrop assembly.

[0072] In an embodiment the prompt is a prompt for the user to adjust the tilt of eyedrop assembly.

[0073] In an embodiment the prompt is in the form of text displayed on a display screen of the portable electronic device.

[0074] In an embodiment the prompt comprises a haptic prompt.EYENEB-1-EP

[0075] In an embodiment the haptic prompt is a vibration of the portable electronic device.

[0076] In an embodiment the prompt comprises an audio prompt.

[0077] In an embodiment the computer program which when executed by a processor will cause the processor to further, detect if the eye drop sprayer device is correctly connected to the portable electronic device to form the eye drop assembly; and initiate a display of a first signal which indicates if the eye drop sprayer device is correctly connected to the portable electronic device, or, initiate the display of a second signal which indicates if the eye drop sprayer device is incorrectly connected to the portable electronic device.

[0078] In an embodiment the portable electronic device comprises a port and the eye drop sprayer device comprises a plug, and wherein the eye drop sprayer device connects to the portable electronic device by insertion of the plug into the port; wherein the computer program which when executed by a processor will cause the processor to further, detect if the plug of the eye drop sprayer device is correctly inserted into the port of the portable electronic device; and initiate a display of the first signal which indicates if the plug of the eye drop sprayer device is correctly inserted into the port of the portable electronic device, or, initiate the display of the second signal which indicates if the plug of the eye drop sprayer device is not correctly inserted into the port of the portable electronic device.

[0079] In an embodiment the computer program which when executed by a processor will cause the processor to initiate the portable electronic device to display the first signal, or, initiate the portable electronic device to display the second signal.

[0080] In an embodiment the first signal is a message displayed on a display screen of the portable electronic device indicating that the eye drop sprayer device is correctly connected to a port of the portable electronicEYENEB-1-EPdevice; the second signal is a message on the display screen of the portable electronic device indicating that the eye drop sprayer device is not correctly connected to a port of the portable electronic device.

[0081] In an embodiment the computer program which when executed by a processor will cause the processor to initiate the eye drop sprayer device to display the first signal, or, initiate the eye drop sprayer device to display the second signal.

[0082] In an embodiment the first signal is the activation of a first coloured light on eye drop sprayer device; the second signal is the activation of a second coloured light on eye drop sprayer device, wherein the first coloured light is a different colour to the second coloured light.

[0083] In an embodiment the fluid comprises a medication.

[0084] According to a further aspect of the present invention there is provided a portable electronic device having said computer program stored in a memory of the portable electronic device.Brief description of the drawings

[0085] Exemplary embodiments of the invention are disclosed in the present description, some with reference to the following drawings:Figure 1 illustrates a portable electronic device connected with an eye drop sprayer device which has a spray nozzle to form an eye drop assembly; and the eye drop assembly being positioned so that the spray nozzle is aligned with an eye of a user;Figure 2 shows a mesh model applied to the image captured by the camera of the portable electronic device, in order to identify the location of the eye in the captured image;EYENEB-1-EPFigure 3a shows an example of prompt for the user to move the eye drop assembly to the left; Figure 3b shows an example of prompt for the user to move the eye drop assembly to the right; and Figure 3c shows an example of message which can be displayed on the screen to inform the user that the spray nozzle is successfully aligned with the eye;Figure 4a shows an example of prompt for the user to move the eye drop assembly closer to the eye; Figure 4a shows an example of prompt for the user to move the eye drop assembly away from the eye;Figure 5 shows a first signal initiated by the computer program if the eye drop sprayer device is correctly connected the portable electronic device, and a second signal initiated by the computer program if the eye drop sprayer device is not correctly connected the portable electronic device.Detailed description of exemplary embodiments of the present invention

[0086] The following terms or expressions as used herein should normally be interpreted as outlined in this section, unless defined otherwise by the description or unless the specific context indicates or requires otherwise:

[0087] The words 'comprise', 'comprises' and 'comprising' and similar expressions are to be construed in an open and inclusive sense, as 'including, but not limited to' in this description and in the claims. In contrast to this, the terms "consist of", "consists of" and "consisting of" as used herein are so-called closed language meaning that only the mentioned components are present.EYENEB-1-EP

[0088] The terms 'a' or 'an' do not exclude a plurality; i.e. the singular forms 'a', 'an' and 'the' should be understood as to include plural referents unless the context clearly indicates or requires otherwise. In other words, all references to singular characteristics or limitations of the present disclosure shall include the corresponding plural characteristic or limitation, and vice versa, unless explicitly specified otherwise or clearly implied to the contrary by the context in which the reference is made. The terms 'a', 'an' and 'the' hence have the same meaning as 'at least one' or as 'one or more' unless defined otherwise.

[0089] The expressions, 'one embodiment', 'an embodiment', 'a specific embodiment' and the like mean that a particular feature, property or characteristic, or a particular group or combination of features, properties or characteristics, as referred to in combination with the respective expression, is present in at least one of the embodiments of the invention. The occurrence of these expressions in various places throughout this description do not necessarily refer to the same embodiment. Moreover, the particular features, properties or characteristics may be combined in any suitable manner in one or more embodiments.

[0090] According to a first aspect of the present invention there is provided a computer program for assisting a user to align the spray nozzle of an eye drop sprayer with an eye, stored on a portable electronic device, the portable electronic device having a processor and at least one camera, and wherein the portable electronic device can connect with an eye drop sprayer device which has a spray nozzle to form an eye drop assembly, wherein the portable electronic device and the eye drop sprayer device are in a predefined orientation with respect to one another when connected to form the eye drop assembly, and wherein the eye drop sprayer device is configured to receive a fluid, and wherein the computer program which when executed by a processor will cause the processor to, use an image captured by the camera of the portable electronic device, wherein at least a portion of the image depicts an eye, to determine the direction to move the eyedrop assembly so that the spray nozzle is aligned with said eye; prompt the user to move the eyedrop assembly in said determinedEYENEB-1-EPdirection. In an embodiment the processor receives the captured image from the camera.

[0091] It should be understood that any of the subsequently described features may be optional features of any of the above mentioned first, second and / or third aspects of the present disclosure. Even if a feature is described in the present disclosure as being a feature of an embodiment, it should be understood that that feature could be an optional feature of any of the other embodiment of the present invention. Any embodiment disclosed in the present disclosure may have any one or more of the features of any of the other embodiments disclosed in the present disclosure.

[0092] The fluid preferably comprises a liquid and / or a semi-solid formulation and / or a semi-solid mixture.

[0093] The term "fluid" as used herein is to be understood in a broad sense and means, unless otherwise stated, a fluid may be a liquid or liquid composition comprising a liquid vehicle or solvent and at least one further ingredient dissolved or dispersed (for example in the form of a suspension or colloidal dispersion). In some embodiments, the fluid may be a physiologically acceptable liquid, for example a cosmetically or pharmaceutically acceptable liquid, preferably a pharmaceutically acceptable liquid. In some embodiments, the fluid may be an aqueous liquid or liquid composition comprising at least one of an excipient and an active pharmaceutical ingredient, for example an ophthalmic active pharmaceutical ingredient. The term "excipient" as used herein means, unless otherwise stated, means a substance that is formulated alongside with an active pharmaceutical ingredient in a pharmaceutical composition and includes, for example, salts, preservatives, antioxidants, buffers or pH- modifiers, viscosity enhancers, tonicity modifiers, surfactants, adjuvants, colorants and others.EYENEB-1-EP

[0094] The term "active pharmaceutical ingredient" (API) as used herein means, unless otherwise stated, means a compound or combination of compounds which are pharmaceutically active against an undesired condition (of a subject). In particular embodiments, the fluid may be an ophthalmologically acceptable liquid for the (ophthalmic) application of the liquid to an ocular surface as discussed above. In particular embodiments, the fluid may be liquid to be applied to a body surface, specifically to an ocular surface of a subject is provided in sterilized form.

[0095] In some embodiments, the fluid or the active pharmaceutically ingredients optionally comprised by the fluid to be dispensed by the device according to the present invention are suitable for the prevention, delay or treatment of an ophthalmic disease or disorder and for the topical administration to the eye of a subject in need thereof.

[0096] In some embodiments, the fluid may comprise a physiologically or pharmaceutically acceptable solvent for topical application, for example water, alcohols, for example ethanol, 2-propanol (isopropanol), glycerol or benzyl alcohol, glycols, especially 1,2-propanediol (propylene glycol), polyethylene glycols, mineral oils, paraffins, isopropyl myristate, oleic acid and others. In further embodiments, the fluid may comprise an ophthalmologically acceptable solvent, for example water, ethanol, glycerol, 1,2-propanediol, propylene glycol, polyethylene glycol, mineral oils, flaxseed oil, castor oil or mixtures thereof (for example compositions sometimes referred to as "artificial tears" which may comprise a demulcent such as carboxymethylcellulose (CMC), hydroxypropyl methylcellulose (hypromellose), hydroxyethylcellulose, methylcellulose, dextran 70, gelatin, glycerol, polyethylene glycol (300, 400), polysorbate 80, polyvinyl alcohol and / or polyvinyl pyrrolidone (povidone)), either in the form of an aqueous mixture or solution or in non-aqueous form.

[0097] The eye as used herein preferably refers to an eye of human or animal, preferably a warm-blooded animal, especially to an eye of a human.EYENEB-1-EP

[0098] The term "portable electronic device" as used herein may also be understood in a broad sense and may mean, unless otherwise stated, any one of: a smartphone, or a tablet computer, or a (handheld) gaming console, or a basic phone, or a flip phone, or a slider phone, or a QWERTY phone, or a rugged phone, or a phablet, or a folding phone, or a netbook, or a laptop computer, or a digital media player, or a handheld personal computer, or a wearable computer, or a smartwatch and others, preferably a smartphone or a tablet computer, especially a smartphone.

[0099] The eye drop sprayer may take any suitable form. The eye drop sprayer may be any device which can dispense a fluid; the fluid may be a liquid or a semi-solid formulation / mixture. The eye drop sprayer may be configured to dispense the fluid in the form of coarse-droplets, and / or may be configured to dispense the fluid in the form of fine droplets (in the form of a mist, for example) such as, for example, a fine droplet micro-mist sprayer, and / or may be configured to dispense the fluid in the form of a liquid stream (e.g. a fine liquid stream) of a predefined volume. In a preferred embodiment the eye drop sprayer may be configured to dispense a volume of fluid in the range 1 - 50 mcl, more preferably in the range 5-25 mcl, most preferably in the range10-20 mcl. The eye drop sprayer may be configured to dispense fluid by any suitable means; for example, the eye drop sprayer may be configured to dispense fluid by mechanical means and / or electro-mechanical means.

[0100] The spray nozzle of an eye drop sprayer may take any suitable form. For example, the spray nozzle may be a tip, a simple opening, a functional structure, or an exit valve port. For example, the spray nozzle may be a frustoconical member, or conical member, with a central opening through which fluid can be dispensed. In an embodiment the spray nozzle may comprise an electromechanical element (such as, for example, a vibrating mesh, and / or an ultrasonic spray system, and / or an electrospray system). In an embodiment the spray nozzle may comprise a mechanical system which comprises a single-exit nozzle or multi-exit nozzle (e.g. Raleigh principle). In an embodiment the spray nozzle may comprise nozzles with collision properties (such as impinging or baffle). In anEYENEB-1-EPembodiment the spray nozzle may comprise multi-compound nozzles (e.g. a nozzle with an exit from which liquid is dispensed and another exit from which gas is dispensed, wherein the gas may be used to support delivery / distance / spray performance).

[0101] Figure 1 provides a perspective view of an eye drop assembly 1. The eye drop assembly 1 comprises an eye drop sprayer device 2 which has a spray nozzle 3 the eye drop sprayer device 2 is connected to a portable electronic device 4. It should be understood that the eye drop sprayer device 2 and the portable electronic device 4 are detachably connected to one another; in other words the portable electronic device 4 and the eye drop sprayer device 2 can be selectively connected or disconnected from one another.

[0102] The portable electronic device 4 comprises at least one camera 5a, 5b, a processor 6, and a memory 7. Preferably, and as it the case in the example shown in Figure 1, the portable electronic device 4 comprises at least two cameras 5a, 5b; specifically, in the example shown in Figure 1 the portable electronic device 4 comprises a first camera 5a facing in a first direction, and a second camera 5b facing in a second, opposite, direction. More specifically, the portable electronic device 4 comprises a front-facing camera 5a and a rear-facing camera 5b. The processor 6 is preferably operably connected to the at least one camera 5a, 5b and to the memory 7. In the present embodiment the processor 6 is operably connected to the first camera 5a, the second camera 5b, and to the memory 7.

[0103] The portable electronic device 4 further comprises a display screen 8. The display screen 8 is configured to be also a touchscreen 8 (i.e. is configured to have touchscreen functionality). In the present application the term "display screen 8" and "touchscreen 8" are used interchangeably since they refer to the same part of the portable electronic device 4. Images captured by the front-facing camera 5a and / or rear-facing camera 5b of the portable electronic device 4 are displayed on the display screen 8.EYENEB-1-EP

[0104] It should be noted that the first camera 5a (front-facing camera 5a) is facing in the same direction as the direction which the display screen 8 is facing. The second camera 5b (rear-facing camera 5b) is facing in a direction which is opposite to the direction which the display screen 8 is facing. In other words the "first direction" in which the first camera 5a (front-facing camera 5a) is facing, is defined as the direction which the display screen 8 is facing, and the "second direction" in which the second camera 5b (rear-facing camera 5b) is facing is define as the direction which is opposite to the direction which the display screen 8 is facing. In the present application the first camera 5a will be referred to hereafter as the front-facing camera 5a and the second camera 5b will be referred to hereafter as the rear-facing camera 5b.

[0105] The front-facing camera 5a and rear-facing camera 5b, may take any suitable form. The front-facing camera 5a and rear-facing camera 5b may be the same type of cameras or different type of cameras; in other words the front-facing camera 5a may be a first type of camera and the rear-facing camera 5b may be a second type of camera different to the first type. The front-facing camera 5a may comprise a wide angle camera, or narrow angle camera, or a video camera, or a time of flight camera, or an infrared camera. The rear-facing camera 5b may comprise a wide angle camera, or narrow angle camera, or a video camera, or a time of flight camera, or an infrared camera.

[0106] As an alternative to the portable electronic device 4 having two cameras 5a, 5b, i.e. as an alternative to the portable electronic device 4 having a separate front-facing camera 5a and the rear-facing camera 5b, the portable electronic device 4 may comprise a single camera which is selectively configurable to face in the first direction or face in the second direction. In other words, alternatively the portable electronic device 4 may comprise a single camera which is selectively configurable to be a frontfacing camera or a rear-facing camera.EYENEB-1-EPT1

[0107] The portable electronic device 4 may comprise a plurality of cameras. The portable electronic device 4 may further comprise one or more additional cameras, in addition to the front-facing camera 5a and the rear-facing camera 5b. For example, the portable electronic device 4 may further comprise a time-of-flight camera. The portable electronic device 4 may comprise and one or more of: a wide angle camera, a video camera, a time of flight camera, an infrared camera.

[0108] In the example shown in Figure 1 the portable electronic device 4 is a smartphone 4. However, it should be understood that the portable electronic device 4 is not limited to being a smartphone, may take any suitable form, such as: a smartphone, or a tablet computer, or a (handheld) gaming console, or a basic phone, or a flip phone, or a slider phone, or a QWERTY phone, or a rugged phone, or a phablet, or a folding phone, or a netbook, or a laptop computer, or a digital media player, or a handheld personal computer, or a wearable computer, or a smartwatch and others, preferably a smartphone or a tablet computer, especially a smartphone.

[0109] The eye drop sprayer device 2 is configured such that it can store the fluid which is to be sprayed in the eye. For example, the eye drop sprayer device 2 may comprise a disposable cartridge comprising the fluid; the cartridge may be inserted into the eye drop sprayer device 2 and arranged to be selectively fluidly connected to the spray nozzle 3. When a disposable cartridge is empty the empty cartridge can be removed from the eye drop sprayer device 2 and replaced with another, new, disposable cartridge that is filled with the fluid, thereby allowing the eye drop sprayer device 2 to be reused. In another embodiment the cartridge is fixed in the eye drop sprayer device 2 and can be refilled.

[0110] The eye drop sprayer device 2 further comprises a stylus 9 which has a tip 9a. The stylus 9, or more specifically the tip 9a of the stylus 9, and the spray nozzle 3 are in a fixed predefined location relative to one another.EYENEB-1-EP

[0111] It should be understood that the eye drop sprayer device 2 can be selectively connected to the portable electronic device 4 in a first predefined configuration or in a second predefined configuration.

[0112] In the first predefined configuration the eye drop sprayer device2 is connected to the portable electronic device 4 such that the spray nozzle3 is pointing in the same direction as the direction which the display screen 8 is facing. In an embodiment, in the first predefined configuration the eye drop sprayer device 2 is connected to the portable electronic device 4 such that the spray nozzle 3 is pointing in the same direction as the direction which the front-facing camera 5a is facing (i.e. the spray nozzle 3 is facing in the first direction). In other words when the eye drop sprayer device 2 is connected to the portable electronic device 4 in the first predefined configuration the direction of spray of the spray nozzle 3 is in the first direction. Figure 1 shows the eye drop sprayer device 2 connected to the portable electronic device 4 in the first predefined configuration.

[0113] In the second predefined configuration the eye drop sprayer device 2 is connected to the portable electronic device 4 such that the spray nozzle 3 is pointing in the opposite direction to the direction which the display screen 8 is facing. In an embodiment, in the second predefined configuration the eye drop sprayer device 2 is connected to the portable electronic device 4 such that the spray nozzle 3 is pointing in the same direction as the direction which the rear-facing camera 5a is facing (i.e. the spray nozzle 3 is facing in the second direction). In other words when the eye drop sprayer device 2 is connected to the portable electronic device 4 in the second predefined configuration the direction of spray of the spray nozzle 3 is in the second direction.

[0114] The eye drop sprayer device 2 is configured so that when the portable electronic device 4 is connected to the eye drop sprayer device 2 in a first predefined configuration, the tip 9a of the stylus 9 will contact the touchscreen 8 of the portable electronic device 4.EYENEB-1-EP

[0115] When the portable electronic device 4 and the eye drop sprayer device 2 are correctly connected to form the eye drop assembly 1 then the portable electronic device 4 and the eye drop sprayer device 2 will preferably be in a predefined orientation with respect to one another. Preferably, when the portable electronic device 4 and the eye drop sprayer device 2 are connected to form the eye drop assembly 1 then the eye drop sprayer device 2 will be connected, preferably mechanically and electrically connected, to the portable electronic device 4. In the example shown in Figure 1, the portable electronic device 4 comprises a port 22, which is an electrical port; the eye drop sprayer device 2 comprises a plug member 31 which can be selectively inserted into the port 22 of the portable electronic device 4 so that the portable electronic device 4 and eye drop sprayer device 2 are connected to form the eye drop assembly 1. The portable electronic device 4 has its own power source 30 (such as a battery 30). In the present example once the plug member 31 of eye drop sprayer device 2 has been selectively inserted into the port 22 of the portable electronic device 4, the eye drop sprayer device 2 and portable electronic device 4 will be electrically connected to one another, and portable electronic device 4 will provide power to the eye drop sprayer device 2 via this electrical connection. In other words, in the present example the eye drop sprayer device 2 does not need it's own power supply, rather the eye drop sprayer device 2 is powered by the power source (e.g. battery) of the portable electronic device 4. In another embodiment the eye drop sprayer device 2 may comprise its own power source. In another embodiment the connection between the eye drop sprayer device 2 and the portable electronic device 4 will be only a mechanical connection. In another embodiment the connection between the eye drop sprayer device 2 and the portable electronic device 4 will only be an electrical connection which electrically connects the eye drop sprayer device 2 to the power source of the portable electronic device 4, so that the connection only provides that eye drop sprayer device 2 is powered by the power source of the portable electronic device 4. In another embodiment the connection between the eye drop sprayer device 2 and the portable electronic device 4 will only be a communication connection (wired, or wireless connection) which allows the eye drop sprayer device 2 to communicate with (e.g. send and receiveEYENEB-1-EPdata / information / signals to and from) the portable electronic device 4. In an embodiment the eye drop sprayer device 2 will connect, preferably mechanically and electrically, to a USB port, or lighting port, of the portable electronic device 4. In any of the afore-mentioned embodiments wherein the eye drop sprayer device 2 is electrically connected to the portable electronic device 4, data / information / signals can be communicated between the eye drop sprayer device 2 and the portable electronic device 4 (e.g. between the eye drop sprayer device 2 and the processor 6 of the portable electronic device 4) via the electrical connection. In another embodiment the eye drop sprayer device 2 will mechanically connect to the portable electronic device 4, but not electrically connect to the portable electronic device 4; in this embodiment the eye drop sprayer device 2 may be wirelessly connected to the portable electronic device 4 and communication between the eye drop sprayer device 2 and portable electronic device 4 may take place over that wireless connection. It should be understood that the eye drop sprayer device 2 may mechanically connect to the portable electronic device 4 using any suitable means, for example the eye drop sprayer device 2 may comprise a non-conducting plug member (or conducting plug member) which can be received into a port of the portable electronic device 4, to mechanically connect the eye drop sprayer device 2 to the portable electronic device 4.

[0116] In the present example the memory 7 of the portable electronic device 4 has stored therein a computer program according to an embodiment of the present invention; said computer program can be executed by the processor 6. The computer program when executed by a processor will cause the processor to, receive an image captured by the front-facing camera 5a and / or rear-facing camera 5b of the portable electronic device 4, wherein at least a portion of the image depicts an eye; and use the image to determine the direction to move the eyedrop assembly 1 so that the spray nozzle 3 is aligned with said eye; and prompt the user to move the eyedrop assembly 1 in said determined direction. One or more prompts may be provided.EYENEB-1-EP

[0117] During use the user 10 will connect the portable electronic device 4 to the eye drop sprayer device 2 in the first predefined configuration, as shown in Figure 1, such that the spray nozzle 3 is pointing in the same direction as the direction which the front-facing camera 5a is facing (i.e. the spray nozzle 3 is facing in the first direction). Once connected in the first predefined configuration the tip 9a of the stylus 9 will contact the touchscreen 8 of the portable electronic device 4.

[0118] In this particular example the user 10 wishes to administer the fluid in the eye drop sprayer device 2 to their own eye 11. The computer program of the present invention can be used to assist the user 10 to align the spray nozzle 3 of an eye drop sprayer 2 with their own eye 11. When using the eye drop assembly 1 to administer the fluid in the eye drop sprayer device 2 to their own eye 11 the portable electronic device 4 should be connected to the eye drop sprayer device 2 in the first predefined configuration, as shown in Figure 1. However, as will be described in a further embodiment later, the computer program of the present invention can also be used to assist the user 10 to align the spray nozzle 3 of an eye drop sprayer 2 with an eye belonging to a third party (such as the eye of another person (e.g. the eye of a patient, or the eye of an animal).

[0119] In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to detect if the eye drop sprayer device 2 is correctly connected to the portable electronic device 4; and initiate a display of a first signal which indicates if the eye drop sprayer device 2 is correctly connected the portable electronic device 4, and, initiate the display of a second signal which indicates if the eye drop sprayer device 2 is incorrectly connected to the portable electronic device 4. In one embodiment the computer program which when executed by a processor 6 will cause the processor 6 to detect if the eye drop sprayer device 2 is correctly connected to the port 22 of the portable electronic device 4; and initiate a display of a first signal which indicates if the eye drop sprayer device 2 is correctly connected to the port 22, and, initiate the display of a second signal which indicates if the eye drop sprayer device 2 is incorrectly connected to a port of the portable electronic device 4. In the presentEYENEB-1-EPapplication "correctly connected" means connected in a predefined manner; preferably, when the plug 31 of the eye drop sprayer device 2 is in a predefined position in the port 22 of the portable electronic device 4 (i.e. when the plug 31 is correctly inserted into the port 22) then eye drop sprayer device 2 is "correctly connected" to the portable electronic device 4.

[0120] In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to initiate the portable electronic device 4 to display the first signal, and, initiate the portable electronic device 4 to display the second signal. For example the first signal may be a message (in the form of text for example) displayed on a display screen 8 of the portable electronic device 4 indicating that the eye drop sprayer device 2 is correctly connected to a port 22 of the portable electronic device 4; and the second signal may be a message (in the form of text for example) on the display screen 8 of the portable electronic device 4 indicating that the eye drop sprayer device 2 is not correctly connected to a port 22 of the portable electronic device 4. In another embodiment the computer program which when executed by a processor will cause the processor 6 to initiate the eye drop sprayer device 2 to display the first signal, and, initiate the eye drop sprayer device 2 to display the second signal. For example the first signal may be the activation of a first coloured light on eye drop sprayer device 2; and the second signal may be the activation of a second coloured light on eye drop sprayer device 2, wherein the first coloured light is a different colour to the second coloured light.

[0121] Figure 5 illustrates an embodiment wherein the computer program which when executed by a processor 6 will cause the processor 6 to initiate both the portable electronic device 4 and eye drop sprayer device 2 to each display a respective first signal if the eye drop sprayer device 2 is correctly connected the portable electronic device 4, and, to initiate both the portable electronic device 4 and eye drop sprayer device 2 to each display a respective second signal if the eye drop sprayer device 2 is not correctly connected the portable electronic device 4.EYENEB-1-EP

[0122] Specifically, in the example shown in Figure 5 the computer program which when executed by a processor 6 will cause the processor 6 to further, detect if the plug 31 of eye drop sprayer device 2 is correctly connected to the port 22 of the portable electronic device 4 (e.g. detect if the plug 31 is in a predefined position in the port 22); and initiate the portable electronic device 4 to display a first signal in the form of text "Connected Successfully" 25 on the display screen 8 and initiate the eye drop sprayer device 2 to display a first signal in the form of the activation of a first coloured light 24 (e.g. 'green' light) on eye drop sprayer device 2, if the plug 31 is correctly connected to the port 22 (e.g. if the plug 31 is in said predefined position in the port 22). The computer program which when executed by a processor 6 will cause the processor 6 to further initiate the portable electronic device 4 to display a second signal in the form of text "Connected Unsuccessfully" 27 on the display screen 8 and initiate the eye drop sprayer device 2 to display a second signal in the form of the activation of a second coloured light 26 (e.g. 'orange' light) on eye drop sprayer device 2, if the plug 31 is not correctly connected to the port 22 (e.g. if the plug 31 is not in said predefined position in the port 22).

[0123] Referring back to Figure 1, since in this particular example the user 10 wishes to administer the fluid in the eye drop sprayer device 2 to their own eye 11, after the eye drop sprayer device 2 has been correctly connected to the portable electronic device 4 in the first predefined configuration, the user arranges the eye drop assembly 1 so that the frontfacing camera 5a is facing towards their face, as shown in Figure 1. In this position since the eye drop sprayer device 2 and portable electronic device 4 are connected in the first predefined configuration, the spray nozzle 3 will be pointing towards the user 10.

[0124] The front-facing camera 5a of the portable electronic device 4 is then operated to capture an image (or a plurality of images e.g. video) wherein at least a portion of the captured image (or a plurality of images e.g. video) depicts the eye 11 of the user 10. In a preferred embodiment the front-facing camera 5a of the portable electronic device 4 is operated to capture a plurality of images (such as a video (i.e. a stream of images)) eachEYENEB-1-EPof which depicts the eye of the user. The innage, or plurality of innages (e.g. video), captured by the front-facing camera 5a are displayed on the display screen 8 of the portable electronic device 4 so that they are visible to the user.

[0125] In a first embodiment, the computer program which when executed by a processor 6 will cause the processor 6 to, use the image (or plurality of images (e.g. video)) captured by the front-facing camera 5a, to determine the position of the front-facing camera 5a relative to the eye 11 of the user 10; and use the determined position of the front-facing camera 5a relative to the eye 11 to determine the direction to move the eyedrop assembly 1 so that the spray nozzle 3 is aligned with the eye. The image (or plurality of images (e.g. video)), captured by the front-facing camera 5a, depict the user's eye.

[0126] As mentioned, the tip 9a of the stylus 9 contacts the touchscreen of the portable electronic device 4 when the portable electronic device 4 and the eye drop sprayer device 2 are connected in the first predefined configuration; and the position of the tip 9a of the stylus 9a is fixed relative to the sprayer nozzle 3. Preferably, in the first embodiment, the memory 7 of the portable electronic device 4 has stored therein the predefined fixed location of the tip 9a of the stylus 9a relative to the sprayer nozzle 3, and the computer program when executed by a processor 6 will preferably cause the processor 6 to,(a) receive, as an input, the location on the touchscreen 8 where the tip 9a of the stylus 9 contacts the touchscreen 8;(b) determine first position data, which is the position of the tip 9a of the stylus 9 relative to the front-facing camera 5a, using said received input;(c) retrieve from the memory 7 of the portable electronic device 4 the predefined fixed location of the tip 9a of the stylus 9 relative to the sprayer nozzle 9;(d) determine second position data, which is the position of the sprayer nozzle 3 relative to the front-facing camera 5a, using the first position data and said retrieved predefined fixed location of the tip 9a ofEYENEB-1-EPthe stylus 9 relative to the sprayer nozzle 3;(e) use the second position data to determine a reference position, wherein the reference position is a relative position of frontfacing camera 5a relative to the eye 11 at which the sprayer nozzle 3 would be aligned with the eye 11 ;(f) determine third position data using the image (or plurality of images (e.g. video)) captured by the front-facing camera 5a, wherein the third position data is the position of the front-facing camera 5a relative to the eye 11 ;(g) compare said third position data to said reference position to determine the direction to move the eyedrop assembly 1 so that the frontfacing camera 5a is brought to the reference position at which the spray nozzle 3 is aligned with the eye 11.

[0127] Preferably, in the first embodiment, the computer program which when executed by a processor 6 will further cause the processor 6 to, prompt the user to move the eyedrop assembly 1 in said determined direction so that the user 10 knows in which direction they should move the eye drop assembly 1 in order to bring the spray nozzle 3 into alignment with said eye 11.

[0128] Preferably, in the first embodiment the computer program when executed by a processor 6 will cause the processor 6 to detect when the spray nozzle 3 is aligned with the eye 11. Preferably, in the first embodiment the computer program when executed by a processor 6 will cause the processor 6 to detect when the front-facing camera 5a has been brought to the reference position. By detecting when the front-facing camera 5a has been brought to the reference position the processor 6 detects if / when the spray nozzle 3 has been brought into alignment with the eye 11. Preferably, the computer program when executed by a processor 6 will cause the processor 6 to repeat at least the above- mentioned series of steps (f)-(g) until processor 6 to detects when the spray nozzle 3 has been brought into alignment with the eye 11 (i.e. until the processor 6 detects that the front-facing camera 5a has been brought to the reference position).EYENEB-1-EP

[0129] Preferably, the computer program which when executed by a processor 6 will cause the processor 6 to further initiate the eye drop sprayer device 2 to spray fluid from the spray nozzle 3 when the spray nozzle 3 is aligned with the eye 11. As a result, the fluid will be administered to the eye 11 of the user 10 at the moment when the spray nozzle 3 is aligned with the eye 11. Preferably, the computer program which when executed by a processor 6 will cause the processor 6 to further detect using an image (or plurality of images e.g. video) captured by the front-facing camera 5a, when the spray nozzle 3 is aligned with the eye 11. In the present embodiment the computer program when executed by a processor 6 will cause the processor 6 to detect when the front-facing camera 5a has been brought to the reference position. By detecting when the front-facing camera 5a has been brought to the reference position the processor 6 detects if / when the spray nozzle 3 has been brought into alignment with the eye 11 of the user 10. In response to detecting that the front-facing camera 5a has been brought to the reference position the processor 6 initiates the eye drop sprayer device 2 to spray fluid from the spray nozzle 3.

[0130] Preferably, in the first embodiment, the computer program when executed by a processor 6 will cause the processor 6 to, determine the third position data, which is the position of the front-facing camera 5a relative to the eye 11 by processing the image (or plurality of images (e.g. video)) captured by the front-facing camera 5a. The image (or plurality of images (e.g. video)) captured by the front-facing camera 5a may be processed using image processing techniques known in the art, to determine the third position data. For example, as shown in Figure 2, in an embodiment, in order to identify the location of the eye 11 of the user 10 in the image (or plurality of images (e.g. video)) captured by the front-facing camera 5a, the computer program which when executed by a processor 6 will cause the processor 6 to: (a) apply a mesh model 35 to the image captured 36 by the front-facing camera 5a; (b) use the mesh model 35 to determine the location of the depiction of the eye 11' of the user 10' in the captured image 36; (c) use the determined location of the depiction of the eye 11' in the captured image 36, to determine the position of the front-facingEYENEB-1-EPcamera 5a relative to the eye 10 of the user 10. Preferably, for step (c), the computer program when executed by a processor 6 will cause the processor 6 to receive images of the user's face captured by the front facing camera 5a; and uses a predefined distance value, which represent a predefined distance (preferably a predefined horizontal distance) between the user's eyes, to calculate the position of the front facing camera 5a relative to the user's eye. The predefined distance value which represents a predefined distance (preferably a predefined horizontal distance) between the user's eyes, is used by the processor 6 as a reference scale to allow the processor to determine distances between features depicted in the images captured by the front-facing camera, and thus allow the processor to determine the position of the front-facing camera 5a relative to the eye 10 of the user 10 from said images.

[0131] In an embodiment the computer program when executed by a processor 6 will cause the processor 6 determine the third position data by, receiving images of the user's face captured by the front facing camera 5a; and using a predefined distance value, which represent a predefined distance (preferably a predefined horizontal distance) between the user's eyes, as a reference scale to allow the processor to determine, from the images captured by the front-facing camera 5a, the position of the frontfacing camera 5a relative to the eye 10 of the user 10. In this embodiment the distance between the user's eyes is assumed to be a fixed constant for all users (i.e. the predefined distance value (preferably a predefined horizontal distance) between the eyes is the same fixed, predefined, constant which is used by the processor as a reference scale, for all users); in other words, in an embodiment, once the first predefined distance has been determined, it does not need to be determined again because the computer program uses the same predefined distance value for all users. The predefined distance value may be determined by determining the distance between mesh vertices applied to the eyes of the user depicted in images of the user's face captured by the front facing camera 5a. The predefined distance value may be previously established based on, for example, human morphological studies.EYENEB-1-EP

[0132] In an embodiment the computer program when executed by a processor 6 will cause the processor 6 to calculate at least a second predefined distance value (e.g. the diameter of the iris of the eye). The second predefined distance value (e.g. the diameter of the iris of the eye can be used as a reference scale (i.e. to allow distance calibration) even in the event that the images captured by the front facing camera depict only a single eye of the user. Preferably, the computer program when executed by a processor 6 will cause the processor 6 to calculate at least a second predefined distance value (e.g. the diameter of the iris of the eye) from images which depict the two eyes so that the first predefined distance value (i.e. predefined horizontal distance between the user's eyes) can be applied as a reference scale when determining second predefined distance value. The second predefined distance value is assumed to be a fixed constant among all users; in other words the second predefined distance value is the same fixed, predefined, constant which is used by the processor as a reference scale, for all users. If the second predefined distance value is, for example, the diameter of the iris of the eye, then the second predefined distance value may be used by the processor 6 as a reference scale to allow the processor 6 to determine, the position of the front-facing camera 5a relative to the eye 10 of the user 10, from the images which depict only one single of the user. The second predefined distance value (e.g. the diameter of the iris of the eye), is used by the processor 6 as a reference scale to allow the processor to determine distances between features depicted in the images captured by the front-facing camera 5a, and thus allows the processor 6 to determine the position of the frontfacing camera 5a relative to the eye 10 of the user 10 from said images.

[0133] The first predefined distance value (which in this example is the predefined horizontal distance between the eyes) can be used by the processor 6 as a first reference scale to determine the position of the frontfacing camera 5a relative to the eye 10 of the user 10, from images which depict both eyes of the user processor 6; and the second predefined distance value (which in this example is the diameter of the iris of the eye) can be used by the processor 6 as a second reference scale to allow the processor to determine, from images captured by the front-facing cameraEYENEB-1-EP5a which depict only single eye of the user, the position of the front-facing camera 5a relative to the eye 10 of the user 10. Most preferably, the second predefined distance value is determined from an image which the first predefined distance value can be used as a reference scale (i.e. the processor 6 determines the second predefined distance value from an image which depict both eyes of the user so that the horizontal distance between the eyes is measurable from that image; the first predefined distance value (e.g. the predefined horizontal distance between the eyes) is then used as a reference scale to allow the second predefined distance value (e.g. the diameter of the iris) to be determined from that image.

[0134] The second predefined distance value is the same fixed, predefined, constant which is used by the processor as a reference scale, for all users; in other words, in an embodiment once the second predefined distance has been determined, it does not need to be determined again since the computer program uses the same second predefined distance value for all users.

[0135] It should be understood that any number of different predefined reference values may be determined. In a further embodiment, the software may use other predefined distance values as a reference scale, for example in another embodiment the triangular distance between both eyes and mouth is used by the processor 6 as a reference scale when processing the images captured by the front facing camera 5a to determine the position of the front facing camera 5a relative to the eye belonging to the third party. In another embodiment the portable electronic device may further comprise a calibration gauge.

[0136] In a further embodiment the computer program when executed by a processor 6 will cause the processor 6 to use qualitative distance measurement methods to determine, from the images captured by the front-facing camera 5a, the position of the front-facing camera 5a relative to the eye 10 of the user 10. For example, the computer program when executed by a processor 6 will cause the processor 6 to detect the user's eyeEYENEB-1-EPin an image captured by the front-facing camera 5a; and create a mesh over the detected eye in the image. The computer program when executed by a processor 6 will cause the processor 6 to determine (e.g. count) the number pixels within the mesh (i.e. determine (e.g. count) the number of pixels which make up the depiction of the eye in the image). The number of pixels defines an eye surface area. The computer program when executed by a processor 6 will cause the processor 6 determine the position of the front-facing camera 5a relative to the eye 10 of the user 10 using the determined eye surface area. At a predefined eye surface area, the spray device would deliver the fluid to the eye. Preferably, users with smaller eyes should place the sprayer device closer to their eye to deliver the fluid; users with larger eyes would benefit from placing the sprayer device further from their eye.

[0137] In an embodiment a stylus 9 with a tip 9a is not provided on the eye drop sprayer device 2 (or are provided but are not user). In this embodiment the above-mentioned steps (a)-(c) may be omitted. The computer program when executed by a processor 6 will preferably cause the processor 6 determine the second position data, using predefined dimensions of the portable electronic device 4 which are stored in a memory which is assessable to the processor 6. For example, in an embodiment the spray nozzle 3 will have a predefined position relative to the front-facing camera 5a when the eye drop sprayer device 2 is connected in the first predefined configuration; this predefined position of the spray nozzle 3 relative to the front-facing camera 5a, is stored in a memory, and the computer program when executed by a processor 6 will preferably cause the processor 6 retrieve from the memory the predefined position, wherein the retrieve predefined position defines the second position data. The computer program when executed by a processor 6 will preferably then cause the processor 6 to carry out said steps (e) and (g) above using the retrieved predefined position.

[0138] In yet another embodiment steps (a)-(e) are omitted; in this embodiment a predefined reference position, which is a relative position of front-facing camera 5a relative to the eye 11 at which the sprayer nozzle 3EYENEB-1-EPwould be aligned with the eye 11, is stored in a memory; the computer program when executed by a processor 6 will preferably cause the processor 6 retrieve from the memory the predefined reference position. The computer program when executed by a processor 6 will then cause the processor 6 to carry out said steps (f) and (g) above using the retrieved predefined reference position.

[0139] In a second embodiment the computer program which when executed by a processor will cause the processor to, use image (or plurality of images (e.g. video)), captured by the front-facing camera 5a, to determine the position of the spray nozzle 3 relative to the eye 11 of the user 10; and use the determined position of the spray nozzle 3 relative to the eye 11 to determine the direction to move the eyedrop assembly 1 so that the spray nozzle 3 is aligned with the eye. The image (or plurality of images (e.g. video)), captured by the front-facing camera 5a, depict the user's eye.

[0140] As mentioned, the tip 9a of the stylus 9 contacts the touchscreen of the portable electronic device 4 when the portable electronic device 4 and the eye drop sprayer device 2 are connected in the first predefined configuration; and the position of the tip 9a of the stylus 9a is fixed relative to the sprayer nozzle 3. Preferably, in the second embodiment, the memory 7 of the portable electronic device 4 has stored therein the predefined fixed location of the tip 9a of the stylus 9a relative to the sprayer nozzle 3, and preferably the computer program which when executed by a processor 6 will preferably cause the processor 6 to,(a) receive, as an input, the location on the touchscreen 8 where the tip 9a of the stylus 9 contacts the touchscreen 8;,(b) determine first position data, which is the position of the tip 9a of the stylus 9 relative to the front-facing camera 5a, using said received input;(c) retrieve from the memory 7 of the portable electronic device 4 the predefined fixed location of the tip 9a of the stylus 9 relative to the sprayer nozzle 9;(d) determine second position data, which is the position of theEYENEB-1-EPsprayer nozzle 3 relative to the front-facing camera 5a, using the first position data and said retrieved predefined fixed location of the tip 9a of the stylus 9 relative to the sprayer nozzle 3;(e) determine third position data, using the image (or plurality of images (e.g. video)) captured by the front-facing camera 5a, wherein the third position data is the position of the front-facing camera 5a relative to the eye 11; and(f)determine fourth position data, which is the position of the sprayer nozzle 3 relative to the eye 11, using the second position data and third position data;(g) use said determined position of the sprayer nozzle 3 relative to the eye 11 to determine the direction to move the eyedrop assembly 1 so that the spray nozzle 3 is aligned with said eye 11.

[0141] Preferably, in the second the embodiment the computer program which when executed by a processor 6 will further cause the processor 6 to, prompt the user to move the eyedrop assembly 1 in said determined direction so that the user 10 knows in which direction they should move the eye drop assembly 1 in order to bring the spray nozzle 3 into alignment with said eye 11.

[0142] Preferably, in the second embodiment the computer program when executed by a processor 6 will cause the processor 6 to detect if / when the spray nozzle 3 has been brought into alignment with the eye 11. For example the computer program when executed by a processor 6 will cause the processor 6 to detect if / when the spray nozzle 3 has been brought into alignment with the eye 11, using the second position data and third position data (wherein in the second embodiment the second position data is the position of the sprayer nozzle 3 relative to the front-facing camera 5a; and the third position data is the position of the front-facing camera 5a relative to the eye 11). Preferably the computer program when executed by a processor 6 will cause the processor 6 to repeat at least the above- mentioned series of steps (e)-(g) until processor 6 to detects when the spray nozzle 3 has been brought into alignment with the eye 11.EYENEB-1-EP

[0143] Preferably the computer program which when executed by a processor 6 will cause the processor 6 to further initiate the eye drop sprayer device 2 to spray fluid from the spray nozzle 3 when the spray nozzle 3 is aligned with the eye 11. As a result, the fluid will be administered to the eye 11 of the user 10 at the moment when the spray nozzle 3 is aligned with the eye 11. Preferably, the computer program which when executed by a processor 6 will cause the processor 6 to further detect using an image (or plurality of images e.g. video) captured by the front-facing camera 5a, when the spray nozzle 3 is aligned with the eye 11. Preferably, in this second embodiment the computer program when executed by a processor 6 will cause the processor 6 to detect if / when the spray nozzle 3 has been brought into alignment with the eye 11, using the second position data and third position data (wherein in the present embodiment the second position data is the position of the sprayer nozzle 3 relative to the front-facing camera 5a; and the third position data is the position of the front-facing camera 5a relative to the eye 11). In response to detecting that the spray nozzle 3 has been brought into alignment with the eye 11, the processor 6 initiates the eye drop sprayer device 2 to spray fluid from the spray nozzle 3.

[0144] In an embodiment a stylus 9 with a tip 9a is not provide on the eye drop sprayer device 2 (or is provided but is not used). In this embodiment the above-mentioned steps (a)-(c) are omitted. The computer program when executed by a processor 6 will preferably cause the processor 6 determine the second position data, using predefined dimensions of the portable electronic device 4. For example, in an embodiment the spray nozzle 3 will have a predefined position relative to the front-facing camera 5a when the eye drop sprayer device 2 is connected to the portable electronic device 4 in the first predefined configuration; this predefined position is stored in a memory, and the computer program when executed by a processor 6 will preferably cause the processor 6 retrieve from the memory the predefined position, wherein the retrieved predefined position defines the second position data (wherein the second position data is the position of the sprayer nozzle 3 relative to the frontfacing camera 5a). The computer program when executed by a processor 6EYENEB-1-EPwill preferably then cause the processor 6 to carry out said steps (e) and (g) above.

[0145] The computer program of the present invention can also be used to assist a user to align the spray nozzle 3 of an eye drop sprayer 2 with an eye belonging to a third party (such as an eye of a patient or animal) so that the fluid in the eye drop sprayer device 2 can be administered to the eye belonging to a third party. In such a case then the user will first connect the eye drop sprayer device 2 and portable electronic device 4 in the first predefined configuration.

[0146] As mentioned the tip 9a of the stylus 9 contacts the touchscreen of the portable electronic device 4 when the portable electronic device 4 and the eye drop sprayer device 2 are connected in the first predefined configuration; and the position of the tip 9a of the stylus 9a is fixed relative to the sprayer nozzle 3. In this embodiment, the memory 7 of the portable electronic device 4 has stored therein the predefined fixed location of the tip 9a of the stylus 9a relative to the sprayer nozzle 3, and the computer program when executed by a processor 6 will cause the processor 6 to,(a) receive, as an input, the location on the touchscreen 8 where the tip 9a of the stylus 9 contacts the touchscreen 8;(b) retrieve from the memory 7 of the portable electronic device 4 the predefined fixed location of the tip 9a of the stylus 9 relative to the sprayer nozzle 9;(d) determine first position data, using the input and said retrieved predefined fixed location of the tip 9a of the stylus 9 relative to the sprayer nozzle 3, wherein the first position data is the position the sprayer nozzle 3 will have relative to the rear-facing camera 5b if the eye drop sprayer device 2 and portable electronic device 4 are connect in the second predefined configuration.

[0147] The location of the tip 9a of the stylus 9 relative to the sprayer nozzle input processor 6 is fixed and the location of the rear-facing camera 5b in the portable electronic device 4 is fixed. The processor 6 will know theEYENEB-1-EPposition of the rear-facing camera 5b in the portable electronic device 4; at least such information stored in the memory and will be retrievable by the processor 6. In an exemplary embodiment the computer program when executed by a processor 6 will cause the processor 6 to determine the first position data by: first determining intermediate position data, using the input and said retrieved predefined fixed location of the tip 9a of the stylus 9 relative to the sprayer nozzle 3, wherein the intermediate position data is the position of the sprayer nozzle 3 relative to the rear-facing camera 5b when the eye drop sprayer device 2 and the portable electronic device 4 are connected in the first predefined configuration. The memory 7 of the portable electronic device 4 may have stored therein a transformation which represents how the position of the sprayer nozzle 9 relative to the rear-facing camera 5b when the eye drop sprayer device 2 and the portable electronic device 4 are connected in the first predefined configuration, changes when the eye drop sprayer device 2 and the portable electronic device 4 are changed from being connected in the first predefined configuration to being connected in the second predefined configuration. In the exemplary embodiment, the computer program when executed by a processor 6 will further cause the processor 6 to retrieve from the memory the transformation and apply the retrieved transformation to the intermediate data to determine said first position data.

[0148] After the first position data (wherein the first position data is the position the sprayer nozzle 3 will have relative to the rear-facing camera 5b if the eye drop sprayer device 2 and portable electronic device 4 are connect in the second predefined configuration) has been determined, the user will then connect the eye drop sprayer device 2 and portable electronic device 4 in the second predefined configuration. In an embodiment the computer program when executed by a processor 6 will cause the processor 6 to prompt the user to connect the eye drop sprayer device 2 and portable electronic device 4 in the second predefined configuration, after the first position data has been determined.

[0149] In the second predefined configuration the tip 9a of the stylus 9 contacts a back surface of the portable electronic device 4. In a preferredEYENEB-1-EPembodiment the location on the back surface where the tip 9a of the stylus 9 contacts the back surface corresponds to the location on the touchscreen 8 where the tip 9a of the stylus 9 contacted the touchscreen 8 when the eye drop sprayer device 2 and portable electronic device 4 were connected in the first predefined configuration.

[0150] In another embodiment a stylus 9 with a tip 9a is not provided on the eye drop sprayer device 2 (or is provided but is not used). In this other embodiment the above-mentioned steps (a)-(d) are omitted. The computer program when executed by a processor 6 will preferably cause the processor 6 determine a reference position, wherein the reference position is a relative position of rear-facing camera 5b relative to the eye belonging to the third party, at which the sprayer nozzle 3 would be aligned with the eye, using predefined dimensions of the portable electronic device 4. For example, in an embodiment the spray nozzle 3 will have a predefined position relative to the rear-facing camera 5b when the eye drop sprayer device 2 is connected to the portable electronic device 4 in the second predefined configuration; this predefined position is stored in a memory which is accessible to the processor 6, and the computer program when executed by a processor 6 will preferably cause the processor 6 retrieve from the memory the predefined position, wherein the retrieve predefined position defines the first position data (wherein the first position data is the position the sprayer nozzle 3 will have relative to the rear-facing camera 5b if the eye drop sprayer device 2 and portable electronic device 4 are connect in the second predefined configuration).

[0151] The computer program when executed by a processor 6 will cause the processor 6 to, (e) use the first position data to determine a reference position, wherein the reference position is a relative position of rear-facing camera 5b relative to the eye belonging to the third party, at which the sprayer nozzle 3 would be aligned with the eye. The computer program when executed may cause the processor 6 to carry out said aforementioned step (e) either before or after the eye drop sprayer device 2 and portable electronic device 4 are connected in the second predefined configuration.EYENEB-1-EP

[0152] In yet another embodiment the reference position (wherein the reference position is a relative position of rear-facing camera 5b relative to the eye belonging to the third party, at which the sprayer nozzle 3 would be aligned with the eye) is predefined and stored in a memory which is accessible to the processor 6. In this embodiment the above-mentioned steps (a)-(e) are omitted. In this embodiment the computer program when executed by a processor 6 will preferably cause the processor 6 retrieve from the memory the (predefined) reference position. The reference position may have been determined in a calibration step and stored in the memory.

[0153] While in the second predefined configuration the rear-facing camera 5b is operated to capture an image (or a plurality of images (e.g. video) wherein at least a portion of the captured image (or a plurality of images (e.g. video) depicts the eye belonging to the third party. In a preferred embodiment the rear-facing camera 5b of the portable electronic device 4 is operated to capture a plurality of images (such as a video (i.e. a stream of images)) each of which depicts the eye of the third party. The image, (or plurality of images (e.g. video)), captured by the rear-facing camera 5b are displayed on the display screen 8 of the portable electronic device 4, accordingly, the images (such as a video (i.e. a stream of images)) captured by the rear-facing camera 5b will be visible to the user that is trying to align the spray nozzle 3 with the eye of the third party.

[0154] The computer program which when executed by a processor 6 will cause the processor 6 to, use the image (or plurality of images (e.g. video) captured by the rear-facing camera 5b to determine the position of the rear-facing camera 5b relative to the eye of the third party; and use the determined position of the rear-facing camera 5b relative to the eye to determine the direction to move the eyedrop assembly 1 so that the spray nozzle 3 is aligned with the eye belonging to the third party.

[0155] Specifically, in the present embodiment the computer program which when executed by a processor 6 will cause the processor 6 to,EYENEB-1-EP(f) receive the innage (or plurality of innages (such as a video) captured by the rear-facing camera 5b, which depict the eye belonging to the third party;(g) determine second position data using the image (or plurality of images (e.g. video)) captured by the rear-facing camera 5b, wherein the second position data is the position of the rear-facing camera 5b relative to the eye of the third party; and(h) compare said second position data to said reference position (determined €the step (e)) to determine the direction to move the eyedrop assembly 1 so that the rear-facing camera 5b is brought to the reference position at which the spray nozzle 3 is aligned with the eye of the third party.

[0156] In an embodiment the computer program which when executed by a processor 6 will further cause the processor 6 to, prompt the user to move the eyedrop assembly 1 in said determined direction so that the user 10 knows in which direction they should move the eye drop assembly 1 in order to bring the spray nozzle 3 into alignment with said eye of the third party.

[0157] Preferably, the computer program when executed by a processor 6 will cause the processor 6 to detect when the rear-facing camera 5b has been brought to the reference position. In doing so the processor 6 to detects if / when the spray nozzle 3 has been brought into alignment with the eye of the third party. Preferably the computer program when executed by a processor 6 will cause the processor 6 to repeat at least the series of steps (f)-(h) until processor 6 to detects when the spray nozzle 3 has been brought into alignment with the eye 11 (i.e. until the processor 6 detects that the rear-facing camera 5b has been brought to the reference position).

[0158] Preferably the computer program which when executed by a processor 6 will cause the processor 6 to further initiate the eye drop sprayer device 2 to spray fluid from the spray nozzle 3 when the sprayEYENEB-1-EPnozzle 3 is aligned with the eye of the third party. As a result, the fluid will be administered to the eye of the third party at the moment when the spray nozzle 3 is aligned with the eye. Preferably, the computer program which when executed by a processor 6 will cause the processor 6 to further detect using an image (or plurality of images e.g. video) captured by the rear-facing camera 5b, when the spray nozzle 3 is aligned with the eye of the third party. In the present embodiment the computer program when executed by a processor 6 will cause the processor 6 to detect when the rear-facing camera 5b has been brought to the reference position. By detecting when the rear-facing camera 5b has been brought to the reference position the processor 6 detects if / when the spray nozzle 3 has been brought into alignment with eye of the third party. In response to detecting that the rear-facing camera 5b has been brought to the reference position the processor 6 initiates the eye drop sprayer device 2 to spray fluid from the spray nozzle 3.

[0159] In an alternative embodiment, the computer program when executed by a processor 6 will cause the processor 6 to carry out the abovementioned steps (a) - (d) to determine the first position data (wherein the first position data is the position the sprayer nozzle 3 will have relative to the rear-facing camera 5b if the eye drop sprayer device 2 and portable electronic device 4 are connect in the second predefined configuration). The user will then connect the eye drop sprayer device 2 and portable electronic device 4 in the second predefined configuration. In an embodiment the computer program when executed by a processor 6 will cause the processor 6 to prompt the user to connect the eye drop sprayer device 2 and portable electronic device 4 in the second predefined configuration.

[0160] While in the second predefined configuration the rear-facing camera 5b is operated to capture an image (or plurality of images e.g. video) wherein at least a portion of the captured image (or plurality of images e.g. video) depicts the eye belonging to the third party. In a preferred embodiment the rear-facing camera 5b of the portable electronic device 4 is operated to capture a plurality of images (such as a video (i.e. aEYENEB-1-EPstream of images)) each of which depicts the eye belonging to the third party. The computer program which when executed by a processor 6 will cause the processor 6 to,(e) determine second position data, using the image (or plurality of images (e.g. video)) captured by the rear-facing camera 5b, wherein the second position data is the position of the rear-facing camera 5b relative to the eye belonging to the third party; and(f)determine third position data, which is the position of the sprayer nozzle 3 relative to the eye belonging to the third party, using the first position data and second position data;(g) use said determined position of the sprayer nozzle 3 relative to the eye of the third party to determine the direction to move the eyedrop assembly 1 so that the spray nozzle 3 is aligned with said eye.

[0161] Preferably, for step (e), an embodiment the computer program when executed by a processor 6 will cause the processor 6 determine the second position data (wherein the second position data is the position of the rear-facing camera 5b relative to the eye belonging to the third party) by, receiving images of the face of the third party, captured by the rear facing camera 5b; and using a predefined distance value, which represent a predefined distance (preferably a predefined horizontal distance) between the eyes of the third party, to determine the position of the rear facing camera 5b relative to the eye of the third party. The predefined distance value (preferably a predefined horizontal distance) between the eye's of the third party, can be used as a reference to determine the position of the rear facing camera 5b relative to the eye of the third party. In this embodiment the distance between the eye's of the third party is assumed to be a fixed constant among all third parties (i.e. the predefined distance value (preferably a predefined horizontal distance) is the same fixed, predefined, constant which is used by the processor as a reference scale, for all third parties); in other words, in an embodiment, once the first predefined distance has been determined, it does not need to be determined again since the computer program uses the same predefined distance value for all third parties.EYENEB-1-EP

[0162] The predefined distance value may be determined by determining the distance between mesh vertices applied to the images of the face of the third party captured by the rear facing camera 5b. The predefined distance value may be previously established based on, for example, human morphological studies.

[0163] Preferably, for step (e), the computer program when executed by a processor 6 will cause the processor 6 to receive images of the user's face captured by the rear facing camera 5b ; and uses a predefined distance value, which represent a predefined distance (preferably a predefined horizontal distance) between the eyes of the third party, to calculate the position of the rear facing camera 5b relative to the eye of the third party. The predefined distance value which represents a predefined distance (preferably a predefined horizontal distance) between the eyes of the third party, is used by the processor 6 as a reference scale to allow the processor to determine distances between features depicted in the images captured by the rear facing camera 5b, and thus allow the processor to determine the position of the rear facing camera 5b relative to the eye of the third party from said images.

[0164] In an embodiment the computer program when executed by a processor 6 will cause the processor 6 determine the third position data by, receiving images of the face of the third party captured by the rear facing camera 5b; and using a predefined distance value, which represent a predefined distance (preferably a predefined horizontal distance) between the eyes of the third party, as a reference scale to allow the processor to determine, from the images captured by the rear facing camera 5b, the position of the rear facing camera 5b relative to the eye of the third party. In this embodiment the distance between the eyes of the third party is assumed to be a fixed constant for all third parties (i.e. the predefined distance value (preferably a predefined horizontal distance) between the eyes is the same fixed, predefined, constant which is used by the processor as a reference scale, for all third parties); in other words, in an embodiment the computer program uses the same predefined distance value for all third parties. The predefined distance value may be determined by determiningEYENEB-1-EPthe distance between mesh vertices applied to the eyes of the third party depicted in images of the face of the third party captured by the rear facing camera 5b. The predefined distance value may be previously established based on, for example, human morphological studies.

[0165] In an embodiment the computer program when executed by a processor 6 will cause the processor 6 to calculate at least a second predefined distance value (e.g. the diameter of the iris of the eye). The second predefined distance value (e.g. the diameter of the iris of the eye can be used as a reference scale (i.e. to allow distance calibration) even in the event that the images captured by the rear facing camera 5b depict only a single eye of the third party. Preferably, the computer program when executed by a processor 6 will cause the processor 6 to calculate at least a second predefined distance value (e.g. the diameter of the iris of the eye) from images which depict the two eyes so that the first predefined distance value (i.e. predefined horizontal distance between the eyes of the third party) can be applied as a reference scale when determining second predefined distance value. The second predefined distance value is assumed to be a fixed constant among all third parties; in other words the second predefined distance value is the same fixed, predefined, constant which is used by the processor as a reference scale, for all third parties. If the second predefined distance value is, for example, the diameter of the iris of the eye, then the second predefined distance value may be used by the processor 6 as a reference scale to allow the processor 6 to determine, the position of the rear facing camera 5b relative to the eye of the third party, from the images which depict only one single eye of the third party. The second predefined distance value (e.g. the diameter of the iris of the eye), is used by the processor 6 as a reference scale to allow the processor to determine distances between features depicted in the images captured by the rear facing camera 5b, and thus allows the processor 6 to determine the position of the rear facing camera 5b relative to the eye of the third party from said images.

[0166] The first predefined distance value (which in this example is the predefined horizontal distance between the eyes) can be used by theEYENEB-1-EPprocessor 6 as a first reference scale to determine the position of the rear facing camera 5b relative to the eye of the third party, from images which depict both eyes of the user processor 6; and the second predefined distance value (which in this example is the diameter of the iris of the eye) can be used by the processor 6 as a second reference scale to allow the processor to determine, from images captured by the rear facing camera 5b which depict only single eye of the third party, the position of the rear facing camera 5b relative to the eye of the third party. Most preferably, the second predefined distance value is determined from an image which the first predefined distance value can be used as a reference scale i.e. the processor 6 determines the second predefined distance value from an image which depict both eyes of the third party so that the horizontal distance between the eyes is measurable from that image; the first predefined distance value (e.g. the predefined horizontal distance between the eyes) is then used as a reference scale to allow the second predefined distance value (e.g. the diameter of the iris) to be determined from that image.

[0167] The second predefined distance value is the same fixed, predefined, constant which is used by the processor as a reference scale, for all third parties; in other words, in an embodiment once the second predefined distance value has been determined, the computer program uses the same second predefined distance value for all third parties.

[0168] It should be understood that any number of different predefined reference values may be determined. In a further embodiment, the software may use other predefined distance values as a reference scale, for example in another embodiment the triangular distance between both eyes and mouth is used by the processor 6 as a reference scale when processing the images captured by the rear facing camera 5b to determine the position of the rear facing camera 5b relative to the eye belonging to the third party. In another embodiment the portable electronic device may further comprise a calibration gauge.EYENEB-1-EP

[0169] In a further embodiment the computer program when executed by a processor 6 will cause the processor 6 to use qualitative distance measurement methods to determine, from the images captured by the rear facing camera 5b , the position of the rear facing camera 5b relative to the eye of the third party. For example, the computer program when executed by a processor 6 will cause the processor 6 to detect the eyes of the third party in an image captured by the rear facing camera 5b; and create a mesh over the detected eye in the image. The computer program when executed by a processor 6 will cause the processor 6 to determine (e.g. count) the number pixels within the mesh (i.e. determine (e.g. count) the number of pixels which make up the depiction of the eye in the image). The number of pixels defines an eye surface area. The computer program when executed by a processor 6 will cause the processor 6 determine the position of the rear facing camera 5b relative to the eye of the third party using the determined eye surface area of the eye of the third party. At a predefined eye surface area, the spray device would deliver the fluid to the eye.

[0170] Preferably the computer program when executed by a processor 6 will cause the processor 6 to detect if / when the spray nozzle 3 has been brought into alignment with the eye of the third party. In the present embodiment, preferably, the computer program when executed by a processor 6 will cause the processor 6 to detect if / when the spray nozzle 3 has been brought into alignment with the eye of the third party, using the first position data and second position data (wherein, in the present embodiment, the first position data is the position the sprayer nozzle 3 will have relative to the rear-facing camera 5b when the eye drop sprayer device 2 and portable electronic device 4 are connect in the second predefined configuration; and the second position data is the position of the rear-facing camera 5b relative to the eye of the third party). In the present embodiment, preferably, the computer program when executed by a processor 6 will cause the processor 6 to repeat at least the above- mentioned series of steps (e)-(g) until processor 6 to detects when the spray nozzle 3 has been brought into alignment with the eye of the third party.EYENEB-1-EP

[0171] Preferably the computer program which when executed by a processor 6 will cause the processor 6 to further initiate the eye drop sprayer device 2 to spray fluid from the spray nozzle 3 when the spray nozzle 3 is aligned with the eye of the third party. As a result, the fluid will be administered to the eye of the third party at the moment when the spray nozzle 3 is aligned with the eye. In the present embodiment, preferably, the computer program which when executed by a processor 6 will cause the processor 6 to further detect using an image (or plurality of images e.g. video) captured by the rear-facing camera 5b, when the spray nozzle 3 is aligned with the eye of the third party. In the present embodiment, preferably, the computer program when executed by a processor 6 will cause the processor 6 to detect if / when the spray nozzle 3 has been brought into alignment with the eye of the third party, using the first position data and second position data (wherein, in the present embodiment, the first position data is the position the sprayer nozzle 3 will have relative to the rear-facing camera 5b if the eye drop sprayer device 2 and portable electronic device 4 are connect in the second predefined configuration; and the second position data is the position of the rearfacing camera 5b relative to the eye of the third party). In response to detecting that the spray nozzle 3 has been brought into alignment with the eye 11, the processor 6 initiates the eye drop sprayer device 2 to spray fluid from the spray nozzle 3.

[0172] In any of the embodiments described in the present disclosure the computer program may assist a user to align the spray nozzle of an eye drop sprayer with a specific part of the eye.

[0173] In any of the embodiments of the present disclosure the computer program which when executed by a processor 6 may further cause the processor 6 to, carry out segmentation of the image (or plurality of images e.g. video) captured by the camera (front-facing camera 5a and / or rear-facing camera 5b) to provide a segmented image; and use the segmented image to identify predefined regions of the eye. The predefined regions may comprise any one or more of: the iris, pupil, and / or sclera.EYENEB-1-EP

[0174] In an embodiment the computer program which when executed by a processor 6 will further cause the processor 6 to, select a predefined region of the eye (eye 11 of the user, or, eye of the third party), or, receive as an input a selection of a predefined region of the eye (eye 11 of the user, or, eye of the third party); and the steps for alignment described in any of the embodiments herein are done with respect to the selected predefined region of the eye, so as to assist the user to align the spray nozzle 3 with the selected predefined region of the eye (eye 11 of the user, or, eye of the third party). For example, the processor may receive a user input that the fluid is to be delivered to the pupil of the eye; the processor 6 will carry out segmentation of the image (or plurality of images e.g. video) captured by the camera (front-facing camera 5a and / or rear-facing camera 5b) to provide a segmented image; and use the segmented image to identify the location of the pupil of the eye; the processor 6 will use the identified location of the pupil of the eye to determine the direction to move the eyedrop assembly 1 so that the spray nozzle 3 is aligned with the pupil of the eye; and will prompt the user to move the eyedrop assembly in said determined direction.

[0175] In any of the embodiments described in the present disclosure, the computer program which when executed by a processor 6 may cause the processor 6 to detect if the user fails to align the spray nozzle 3 with the eye (eye 11 of the user, or, eye of the third party) within a predefined time period; and in response to detecting that the use failed to align the spray nozzle 3 with the eye (eye 11 of the user, or, eye of the third party) within the predefined time period, send an alert to a remote server or platform. The alert may serve to notify an administrator that the user is having difficulty to successfully align the spray nozzle 3 with the eye. In response to receiving the alert, the administrator may then establish communication with the portable electronic device 4 of the eye drop assembly to provide assistance to the user.

[0176] In any of the embodiments of the present invention, the computer program which when executed by the processor may cause the processor 6 to determine one or more different directions to move theEYENEB-1-EPeyedrop assembly 1 so that the spray nozzle 3 is aligned with the eye (eye 11 of the user, or, eye of the third party) and / or so that the eyedrop assembly 1 in a predefined orientation with respect to the eye (eye 11 of the user, or, eye of the third party). The directions may be linear and / or rotational.

[0177] For example, in an embodiment the computer program which when executed by a processor will cause the processor 6 to determine if the eyedrop assembly 1 should be moved to the left or right, relative to the eye, in order to bring the spray nozzle 3 into alignment with the eye. Referring to the Figures 3a and 3b the computer program has been executed by a processor 6 and has caused the processor 6 to determine that the eyedrop assembly 1 should be moved to the left in order to bring the spray nozzle 3 into alignment with the eye 11. In the example the computer program which when executed by a processor will cause the processor 6 to displays a prompt 14 in the form of text "Move LEFT" on the display screen 8 of the portable electronic device 4. When the user follows the prompts and moves eyedrop assembly 1 in said direction prompted, the user will move the eyedrop assembly 1 towards a position wherein the spray nozzle 3 is aligned with the eye 11.

[0178] In an embodiment the computer program which when executed by a processor will cause the processor 6 to determine if the spray nozzle 3 has been brought into alignment with the eye 11. In response to determining that the spray nozzle 3 has been brought into alignment with the eye 11, the processor 6 will generate a message or alert to let the user know that successful alignment has been achieved. As shown in Figure 3c once the eyedrop assembly 1 has been successfully positioned so that spray nozzle 3 is aligned with the eye 11, a message or alert is generated to let the user know that successful alignment has been achieved. In this example a message "CORRECT position" is displayed on the display screen 8 of the portable electronic device 4, and / or a light signal (such as a green light) is displayed on the display screen 8 of the portable electronic device 4 and / or a light signal is displayed (such as the lighting of a green light) on the eye drop sprayer device 2.EYENEB-1-EP

[0179] In one embodiment the computer program which when executed by a processor will cause the processor 6 to further process the image (or plurality of images (e.g. video)) captured by the camera (front-facing camera 5a and / or rear-facing camera 5b), to determine if the eyedrop assembly 1 should be moved to the closer to, or away from, the eye, in order to bring the spray nozzle 3 into position wherein there is a predefined distance between the spray nozzle 3 and the eye. In an embodiment the computer program when executed by a processor 6 will cause the processor 6 to further, process the image (or plurality of images (e.g. video)) captured by the camera (front-facing camera 5a and / or rearfacing camera 5b) to determine the distance between a predefined reference and the eye (eye 11 of the user 10, or, eye of the third party); and to provide a prompt for the user to move the eyedrop assembly 1 closer to the eye or to move the eyedrop assembly 1 further away from the eye, until the distance between the predefined reference and the eye is equal to a predefined distance. The predefined reference may be the spray nozzle 3, or the camera (front-facing camera 5a and / or rear-facing camera 5b). The camera (front-facing camera 5a and / or rear-facing camera 5b) may comprise a time-of-flight camera, and the image (or plurality of images (e.g. video)) may be captured by the time-of-flight camera. The predefined distance may be any suitable distance, for example the predefined distance may be 10cm.

[0180] For example, as shown in figures 4a and 4b the computer program when executed by a processor 6 caused the processor 6 to further, process the image (or plurality of images (e.g. video)) captured by the front-facing camera 5a, to determine the distance between a predefined reference and the eye 11 ; and to compare the determined distance to a predefined distance; and to prompt the user 10 to move the eyedrop assembly 1 further away from the eye or closer to the eye, until the distance between the spray nozzle 3 and the eye 11 is equal to the predefined distance. The predefined reference may be the tip of the spray nozzle 3 for example. The predefined distance could be any suitable distance; in a preferred embodiment the predefined distance is in the range 2cm-20cm; most preferably the predefined distance is 10cm. In theEYENEB-1-EPexample shown in figure 4a the processor 6 processed the image (or plurality of images (e.g. video)) captured by the front-facing camera 5a, and determined that the distance between the spray nozzle 3 is and the eye 11 is greater than the predefined distance (which in this example is 10cm); accordingly, the computer program when executed by a processor 6 caused the processor 6 the provide a prompt, in the form of text "come CLOSER" displayed on the display screen 8, for the user to move the eyedrop assembly 1 closer to the eye 11, until the distance between the spray nozzle 3 and the eye 11 is equal to the predefined distance of 10cm. As shown in figure 4b the processor 6 processed the image (or plurality of images (e.g. video)) captured by the front-facing camera 5a, and determined that the distance between the spray nozzle 3 is and the eye 11 is less than the predefined distance of 10cm; accordingly, the computer program when executed by a processor 6 caused the processor 6 the provide a prompt, in the form of text "move BACK" displayed on the display screen 8, for the user to move the eyedrop assembly 1 away from to the eye 11, until the distance between the spray nozzle 3 and the eye 11 is equal to the predefined distance of 10cm.

[0181] In the examples shown in Figures 3a, 3b, 4a and 4b, the prompts 14 are in the form of text displayed on the display screen 8 of the portable electronic device 4. However, it should be understood that the prompts 14 are not limited to being in the form of text displayed on the display screen 8, rather the prompts 14 may take any suitable form. For example, in an embodiment the prompt(s) may comprise a haptic prompt. The haptic prompt may be a vibration of the portable electronic device 4. In an embodiment the prompt(s) may comprise an audio prompt. The prompt(s) may comprise any combination of different types of prompts. For example, the prompt(s) may comprise a combination of text displayed on the display screen 8 plus an audio prompt (such as an audio of the text displayed on the display screen); or the prompt(s) may comprise a combination of text displayed on the display screen 8 plus a haptic prompt (such as vibration of the portable electronic device 4).EYENEB-1-EP

[0182] It should be understood that the computer program when executed by a processor 6 causes the processor to carry out any of the above-mentioned steps on an image (or plurality of images (e.g. video)) captured by the rear-facing camera 5b. In particular, any of the steps described with reference to Figures 3a, 3b, 4a and 4b, may be carried out by the processor 6 on an image (or plurality of images (e.g. video)) captured by the rear-facing camera 5b.

[0183] In one embodiment the computer program which when executed by a processor will cause the processor 6 to further process the image (or plurality of images (e.g. video)) captured by the camera (front-facing camera 5a and / or rear-facing camera 5b) to determine if the eyedrop assembly 1 should be rotated or titled in order to bring the eyedrop assembly 1 into a predefined orientation.

[0184] For example, in an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to further, process the image (or plurality of images (e.g. video)) captured by the camera (front-facing camera 5a and / or rear-facing camera 5b), to determine an offset between a predefined reference axis and an optical axis of the eye 11 ; and determine from the determined offset, a direction to adjust the tilt of the eyedrop assembly 1 to bring the predefined reference axis parallel to the optical axis of the eye 11 ; and prompt the user to move the eyedrop assembly 1 in said determined direction. In one embodiment the predefined reference axis may be an optical axis of the camera (front-facing camera 5a and / or rear-facing camera 5b); in another embodiment the predefined reference axis may be an axis of the spray nozzle 3 which extends in the direction of spray of the spray nozzle 3 (e.g. an axis of the spray nozzle 3, which extends from a centre of an opening of the spray nozzle 3 through which fluid is sprayed, in the direction of spray of the spray nozzle 3).

[0185] In another exemplary embodiment the computer program which when executed by a processor 6 will cause the processor 6 to further,EYENEB-1-EPprocess the innage (or plurality of innages (e.g. video)) captured by the camera (front-facing camera 5a and / or rear-facing camera 5b) to determine a rotation of the portable electronic device 4 and / or the eyedrop assembly 1 about a predefined reference axis; and determine from the determined rotation, a direction to rotate the eyedrop assembly 1 to bring the portable electronic device 1 and / or the eyedrop assembly 1 into a vertical orientation; and prompt the user to move the eyedrop assembly 1 in said determined direction. In one embodiment the predefined reference axis may be an optical axis of the camera (front-facing camera 5a and / or rearfacing camera 5b) of the portable electronic device 4.

[0186] In an embodiment the portable electronic device 4 may further comprise an accelerometer, and wherein the image (or plurality of images (e.g. video)) captured by the camera (front-facing camera 5a and / or rearfacing camera 5b) further depicts a face; and the computer program which when executed by a processor may cause the processor to, receive an output of the accelerometer which indicates the tilt of the portable electronic device 4 and / or the tilt of the eyedrop assembly 1 about one or more reference axes; process the image (or plurality of images (e.g. video)) captured by the camera (front-facing camera 5a and / or rear-facing camera 5b) to determine the orientation of a coronal plane of the face depicted in the image; determine using the determined orientation of a coronal plane of the face depicted in the image, and the received output of the accelerometer, a direction to move the eyedrop assembly 1 so that portable electronic device 4 and / or the eyedrop assembly 1, is parallel to the coronal plane of the face; and prompt the user to move the eyedrop assembly in said determined direction.

[0187] In an embodiment wherein the image (or plurality of images (e.g. video)) captured by the camera (front-facing camera 5a and / or rear-facing camera 5b) further depicts a face, the computer program which when executed by a processor will cause the processor to, process the image (or plurality of images (e.g. video)) to determine an angle between a plane of the portable electronic device 4 and a coronal plane of the face; determine from the determined angle a direction to move the eyedrop assembly 1 soEYENEB-1-EPthat the plane of the portable electronic device 4 is parallel to the coronal plane of the face; and prompt the user to move the eyedrop assembly 1 in said determined direction.

[0188] In an embodiment the portable electronic device 4 may further comprise a depth sensor, and wherein the image (or plurality of images (e.g. video)) captured by the camera (front-facing camera 5a and / or rearfacing camera 5b) further depicts a face, and wherein the computer program which when executed by a processor will cause the processor to, receive an output of the depth sensor which indicates the distance of the camera (front-facing camera 5a and / or rear-facing camera 5b) to a single point, or plurality of points, depicted in the received image (or plurality of images (e.g. video)); determine from the received output of the depth sensor an angle between a plane of the portable electronic device 4 and a coronal plane of the face; determine from the determined angle the direction to move the eyedrop assembly 1 so that the plane of the portable electronic device 4 is parallel to the coronal plane of the face; prompt the user to move the eyedrop assembly in said determined direction.

[0189] In any of the above-mentioned embodiments the computer program which when executed by a processor 6 may cause the processor 6 to further, initiate the eye drop sprayer device 2 to spray fluid from the spray nozzle 3 when the spray nozzle 3 is aligned with the eye (the eye of the user or the eye of a third party). As a result the fluid can be administered to the eye of the user, or the eye of the third party, at the moment when the spray nozzle 3 is aligned with the eye.

[0190] Preferably, the eye drop sprayer device 2 comprises an actuator which is operable to actuate the eye drop sprayer device 2 to spray fluid from the spray nozzle 3. Preferably, in any embodiment of the present invention, the computer program which when executed by a processor 6 may cause the processor 6 to initiate the eye drop sprayer device 2 to spray fluid from the spray nozzle 3 by sending an activation signal to the actuator; and wherein the actuator is configured to actuate the eye dropEYENEB-1-EPsprayer device 2 to spray fluid from the spray nozzle 3 in response to receiving the activation signal.

[0191] In any embodiment the computer program which when executed by a processor 6 may cause the processor 6 to further detect using images captured by the camera (front-facing camera 5a and / or rear-facing camera 5b) when the spray nozzle 3 is aligned with the eye (eye 11 of the user 10 or the eye belonging to the third party). In any embodiment the computer program which when executed by a processor 6 may cause the processor 6 to further, receive at least a second image (or plurality of images (e.g. video) captured by the camera (front-facing camera 5a and / or rear-facing camera 5b) of the portable electronic device 4, wherein the at least a second image (or plurality of images (e.g. video) depicts the eye (eye 11 of the user 10 or the eye belonging to the third party); and detect using the at least a second image (or plurality of images (e.g. video) when the spray nozzle 3 is aligned with the eye (eye 11 of the user 10 or the eye belonging to the third party); and in response to detecting that the spray nozzle 3 is aligned with the eye, initiate the eye drop sprayer device 2 to spray fluid from the spray nozzle 3.

[0192] The portable electronic device 4 may comprise a plurality of cameras. The plurality of cameras may comprise one or more of, a wide angle camera, a video camera for monitoring the eye image, a time of flight camera, an infrared camera.

[0193] For example the portable electronic device 4 may comprise a plurality of rear facing cameras and / or a plurality of front-facing cameras. The plurality of rear facing cameras may be cameras of different types. The plurality of front-facing cameras may be cameras of different types. In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to, select one of the plurality of cameras to capture an image (or plurality of images e.g. video) of the eye (eye 11 of the user 10 or the eye belonging to the third party). In an embodiment the computer program which when executed by a processor 6 will cause theEYENEB-1-EPprocessor 6 to provide a prompt to the user to activate a selected one of said cameras to capture an image (or plurality of images eg. video) of the eye.

[0194] In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to, operate a first front-facing camera of the portable electronic device 4 to capture one or more images of the eye 11 of the user 10, until the eyedrop assembly 1 has been moved to a position in which the spray nozzle 3 is aligned with the eye 11 of the user 10; and then operate a second front-facing camera of the portable electronic device 4 to capture one or more images of the eye 11 of the user 10, after the spray nozzle has been aligned with the eye. Preferably the computer program which when executed by a processor 6 will cause the processor 6 to operate a second front-facing camera to capture one or more images of the eye 11 of the user 10, after the spray nozzle 3 has been aligned with the eye 11 of the user 10, and before (e.g. immediately before) or at the time the processor initiates the eye drop sprayer device 2 to spray fluid from the spray nozzle. The first front-facing camera and second front-facing camera may be different types of camera, for example the first front-facing camera may be a wide angle camera and second frontfacing camera may be a video camera; or for example the first front-facing camera may be a time-of-flight camera and second front-facing camera may be a video camera.

[0195] In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to, operate a first rear-facing camera of the portable electronic device 4 to capture one or more images of the eye of a third party, until the eyedrop assembly 1 has been moved to a position in which the spray nozzle 3 is aligned with the eye of a third party; and then operate a second rear-facing camera of the portable electronic device 4 to capture one or more images of the eye of a third party, after the spray nozzle has been aligned with the eye of a third party. Preferably the computer program which when executed by a processor 6 will cause the processor 6 to operate a second rear-facing camera to capture one or more images of the eye of a third party after the sprayEYENEB-1-EPnozzle 3 has been aligned with the eye of a third party, and before (e.g. immediately before) or at the time the processor initiates the eye drop sprayer device 2 to spray fluid from the spray nozzle. The first rear-facing camera and second rear-facing camera may be different types of camera, for example the first rear-facing camera may be a wide angle camera and second rear-facing camera may be a video camera; or for example the first rear-facing camera may be a time-of-flight camera and second rear-facing camera may be a video camera.

[0196] In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to further, receive at least a second image depicting the user's eye 11, captured by the front-facing camera 5a of the portable electronic device 4 when the eyedrop assembly 1 is in a position in which the spray nozzle 3 is aligned with the users eye 11 ; determine from the received at least second image when the user's eye 11 is open; and initiate the eye drop sprayer device 2 to spray fluid from the spray nozzle 3 when the user's eye is open.

[0197] In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to, receive a plurality of images (e.g. video) captured by the front-facing camera 5a of the portable electronic device 4; determine a blinking frequency of the user's eye 11 ; use the determined blinking frequency to determine a time instant when the user's eye is due to be open; and initiate the eye drop sprayer device 2 to spray fluid at said determined time instant so that the fluid is sprayed from the spray nozzle 3 into the user's eye 11 when the user's eye 11 is open.

[0198] In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to further, receive as input at least a third image depicting the user's eye 11, captured by the front-facing camera 5a of the portable electronic device 4 at a time instant corresponding to when the eye drop sprayer device 2 was initiated to spray fluid from the spray nozzle 3; determining from the at least third image ifEYENEB-1-EPuser's eye was closed when the fluid reached the user's eye 11. Preferably the computer program which when executed by a processor 6 will cause the processor 6 to further provide a prompt to repeat the steps to align the spray nozzle 3 with the eye 11 (so that another spray of fluid can be administered to the eye 11 of the user) if it is determined from the at least third image that the user's eye was closed when the fluid reached the user's eye 11.

[0199] In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to further, receive at least a second image depicting the user's eye 11, captured by the front-facing camera 5a of the portable electronic device 4 when the eyedrop assembly 1 is in a position in which the spray nozzle 3 is aligned with the users eye 11 ; determine from the received at least second image when the user's eye 11 is closed; and initiate the eye drop sprayer device 2 to spray fluid from the spray nozzle 3 when the user's eye is closed.

[0200] In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to, receive a plurality of images (e.g. video) captured by the front-facing camera 5a of the portable electronic device 4; determine a blinking frequency of the user's eye 11 ; use the determined blinking frequency to determine a time instant when the user's eye is due to be closed; and initiate the eye drop sprayer device 2 to spray fluid at said determined time instant so that the fluid is sprayed from the spray nozzle 3 into the user's eye 11 when the user's eye 11 is closed.

[0201] In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to further, receive as input at least a third image depicting the user's eye 11, captured by the front-facing camera 5a of the portable electronic device 4 at a time instant corresponding to when the eye drop sprayer device 2 was initiated to spray fluid from the spray nozzle 3; determining from the at least third image if user's eye was closed when the fluid reached the user's eye 11. PreferablyEYENEB-1-EPthe computer program which when executed by a processor 6 will cause the processor 6 to further provide a prompt to repeat the steps to align the spray nozzle 3 with the eye 11 (so that another spray of fluid can be administered to the eye 11 of the user) if it is determined from the at least third image that the user's eye was open when the fluid reached the user's eye 11.

[0202] In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to further, receive as an input a signal indicating if the fluid in the eye drop sprayer 2 is to be administered to an open eye or to a closed eye. In an embodiment the computer program which when executed by a processor 6 will cause the processor to further, receive from the eye drop sprayer device 2 a signal indicating if the fluid is to be administered to an open eye or to a closed eye. The computer program which when executed by a processor 6 will cause the processor 6 to further carry out any of the above mentioned steps described for the aforementioned embodiments depending on whether the fluid in the eye drop sprayer 2 is to be administered to an open eye or to a closed eye of the user.

[0203] In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to further, receive at least a second image depicting the eye belonging to a third party, captured by the rear-facing camera 5b of the portable electronic device 4 when the eyedrop assembly 1 is in a position in which the spray nozzle 3 is aligned with the eye belonging to a third party; determine from the received at least second image when the eye belonging to a third party is open; and initiate the eye drop sprayer device 2 to spray fluid from the spray nozzle 3 when eye belonging to a third party is open.

[0204] In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to, receive a plurality of images (e.g. video) captured by the rear-facing camera 5b of the portable electronic device 4; determine a blinking frequency of the eye belongingEYENEB-1-EPto a third party; use the determined blinking frequency to determine a time instant when the eye belonging to a third party is due to be open; and initiate the eye drop sprayer device 2 to spray fluid at said determined time instant so that the fluid is sprayed from the spray nozzle 3 into the eye belonging to a third party when the eye is open.

[0205] In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to further, receive as input at least a third image depicting the eye belonging to a third party, captured by the rear-facing camera 5b of the portable electronic device 4 at a time instant corresponding to when the eye drop sprayer device 2 was initiated to spray fluid from the spray nozzle 3; determining from the at least third image if eye belonging to a third party was closed when the fluid reached the eye belonging to a third party. Preferably the computer program which when executed by a processor 6 will cause the processor 6 to further provide a prompt to repeat the steps to align the spray nozzle 3 with the eye belonging to a third party (so that another spray of fluid can be administered to the eye belonging to a third party) if it is determined from the at least third image that the eye belonging to a third party was closed when the fluid reached the eye belonging to a third party.

[0206] In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to further, receive at least a second image depicting the eye belonging to a third party, captured by the rear-facing camera 5b of the portable electronic device 4 when the eyedrop assembly 1 is in a position in which the spray nozzle 3 is aligned with the eye belonging to a third party; determine from the received at least second image when the eye belonging to a third party is closed; and initiate the eye drop sprayer device 2 to spray fluid from the spray nozzle 3 when the eye belonging to a third party is closed.

[0207] In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to, receive a plurality of images (e.g. video) captured by the rear-facing camera 5b of the portableEYENEB-1-EPelectronic device 4; determine a blinking frequency of the eye belonging to a third party; use the determined blinking frequency to determine a time instant when the eye belonging to a third party is due to be closed; and initiate the eye drop sprayer device 2 to spray fluid at said determined time instant so that the fluid is sprayed from the spray nozzle 3 into the eye belonging to a third party when the eye is closed.

[0208] In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to further, receive as input at least a third image depicting the eye belonging to a third party, captured by the rear-facing camera 5b of the portable electronic device 4 at a time instant corresponding to when the eye drop sprayer device 2 was initiated to spray fluid from the spray nozzle 3; determining from the at least third image if eye belonging to a third party was closed when the fluid reached the eye belonging to a third party. Preferably the computer program which when executed by a processor 6 will cause the processor 6 to further provide a prompt to repeat the steps to align the spray nozzle 3 with the eye belonging to a third party (so that another spray of fluid can be administered to the eye belonging to a third party) if it is determined from the at least third image that the eye belonging to a third party was open when the fluid reached the eye.

[0209] In an embodiment the computer program which when executed by a processor 6 will cause the processor 6 to further, receive as an input a signal indicating if the fluid in the eye drop sprayer 2 is to be administered to an open eye or to a closed eye. In an embodiment the computer program which when executed by a processor 6 will cause the processor to further, receive from the eye drop sprayer device 2 a signal indicating if the fluid is to be administered to an open eye or to a closed eye. The computer program which when executed by a processor 6 will cause the processor 6 to further carry out any of the above mentioned steps described for the aforementioned embodiments depending on whether the fluid in the eye drop sprayer 2 is to be administered to an open eye or to a closed eye of the third party.EYENEB-1-EP

[0210] According to a further embodiment the computer program which when executed by a processor 6 will cause the processor 6 to further, receive as input at least a second image, which depicts the eye 11 of the user, captured by the front-facing camera 5a of the portable electronic device 4; and to process the received at least second image to detect if there is an obstacle overlaying the eye 11 of the user 10.The processor 6 may process the received at least second image to detect if there is an obstacle overlaying the eye 11 of the user 10, using image processing techniques known in the art. Preferably, the computer program which when executed by a processor 6 will cause the processor 6 provide a prompt to remove the obstacle if it is detected that there is an obstacle overlaying the eye 11 of the user 10. The obstacle may take any form; for example, the obstacle may comprise at least one of glasses, eye patch, eye cap, plaster, cosmetic patch, and / or a bandage. Preferably, the at least second image is an image captured by the front-facing camera 5a when the eye drop assembly 1 has been moved to a position wherein the spray nozzle 3 is aligned with the eye 11 of the user. In an embodiment the processor 6 may further process the received at least second image to detect if an artificial eye is located in the eye sock, and / or to detect if the eye socket is empty. This may be done using image processing techniques known in the art. The computer program which when executed by a processor 6 will cause the processor 6 to prompt the user to insert their artificial eye into the eye socket if it is detected that the eye socket is empty. Or, (depending on the fluid to be administered) the computer program which when executed by a processor 6 will cause the processor 6 to prompt the user to remove their artificial eye from the eye socket, if it is detected that the artificial eye is present in the eye socket.

[0211] According to a further embodiment the computer program which when executed by a processor 6 will cause the processor 6 to further, receive as input at least a second image, which depicts the eye of a third party, captured by the rear-facing camera 5b of the portable electronic device 4; and to process the received at least second image to detect if there is an obstacle overlaying the eye of a third party . The processor 6 may process the received at least second image to detect if there is anEYENEB-1-EPobstacle overlaying the eye of a third party, using image processing techniques known in the art. Preferably, the computer program which when executed by a processor 6 will cause the processor 6 provide a prompt to remove the obstacle if it is detected that there is an obstacle overlaying the eye of a third party. The obstacle may take any form; for example, the obstacle may comprise at least one of glasses, eye patch, and / or a bandage. Preferably, the at least second image is an image captured by the rearfacing camera 5b when the eye drop assembly 1 has been moved to a position wherein the spray nozzle 3 is aligned with the eye of a third party.

[0212] Various modifications and variations to the described embodiments of the invention will be apparent to those skilled in the art without departing from the scope of the invention as defined in the appended claims. Although the invention has been described in connection with specific preferred embodiments, it should be understood that the invention as claimed should not be unduly limited to such specific embodiment.EYENEB-1-EP

Claims

1. 72Claims1. A computer program, for assisting a user to align the spray nozzle (3) of an eye drop sprayer device (2) with an eye, stored on a portable electronic device (4), the portable electronic device having a processor (6) and a camera (5a, 5b); and wherein the portable electronic device (4) can connect with an eye drop sprayer device (2) which has a spray nozzle (3) to form an eye drop assembly (1), wherein the portable electronic device (4) and the eye drop sprayer device (2) are in a predefined orientation with respect to one another when connected to form the eye drop assembly (1); and wherein the eye drop sprayer device (2) holds a fluid; and wherein the computer program which when executed by a processor (6) will cause the processor (6) to, use an captured by the camera (5a, 5b) of the portable electronic device (4), wherein at least a portion of the image depicts an eye, to determine the direction to move the eyedrop assembly (1) so that the spray nozzle (3) is aligned with said eye; prompt the user to move the eyedrop assembly (1) in said determined direction.

2. The computer program according to claim 1 wherein the computer program which when executed by a processor will cause the processor to, use the image to determine the position of the spray nozzle relative to the eye; and use the determined position of the spray nozzle relative to the eye to determine said direction to move the eyedrop assembly so that the spray nozzle is aligned with the eye.

3. The computer program according to claim 2, wherein the portable electronic device comprises a touchscreen, and wherein the eye drop sprayer comprises a stylus which has a tip which is in a predefined fixed location relative to the sprayer nozzle, and wherein the stylus contacts the touchscreen of the portable electronic device when the portable electronicEYENEB-1-EP73 device and the eye drop sprayer device are connected to form the eye drop assembly, and wherein the computer program which when executed by a processor will cause the processor to further, receive, as an input, the location on the touchscreen where the tip of the stylus contacts the touchscreen; use said input and said image, to determine the position of the sprayer nozzle relative to the eye; use said determined position of the sprayer nozzle relative to the eye to determine said direction to move the eyedrop assembly so that the spray nozzle is aligned with said eye.

4. The computer program according to claim 4, wherein the portable electronic device comprises a memory having stored therein the predefined fixed location of the tip of the stylus relative to the sprayer nozzle, and wherein the computer program which when executed by a processor will cause the processor to determine the position of the sprayer nozzle relative to the eye by, determining first position data, which is the position of the tip of the stylus relative to the camera, using said input; retrieving from a memory of the portable electronic device the predefined fixed location of the tip of the stylus relative to the sprayer nozzle; determining second position data, which is the position of the sprayer nozzle relative to the camera, using the first position data and said retrieved predefined fixed location of the tip of the stylus relative to the sprayer nozzle; determining third position data, which is the position of the camera relative to the eye, using the image; determining the position of the sprayer nozzle relative to the eye, using the second position data and third position data.

5. The computer program according to claim 1 wherein the computer program which when executed by a processor will cause the processor to, use the image to determine the position of the camera relative to the eye; andEYENEB-1-EP74 use the determined position of the camera relative to the eye to determine said direction to move the eyedrop assembly so that the spray nozzle is aligned with the eye6. The computer program according to claim 5, wherein the portable electronic device comprises a touchscreen, and wherein the eye drop sprayer comprises a stylus which has a tip which is in a predefined fixed location relative to the sprayer nozzle, and wherein the stylus contacts the touchscreen of the portable electronic device when the portable electronic device and the eye drop sprayer device are connected to form the eye drop assembly, and wherein the computer program which when executed by a processor will cause the processor to further, receive, as an input, the location on the touchscreen where the tip of the stylus contacts the touchscreen; use said input and said image, to determine the position of the camera relative to the eye; use said determined position of the camera relative to the eye to determine said direction to move the eyedrop assembly so that the spray nozzle is aligned with said eye.

7. The computer program according to claim 6, wherein the portable electronic device comprises a memory having stored therein the predefined fixed location of the tip of the stylus relative to the sprayer nozzle, and wherein the computer program which when executed by a processor will cause the processor to, determine first position data, which is the position of the tip of the stylus relative to the camera, using said input; retrieving from a memory of the portable electronic device the predefined fixed location of the tip of the stylus relative to the sprayer nozzle; determine second position data, which is the position of the sprayer nozzle relative to the camera, using the first position data and said retrieved predefined fixed location of the tip of the stylus relative to the sprayer nozzle; use the second position data to determine a reference position, whereinEYENEB-1-EP75 the reference position is a relative position of the camera relative to the eye at which the sprayer nozzle would be aligned with the eye; determine third position data using the image captured by the camera, wherein the third position data is the position of the camera relative to the eye; compare said third position data to said reference position to determine the direction to move the eyedrop assembly so that the camera is brought to the reference position, and the spray nozzle is aligned with the eye.

8. The computer program according to any one of the preceding claims wherein the portable electronic device comprises a display screen, and wherein the eye drop sprayer device is connected to the portable electronic device in a first predefined configuration wherein the spray nozzle is pointing in the same direction as the direction that that the display screen is facing.

9. The computer program according to according to any one of the preceding claims wherein the eye is an eye belonging to a third party; and wherein the portable electronic device comprises a touchscreen, and wherein the eye drop sprayer comprises a stylus which has a tip which is in a predefined fixed location relative to the sprayer nozzle, and wherein the stylus contacts the touchscreen of the portable electronic device when the eye drop sprayer device is connected to the portable electronic device in a first predefined configuration wherein the eye drop sprayer device is connected to the portable electronic device such that the spray nozzle is pointing in the same direction as the direction that that the display screen is facing, and wherein the computer program which when executed by a processor will cause the processor to further, receive, as an input, the location on the touchscreen where the tip of the stylus contacts the touchscreen; determine first position data, using the input and said retrieved predefined fixed location of the tip of the stylus relative to the sprayer nozzle, wherein the first position data is the position the sprayer nozzle will have relative to the camera if the eye drop sprayer device and portableEYENEB-1-EP76 electronic device are connect in a second predefined configuration, wherein in said second predefined configuration the eye drop sprayer device is connected to the portable electronic device such that the spray nozzle is pointing in the opposite direction as the direction that that the display screen is facing; use the first position data to determine a reference position, wherein the reference position is a relative position of the camera relative to the eye at which the sprayer nozzle would be aligned with the eye; determine second position data using an image captured by the camera when the eye drop sprayer device and portable electronic device are connected in the second predefined configuration, wherein the image depicts the eye of a third party, wherein the second position data is the position of the camera relative to the eye of the third party; compare said second position data to said reference position to determine the direction to move the eyedrop assembly so that camera brought to the reference position and the spray nozzle is aligned with the eye of the third party.

10. The computer program according to according to any one of claims 1-8 wherein the eye is an eye belonging to a third party; and wherein the portable electronic device comprises a touchscreen, and wherein the eye drop sprayer comprises a stylus which has a tip which is in a predefined fixed location relative to the sprayer nozzle, and wherein the stylus contacts the touchscreen of the portable electronic device when the eye drop sprayer device is connected to the portable electronic device in a first predefined configuration wherein the eye drop sprayer device is connected to the portable electronic device such that the spray nozzle is pointing in the same direction as the direction that that the display screen is facing, and wherein the computer program which when executed by a processor will cause the processor to further, receive, as an input, the location on the touchscreen where the tip of the stylus contacts the touchscreen; determine first position data, using the input and said retrieved predefined fixed location of the tip of the stylus relative to the sprayer nozzle, wherein the first position data is the position the sprayer nozzleEYENEB-1-EP77 will have relative to the camera if the eye drop sprayer device and portable electronic device are connect in a second predefined configuration, wherein in said second predefined configuration the eye drop sprayer device is connected to the portable electronic device such that the spray nozzle is pointing in the opposite direction as the direction that that the display screen is facing; determine second position data using an image captured by the camera when the eye drop sprayer device and portable electronic device are connected in the second predefined configuration, wherein the image depicts the eye of a third party, wherein the second position data is the position of the camera relative to the eye of the third party; determine third position data, which is the position of the sprayer nozzle relative to the eye belonging to the third party, using the first position data and second position data; use said determined position of the sprayer nozzle relative to the eye to determine the direction to move the eyedrop assembly so that the spray nozzle is aligned with said eye of the third party.11.The computer program according to claim 10 wherein the computer program which when executed by a processor will cause the processor to further prompt the user to connect the portable electronic device and eye drop sprayer device in the second predefined configuration after the first position data has been determined.

12. The computer program according to any of claims 10 or 11, wherein the computer program which when executed by a processor will cause the processor to, detect when the when the eye drop sprayer device and portable electronic device and are connected in the second predefined configuration.

13. The computer program according to any one of the preceding claims, wherein the computer program which when executed by a processor will cause the processor to,EYENEB-1-EPreceive as input an indication of whether the fluid is to be administered to the user's own eye, or, if the fluid is to be administered to an eye of a third party.

14. The computer program according to any one of the preceding claims wherein the computer program which when executed by a processor will cause the processor to further, initiate the eye drop sprayer device to spray fluid from the spray nozzle when the spray nozzle is aligned with the eye.

15. The computer program according to any one of the preceding claims wherein the computer program which when executed by a processor will cause the processor to further, receive as input at least a second image captured by the camera of the portable electronic device, wherein at least a portion of the captured second image depicts the eye; detect using the at least second image when the spray nozzle is aligned with the eye.

16. The computer program according to any one of the preceding claims wherein the computer program which when executed by a processor will cause the processor to, detect if the user fails to align the spray nozzle with the eye within a predefined time period; and in response to detecting that the user failed to align the spray nozzle with the eye within a predefined time period, send an alert to a remote server or platform.

17. The computer program according to any one of the preceding claims wherein the computer program which when executed by a processor will cause the processor to further, receive as input at least a second image depicting the eye, captured by the camera of the portable electronic device when the eyedrop assembly is in a position in which the spray nozzle is aligned with the users eye;EYENEB-1-EPdetermine from the received at least second image when the eye is open; and initiate the eye drop sprayer device to spray fluid from the spray nozzle when the eye is open.

18. The computer program according to claim 17 wherein the computer program which when executed by a processor will cause the processor to, receive as input a plurality of images captured by the camera of the portable electronic device; and determine a blinking frequency of the eye from said input; use the determined blinking frequency to determine a time instant when the eye is due to be open; and initiate the eye drop sprayer device to spray fluid at said determined time instant so that the fluid is sprayed from the spray nozzle when the eye is due to be open.

19. The computer program according to any one of claims 17 or 18 wherein the computer program when executed by a processor will cause the processor to further, receive as input at least a third image depicting the eye, captured by the camera at a time instant corresponding to when the eye drop sprayer device was initiated to spray fluid from the spray nozzle; determine from the at least third image if user's eye was closed when the fluid reached the eye.

20. The computer program according to claim 19 wherein the computer program is when executed by a processor will cause the processor to further, prompt the user to align the spray nozzle with the eye if it is determined from the at least third image that the eye was closed when the fluid reached the eye.21.The computer program according to any one of the preceding claims wherein the computer program which when executed by a processor will cause the processor to further,EYENEB-1-EPreceive as input at least a second image depicting the eye, captured by the camera of the portable electronic device when the eyedrop assembly is in a position in which the spray nozzle is aligned with the users eye; determine from the received at least second image when the eye is closed; and initiate the eye drop sprayer device to spray fluid from the spray nozzle when the eye is closed.

22. The computer program according to claims 21 wherein the computer program when executed by a processor will cause the processor to further, receive as input at least a third image depicting the eye, captured by the camera at a time instant corresponding to when the eye drop sprayer device was initiated to spray fluid from the spray nozzle; determine from the at least third image if user's eye was open when the fluid reached the eye.

23. The computer program according to claim 22 wherein the computer program is when executed by a processor will cause the processor to further, prompt the user to align the spray nozzle with the eye if it is determined from the at least third image that the eye was open when the fluid reached the eye.

24. The computer program according to any one of the preceding claims wherein the computer program which when executed by a processor will cause the processor to further, receive from the eye drop sprayer device a signal indicating if the fluid is to be administered to an open eye or to a closed eye; or receive an input from a user indicating if the fluid is to be administered to an open eye or to a closed eye.

25. The computer program according to claims 24 wherein the computer program which when executed by a processor will cause the processor to further, carry out the steps of any one of claims 17-20 if the signal receivedEYENEB-1-EP81 indicates that the fluid is to be administered to an open eye or if the user input indicates that the fluid is to be administered to an open eye; and / or carry out the steps of any one of claims 21-23 if the signal received indicates that the fluid is to be administered to a closed eye or if the user input indicates that the fluid is to be administered to a closed eye.

26. The computer program according to any one of the preceding claims wherein the computer program which when executed by a processor will cause the processor to further, receive as input at least a second image, captured by the camera, when the eyedrop assembly is in a position in which the spray nozzle is aligned with the eye, process the received at least second image to detect if there is an obstacle overlaying the eye.

27. The computer program according to claim 26 wherein the computer program which when executed by a processor will cause the processor to further, provide a prompt to remove the obstacle if it is detected that there is an obstacle overlaying the eye.

28. The computer program according to claims 2 or 27 wherein the obstacle comprises at least one of glasses, eye patch, and / or a bandage.

29. The computer program according to any one of the preceding claims wherein the received image depicts the face of a user, and wherein the computer program which when executed by a processor will cause the processor to, apply a mesh model to the image captured by the camera.

30. The computer program according to claim 29 wherein the computer program which when executed by a processor will further cause the processor to, use the mesh model to determine the location of the depiction of the eye in the captured image; and use the determined location of the depiction of eye in the capturedEYENEB-1-EP82 image to determine the position of the camera relative to the eye of the user.

31. The computer program according to any one of the preceding claims wherein the computer program which when executed by a processor will cause the processor to further, process the image captured by the camera to determine a distance between a predefined reference and the eye; prompt the user to move the eyedrop assembly closer to the eye, or prompt the user to move the eyedrop assembly away from the eye, until the distance between the predefined reference and the eye is equal to a predefined distance.

32. The computer program according to claim 31 wherein the predefined reference is the spray nozzle through which fluid is sprayed.

33. The computer program according to claim 31 wherein the predefined reference is the camera.

34. The computer program according to claim 31, wherein the portable electronic device comprises a time-of-flight camera.

35. The computer program according to claim 34 wherein the predefined reference is the time-of-flight camera.

36. The computer program according to any one of the preceding claims wherein the computer program which when executed by a processor will cause the processor to further, process the image captured by the camera to determine an offset between a predefined reference axis and an optical axis of the eye; determine from the determined offset, the direction to adjust the tilt of the eyedrop assembly to bring the predefined reference axis parallel to the optical axis of the eye;EYENEB-1-EP83 prompt the user to move the eyedrop assembly in said determined direction.

37. The computer program according to claim 36 wherein the predefined reference axis is an optical axis of the camera.

38. The computer program according to claim 36 wherein the predefined reference axis is an axis of the spray nozzle which extends in the direction of spray of the spray nozzle.

39. The computer program according to claim 38 wherein the predefined reference axis is an axis of the spray nozzle, which extends from a centre of an opening of the spray nozzle through which fluid is sprayed, in the direction of spray of the spray nozzle.

40. The computer program according to any one of the preceding claims wherein the computer program which when executed by a processor will cause the processor to further, process the image captured by the camera to determine a rotation of the portable electronic device and / or the eyedrop assembly about a predefined reference axis; determine from the determined rotation a direction to rotate the eyedrop assembly to bring the portable electronic device and / or the eyedrop assembly into a predefined orientation; prompt the user to move the eyedrop assembly in said determined direction.41.The computer program according to claim 40 wherein the predefined orientation is a vertical orientation.

42. The computer program according to claim 40 or 41 wherein the predefined reference axis is an optical axis of the camera.EYENEB-1-EP8443. The computer program according to any one of the preceding claims, wherein the portable electronic device comprises an accelerometer, and wherein the computer program which when executed by a processor will cause the processor to, receive an output of the accelerometer which indicates a tilt of the portable electronic device and / or a tilt of the eyedrop assembly about one or more reference axes; determine from the received output of the accelerometer a direction to move the eyedrop assembly so that portable electronic device and / or the eyedrop assembly is parallel to a coronal plane of a face depicted in the image captured by the camera; prompt the user to move the eyedrop assembly in said determined direction.

44. The computer program according to any one of the preceding claims, wherein the image captured by the camera depicts a face, and wherein the computer program which when executed by a processor will cause the processor to, process the captured image to determine an angle between a plane of the portable electronic device and a coronal plane of the face depicted in the image; determine from the determined angle a direction to move the eyedrop assembly so that the plane of the portable electronic device is parallel to the coronal plane of the face depicted in the image; prompt the user to move the eyedrop assembly in said determined direction.

45. The computer program according to any one of the preceding claims, wherein the portable electronic device comprises a depth sensor, and wherein the image captured by the camera depicts a face, and wherein the computer program which when executed by a processor will cause the processor to, receive an output of the depth sensor which indicates the distance of the camera to a plurality of points depicted in the image; determine from the received output of the depth sensor an angleEYENEB-1-EP85 between a plane of the portable electronic device and a coronal plane of the face; determine from the determined angle a direction to move the eyedrop assembly so that the plane of the portable electronic device is parallel to the coronal plane of the face; prompt the user to move the eyedrop assembly in said determined direction.

46. The computer program according to any one of the preceding claims, wherein the computer program which when executed by a processor will cause the processor to, carry out segmentation of the image captured by the camera, to form a segmented image.

47. The computer program according to claim 46, wherein the computer program which when executed by a processor will cause the processor to, use the segmented image to identify predefined regions of the eye.

48. The computer program according to claim 47, wherein the computer program which when executed by a processor will cause the processor to, select a predefined region of the eye, or, receive as an input a selection of a predefined region of the eye; and determine from the image the direction to move the eyedrop assembly so that the spray nozzle is aligned with said selected predefined region of the eye.

49. The computer program according to claim 48, wherein the computer program which when executed by a processor will cause the processor to, prompt the user in which direction to move the eyedrop assembly so that the spray nozzle is aligned with the selected predefined region of the eye.

50. The computer program according to any one of claims 47-49 wherein the predefined regions comprise at least one or more of, the iris, pupil, sclera.EYENEB-1-EP8651.The computer program according to any one of the preceding claims wherein the portable electronic device comprises a plurality of cameras, and wherein the computer program which when executed by a processor will cause the processor to, selectively operate one of the plurality of cameras to capture an image of the eye.

52. The computer program according to claim 51, wherein the computer program which when executed by a processor will cause the processor to, operate a first camera of the portable electronic device to capture one or more images of the eye until the eyedrop assembly has been moved to a position in which the spray nozzle is aligned with the eye; and operate a second camera to capture one or more images of the eye after the spray nozzle has been aligned with the eye.

53. The computer program according to claim 52, wherein the computer program which when executed by a processor will cause the processor to operate a second camera to capture one or more images of the eye, after the spray nozzle has been aligned with the eye, and during when the processor initiates the eye drop sprayer device to spray fluid from the spray nozzle.

54. The computer program according to any one of claims 51-53, wherein the plurality of cameras comprise one or more of, a wide angle camera, a video camera for monitoring the eye image, a time of flight camera, an infrared camera.

55. The computer program according to any one of the preceding claims, wherein the prompt is a prompt for the user to move the eyedrop assembly to the left or to the right.

56. The computer program according to any one of the preceding claims, wherein the prompt is a prompt for the user to move the eyedrop assembly further away, or closer to the eye.EYENEB-1-EP8757. The computer program according to any one of the preceding claims, wherein the prompt is a prompt for the user to rotate eyedrop assembly.

58. The computer program according to any one of the preceding claims, wherein the prompt is a prompt for the user to adjust the tilt of eyedrop assembly.

59. The computer program according to any one of the preceding claims, wherein the prompt is in the form of text displayed on a display screen of the portable electronic device.

60. The computer program according to any one of the preceding claims wherein the prompt comprises a haptic prompt.

61. The computer program according to claim 60 wherein the haptic prompt is a vibration of the portable electronic device.

62. The computer program according to any one of the preceding claims wherein the prompt comprises an audio prompt.

63. The computer program according to any one of the preceding claims wherein the computer program which when executed by a processor will cause the processor to further, detect if the eye drop sprayer device is correctly connected to the portable electronic device to form the eye drop assembly; and initiate a display of a first signal which indicates if the eye drop sprayer device is correctly connected to the portable electronic device, or, initiate the display of a second signal which indicates if the eye drop sprayer device is incorrectly connected to the portable electronic device.

64. The computer program according to claim 63 wherein the portable electronic device comprises a port and the eye drop sprayer device comprises a plug, and wherein the eye drop sprayer device connects to theEYENEB-1-EP88 portable electronic device by insertion of the plug into the port; wherein the computer program which when executed by a processor will cause the processor to further, detect if the plug of the eye drop sprayer device is correctly inserted into the port of the portable electronic device; and initiate a display of the first signal which indicates if the plug of the eye drop sprayer device is correctly inserted into the port of the portable electronic device, or, initiate the display of the second signal which indicates if the plug of the eye drop sprayer device is not correctly inserted into the port of the portable electronic device.

65. The computer program according to claim 63 or 64 wherein the computer program which when executed by a processor will cause the processor to initiate the portable electronic device to display the first signal, or, initiate the portable electronic device to display the second signal.

66. The computer program according to claim 65 wherein, the first signal is a message displayed on a display screen of the portable electronic device indicating that the eye drop sprayer device is correctly connected to a port of the portable electronic device; the second signal is a message on the display screen of the portable electronic device indicating that the eye drop sprayer device is not correctly connected to a port of the portable electronic device.

67. The computer program according to claim 63 or 64 wherein the computer program which when executed by a processor will cause the processor to initiate the eye drop sprayer device to display the first signal, or, initiate the eye drop sprayer device to display the second signal.

68. The computer program according to claim 67 wherein, the first signal is the activation of a first coloured light on eye drop sprayer device; the second signal is the activation of a second coloured light on eyeEYENEB-1-EPdrop sprayer device, wherein the first coloured light is a different colour to the second coloured light.

69. The computer program according to any one of the preceding claims wherein the fluid comprises a medication.

70. The computer program according to any one of the preceding claims wherein the portable electronic device is a smartphone.

71. A portable electronic device having a memory which stores a computer program according to any one of the preceding claims.EYENEB-1-EP

Images