Computer program to assist a user in aligning a spray nozzle of an eye drop sprayer with an eye

Abstract

According to the invention there is provided a computer program stored on a portable electronic device (4) for assisting a user in aligning a spray nozzle (3) of an eye drop sprayer device (2) with an eye, the portable electronic device having a processor (6) and a camera (5a, 5b); and wherein the portable electronic device (4) is connectable with the eye drop sprayer device (2) having the spray nozzle (3) to form an eye drop assembly (1), wherein the portable electronic device (4) and the eye drop sprayer device (2) are in a predetermined orientation relative to each other when connected to form the eye drop assembly (1); and wherein the eye drop sprayer device (2) contains a fluid; and wherein the computer program, when executed by the processor (6), will cause the processor (6) to: use an image captured by the camera (5a, 5b) of the portable electronic device (4) to determine a direction in which to move the eye drop assembly (1) so that the spray nozzle (3) is aligned with the aforementioned eye, wherein at least a part of the image depicts the eye; prompt the user to move the eye drop assembly (1) in the aforementioned determined direction. Further provided is a portable electronic device having a memory storing the computer program.

Description

Technical Field

[0001] This invention relates to a computer program for assisting a user in aligning the nozzle of an eye drop sprayer with their eye. The computer program is stored on a portable electronic device having a processor and a camera; this portable electronic device can be connected to an eye drop sprayer device having a spray nozzle to form an eye drop assembly. A further provision provides a portable electronic device having the aforementioned computer program stored in the memory of the portable electronic device. Background Technology

[0002] Applying fluids (such as eye drops or other ophthalmic medications) directly to the eye presents numerous challenges: Typically, the fluid is contained in a plastic bottle with a dispensing nozzle; the user must tilt their head back, align the nozzle with their eye, and hold this position until the fluid drop falls into the eye. Users often lack the dexterity to tilt their head back; and / or they often lack the fine motor skills to precisely align the nozzle with their eye; therefore, the fluid drop may not be successfully delivered to the user's eye.

[0003] Failure to deliver fluid drops to the user's eyes not only results in insufficient dosage but also in significant fluid waste.

[0004] In addition, there is a risk that the user may move the bottle too close to their eyes, causing the dispensing nozzle to come into contact with their eyes or eyelids, resulting in eye or eyelid injury and / or eye contamination. If the dispensing nozzle comes into contact with the user's eyes or eyelids, it can also cause contamination of the dispensing nozzle.

[0005] In addition, users need to count the number of drops dispensed from the nozzle to ensure that the exact number of drops is applied to the eye, thus ensuring that the correct dose of fluid is delivered to the eye. Users often fail to count the number of drops dispensed from the nozzle, resulting in the incorrect dose of fluid being applied to the eye.

[0006] Furthermore, the rate at which drops are dispensed from the nozzle is typically determined by how much the user squeezes the plastic bottle; if the user squeezes the bottle too much, this can result in a large number of drops being dispensed rapidly from the nozzle, leading to the application of too much fluid to the eye (i.e., overdose). Depending on the type of fluid (e.g., the ingredients of the ophthalmic medication), applying too many drops / too much fluid to the eye can cause discomfort and / or pain, or in the worst case, eye damage.

[0007] Furthermore, for some fluids, delivery to the pupil, iris, or sclera of the eye is necessary; this means that for successful application, the fluid drops dispensed from the nozzle must be delivered into an open eye. For such fluids, the timing of dispensing the fluid drops from the nozzle is critical, as the eyelids must be open when the drops reach the eye. Delivering drops into an open eye is difficult, especially for users lacking hand dexterity or fine motor skills. Additionally, some users may have a very sensitive or exaggerated blinking reflex, making delivery to their open eyes even more difficult. Other users may suffer from blepharospasm or reflex tearing, further complicating delivery to their open eyes or causing the fluid drops to remain in the eye.

[0008] In other cases, users deliver fluids to the eyes of other people / animals. For example, caregivers (such as parents, nurses, nursing staff, and / or doctors) often need to deliver fluids to the eyes of children, patients, or the elderly. Delivering fluids to the eyes of other people / animals using existing manual techniques is more difficult because caregivers cannot control the eyes of other people / animals or predict their eye reactions or activities.

[0009] "Smart" fluid sprayers are known, in which the sprayer device is linked to a portable electronic device, for example, via Bluetooth. These smart fluid sprayers transmit data captured by the smart fluid sprayer to a remote server. It is also known that the sprayer is automatically triggered to spray fluid after successful alignment with the eye. However, none of these existing technologies teach the use of a camera and processor from a portable electronic device (such as a smartphone) connected to the sprayer device to assist the user in aligning the nozzle of the sprayer device with the eye.

[0010] The object of this invention is to mitigate or significantly mitigate at least some of the problems present in current practice with manual techniques for applying fluids to the eyes. In particular, one object of this invention is to provide a computer program set on a portable electronic device (such as a smartphone) connected to a sprayer device, which assists the user in aligning the spray nozzle of the sprayer device with the eye. Summary of the Invention

[0011] The present invention relates to a computer program having the features described in independent claim 1.

[0012] In this invention, a computer program is installed on a portable electronic device (such as a smartphone) connected to an eye drop sprayer to form an eye drop assembly. When executed by a processor, the computer program causes the processor of the portable electronic device to use an image (preferably a facial image) captured by the camera of the portable electronic device to determine in which direction the eye drop assembly should be moved so that the spray nozzle of the eye drop sprayer is aligned with the eye. The program also prompts the user to move the eye drop assembly in the determined direction, thereby achieving the purpose of assisting the user in aligning the spray nozzle of the sprayer with the eye.

[0013] The dependent claims describe optional features of various embodiments of the invention. It should be understood that any feature described subsequently may be an optional feature of any embodiment described herein. Even if a feature is described herein as a feature of an embodiment, it should be understood that the feature may be an optional feature of any other embodiment of the invention. Any embodiment disclosed herein may have any one or more features of any other embodiment disclosed herein.

[0014] In a preferred embodiment, the computer program, when executed by the processor, causes the processor to: trigger the eye drop spray device to spray fluid through the spray nozzle when the spray nozzle of the eye drop spray device is aligned with the eye. The computer program, when executed by the processor, can cause the processor to: detect when the spray nozzle of the eye drop spray device is aligned with the eye; and, in response to detecting that the spray nozzle of the eye drop spray device is aligned with the eye, trigger the eye drop spray device to spray fluid through the spray nozzle. Advantageously, in this preferred embodiment, the fluid is applied to the eye at the moment the spray nozzle is aligned with the eye.

[0015] According to an embodiment of the present invention, a computer program stored on a portable electronic device is provided for assisting a user in aligning the spray nozzle of an eye drop spray device with the eye. The portable electronic device has a processor and a camera. The portable electronic device can be connected to an eye drop spray device having a spray nozzle to form an eye drop assembly. When the portable electronic device and the eye drop spray device are connected to form the eye drop assembly, the portable electronic device and the eye drop spray device are in a predetermined orientation relative to each other. The eye drop spray device contains fluid. When executed by the processor, the computer program causes the processor to: use an image captured by the camera of the portable electronic device to determine a direction for moving the eye drop assembly such that the spray nozzle is aligned with the eye, wherein at least a portion of the image depicts the eye; and prompt the user to move the eye drop assembly in the determined direction.

[0016] In an embodiment, when executed by a processor, the computer program will cause the processor to: use the image to determine the position of the spray nozzle relative to the eye; and use the determined position of the spray nozzle relative to the eye to determine the orientation of the aforementioned movable eye drop assembly, such that the spray nozzle is aligned with the eye.

[0017] In one embodiment, the portable electronic device includes a touchscreen, and the eye drop sprayer includes a stylus with a tip, the stylus tip being in a predetermined fixed position relative to the sprayer nozzle, and wherein, when the portable electronic device and the eye drop sprayer assembly are connected to form an eye drop assembly, the stylus contacts the touchscreen of the portable electronic device, and wherein, when executed by a processor, the computer program further causes the processor to: receive the position of the stylus tip contacting the touchscreen as input; use the input and the image to determine the position of the sprayer nozzle relative to the eye; and use the determined position of the sprayer nozzle relative to the eye to determine the direction of the movement of the eye drop assembly such that the spray nozzle is aligned with the eye.

[0018] In one embodiment, the portable electronic device includes a memory storing a predetermined fixed position of a stylus tip relative to a spray nozzle, wherein a computer program, when executed by a processor, causes the processor to determine the position of the spray nozzle relative to the eye by: determining first position data using the aforementioned input, the first position data being the position of the stylus tip relative to a camera; retrieving the predetermined fixed position of the stylus tip relative to the spray nozzle from the memory of the portable electronic device; determining second position data using the first position data and the retrieved predetermined fixed position of the stylus tip relative to the spray nozzle, the second position data being the position of the spray nozzle relative to the camera; determining third position data using the image, the third position data being the position of the camera relative to the eye; and determining the position of the spray nozzle relative to the eye using the second position data and the third position data.

[0019] In an embodiment, when executed by a processor, the computer program will cause the processor to: use the image to determine the position of the camera relative to the eye; and use the determined position of the camera relative to the eye to determine the orientation of the aforementioned movable eye drop assembly, such that the spray nozzle is aligned with the eye.

[0020] In one embodiment, the portable electronic device includes a touchscreen, and the eye drop sprayer includes a stylus with a tip, the stylus tip being in a predetermined fixed position relative to the sprayer nozzle, and wherein, when the portable electronic device and the eye drop sprayer assembly are connected to form an eye drop assembly, the stylus contacts the touchscreen of the portable electronic device, and wherein, when executed by a processor, the computer program further causes the processor to: receive the position of the stylus tip contacting the touchscreen as input; use the input and the image to determine the position of a camera relative to the eye; and use the determined position of the camera relative to the eye to determine the direction of the movement of the eye drop assembly such that the spray nozzle is aligned with the eye.

[0021] In one embodiment, the portable electronic device includes a memory storing a predetermined fixed position of a stylus tip relative to a spray nozzle, and wherein, when executed by a processor, a computer program causes the processor to: determine first position data using the aforementioned input, the first position data being the position of the stylus tip relative to a camera; retrieve the predetermined fixed position of the stylus tip relative to the spray nozzle from the memory of the portable electronic device; determine second position data using the first position data and the retrieved predetermined fixed position of the stylus tip relative to the spray nozzle, the second position data being the position of the spray nozzle relative to the camera; determine a reference position using the second position data, wherein the reference position is the relative position of the camera to the eye, at which the spray nozzle would be aligned with the eye; determine third position data using an image captured by the camera, wherein the third position data is the position of the camera relative to the eye; and compare the third position data with the reference position to determine a direction for moving the eye drop assembly such that the camera reaches the reference position and the spray nozzle is aligned with the eye.

[0022] In one embodiment, the portable electronic device includes a display screen, and wherein, when the eye drop spray device is connected to the portable electronic device in a first predetermined configuration, the spray nozzle points in the same direction as the direction the display screen faces.

[0023] In this embodiment, the eye is a third party's eye; and the portable electronic device includes a touchscreen; the eye drop sprayer includes a stylus with a tip, the stylus tip being in a predetermined fixed position relative to the sprayer nozzle; and when the eye drop sprayer device is connected to the portable electronic device in a first predetermined configuration, the stylus contacts the touchscreen of the portable electronic device; the eye drop sprayer device is connected to the portable electronic device such that the spray nozzle points in the same direction as the display screen; and the computer program, when executed by the processor, further causes the processor to: receive the position of the stylus tip contacting the touchscreen as input; use the input and the retrieved predetermined fixed position of the stylus tip relative to the sprayer nozzle to determine first position data, wherein the first position data is if the eye drop sprayer device and the portable electronic device... When connected in a second predetermined configuration, the spray nozzle will have a position relative to the camera, wherein, in the second predetermined configuration, the eye drop spray device is connected to the portable electronic device such that the spray nozzle points in the opposite direction to the direction the display screen is facing; a first position data is used to determine a reference position, wherein the reference position is the relative position of the camera relative to the eye, at which the spray nozzle will be aligned with the eye; when the eye drop spray device and the portable electronic device are connected in the second predetermined configuration, an image captured by the camera is used to determine second position data, wherein the image depicts a third-party eye, wherein the second position data is the position of the camera relative to the third-party eye; the second position data is compared with the reference position to determine the direction of moving the eye drop assembly such that the camera reaches the reference position and the spray nozzle is aligned with the third-party eye.

[0024] In this embodiment, the eye is a third party's eye; and the portable electronic device includes a touchscreen; the eye drop sprayer includes a stylus with a tip, the stylus tip being in a predetermined fixed position relative to the sprayer nozzle; and when the eye drop sprayer device is connected to the portable electronic device in a first predetermined configuration, the stylus contacts the touchscreen of the portable electronic device; the eye drop sprayer device is connected to the portable electronic device such that the spray nozzle points in the same direction as the display screen; and the computer program, when executed by the processor, further causes the processor to: receive the position of the stylus tip contacting the touchscreen as input; use the input and the retrieved predetermined fixed position of the stylus tip relative to the sprayer nozzle to determine first position data, wherein the first position data is if the eye drop sprayer device... When the device and the portable electronic device are connected in a second predetermined configuration, the position of the spray nozzle relative to the camera is as follows: In the second predetermined configuration, the eye drop spray device is connected to the portable electronic device such that the spray nozzle points in the opposite direction to the direction the display screen faces; When the eye drop spray device and the portable electronic device are connected in the second predetermined configuration, an image captured by the camera is used to determine second position data, wherein the image depicts a third-party eye, and the second position data is the position of the camera relative to the third-party eye; First position data and second position data are used to determine third position data, the third position data being the position of the spray nozzle relative to the eye belonging to the third party; The determined position of the spray nozzle relative to the eye is used to determine the direction of moving the eye drop assembly such that the spray nozzle is aligned with the third-party eye.

[0025] In one embodiment, when executed by a processor, the computer program further instructs the processor, after determining the first location data, to prompt the user to connect the portable electronic device and the eye drop spray device in a second predetermined configuration.

[0026] In one embodiment, the computer program, when executed by the processor, further enables the processor to detect when the eye drop spray device and the portable electronic device are connected in a second predetermined configuration.

[0027] In an embodiment, when executed by a processor, the computer program further causes the processor to receive an instruction as input, which is an instruction about whether the fluid is to be applied to the user's own eyes or to a third party's eyes.

[0028] In one embodiment, the computer program, when executed by the processor, further causes the processor to trigger the eye drop spray device to spray fluid from the spray nozzle when the spray nozzle is aligned with the eye.

[0029] In one embodiment, when executed by a processor, the computer program further causes the processor to: receive at least a second image captured by a camera of a portable electronic device as input, wherein at least a portion of the captured second image depicts an eye; and use the at least second image to detect when a spray nozzle is aligned with the eye.

[0030] In one embodiment, when executed by a processor, the computer program causes the processor to: detect whether the user has failed to align the spray nozzle with their eyes within a predetermined time period; and, in response to detecting that the user has failed to align the spray nozzle with their eyes within the predetermined time period, send an alarm to a remote server or platform.

[0031] In an embodiment, when executed by a processor, the computer program further causes the processor to: receive at least a second image depicting the eye as input, the second image being captured by a camera of a portable electronic device when the eye drop assembly is in a position where the spray nozzle is aligned with the user's eye; determine, based on the received at least the second image, when the eye is open; and when the eye is open, trigger the eye drop spray device to spray fluid from the spray nozzle.

[0032] In an embodiment, when executed by a processor, the computer program causes the processor to: receive multiple images captured by a camera of a portable electronic device as input; determine the blinking frequency of the eyes based on the input; use the determined blinking frequency to determine the time when the eyes are expected to open; and trigger an eye drop spray device at the determined time to spray fluid, such that fluid is sprayed from the spray nozzle when the eyes are expected to open.

[0033] In an embodiment, when executed by a processor, the computer program further causes the processor to: receive at least a third image depicting the eye as input, the third image being captured by a camera at a moment corresponding to the triggering of the eye drop spray device to eject fluid from the spray nozzle; and determine, based on the at least third image, whether the eye is closed when the fluid reaches the user's eye.

[0034] In one embodiment, the computer program, when executed by the processor, further instructs the processor to: prompt the user to align the spray nozzle with the eye if, based on at least a third image, the eye is closed when the fluid reaches it.

[0035] In an embodiment, when executed by a processor, the computer program further causes the processor to: receive at least a second image depicting the eye as input, the second image being captured by a camera of a portable electronic device when the eye drop assembly is in a position where the spray nozzle is aligned with the user's eye; determine, based on the received at least the second image, when the eye is closed; and when the eye is closed, trigger the eye drop spray device to spray fluid from the spray nozzle.

[0036] In an embodiment, when executed by a processor, the computer program further causes the processor to: receive at least a third image depicting the eye as input, the third image being captured by a camera at a moment corresponding to the triggering of the eye drop spray device to eject fluid from the spray nozzle; and determine, based on the at least third image, whether the eye is open when the fluid reaches the user's eye.

[0037] In one embodiment, the computer program, when executed by the processor, further instructs the processor to: prompt the user to align the spray nozzle with the eye if, based on at least a third image, the eye opens when the fluid reaches it.

[0038] In an embodiment, the computer program, when executed by the processor, will further cause the processor to: receive a signal from the eye drop spray device indicating that fluid is to be applied to an open or closed eye; or receive input from the user indicating that fluid is to be applied to an open or closed eye.

[0039] In an embodiment, when executed by a processor, the computer program further causes the processor to: perform any of the above steps when a received signal indicates that fluid should be applied to open eyes, or when a user inputs that fluid should be applied to open eyes; and / or when a received signal indicates that fluid should be applied to closed eyes, or when a user inputs that fluid should be applied to closed eyes.

[0040] In an embodiment, when executed by a processor, the computer program further causes the processor to: receive at least a second image as input, the second image being captured by a camera when the eye drop assembly is in a position where the spray nozzle is aligned with the eye, and process the received at least the second image to detect whether an obstacle is covering the eye.

[0041] In one embodiment, the computer program, when executed by the processor, further instructs the processor to: if an obstacle is detected covering the eyes, provide a prompt to remove the obstacle.

[0042] In an embodiment, the obstacle includes at least one of glasses, eye mask, and / or bandage.

[0043] In one embodiment, the received image depicts the user's face, and wherein the computer program, when executed by the processor, causes the processor to apply a mesh model to the image captured by the camera.

[0044] In an embodiment, when executed by a processor, the computer program further instructs the processor to: use a mesh model to determine the location of the depicted eye in the captured image; and use the determined location of the depicted eye in the captured image to determine the position of the camera relative to the user's eye.

[0045] In an embodiment, when executed by a processor, the computer program further instructs the processor to: process the image captured by the camera to determine the distance between a predetermined reference and the eye; prompt the user to move the eye drop assembly closer to the eye, or prompt the user to move the eye drop assembly away from the eye, until the distance between the predetermined reference and the eye is equal to the predetermined distance.

[0046] In this embodiment, the predetermined reference is a spray nozzle through which fluid is sprayed.

[0047] In this embodiment, the predetermined reference is a camera.

[0048] In one embodiment, the portable electronic device includes a time-of-flight camera.

[0049] In this embodiment, the predetermined reference is a time-of-flight camera.

[0050] In an embodiment, when executed by a processor, the computer program further instructs the processor to: process an image captured by a camera to determine an offset between a predetermined reference axis and the optical axis of the eye; determine, based on the determined offset, a direction for adjusting the tilt of the eye drop assembly so that the predetermined reference axis is parallel to the optical axis of the eye; and prompt the user to move the eye drop assembly in the determined direction.

[0051] In this embodiment, the predetermined reference axis is the optical axis of the camera.

[0052] In an embodiment, the predetermined reference axis is the axis of the spray nozzle that extends in the spray direction of the spray nozzle.

[0053] In an embodiment, the predetermined reference axis is an axis of the spray nozzle extending from the center of the opening of the spray nozzle in the spray direction of the spray nozzle, through which fluid is sprayed.

[0054] In an embodiment, when executed by a processor, the computer program further causes the processor to: process an image captured by a camera to determine the rotation of the portable electronic device and / or the eye drop assembly about a predetermined reference axis; determine, based on the determined rotation, the direction of rotation of the eye drop assembly, which causes the portable electronic device and / or the eye drop assembly to a predetermined orientation; and prompt the user to move the eye drop assembly in the determined direction.

[0055] In this embodiment, the predetermined orientation is a vertical orientation.

[0056] In this embodiment, the predetermined reference axis is the optical axis of the camera.

[0057] In one embodiment, the portable electronic device includes an accelerometer, and wherein, when executed by a processor, the computer program causes the processor to: receive the output of the accelerometer, which indicates the tilt of the portable electronic device and / or the tilt of the eye drop assembly about one or more reference axes; determine, based on the received accelerometer output, a direction for moving the eye drop assembly such that the portable electronic device and / or the eye drop assembly are parallel to the coronal plane of the face depicted in an image captured by a camera; and prompt the user to move the eye drop assembly in the direction determined above.

[0058] In one embodiment, the image captured by the camera depicts a face, and wherein, when executed by the processor, the computer program causes the processor to: process the captured image to determine an angle between the plane of the portable electronic device and the coronal plane of the face depicted in the image; determine, based on the determined angle, a direction for moving the eye drop assembly such that the plane of the portable electronic device is parallel to the coronal plane of the face depicted in the image; and prompt the user to move the eye drop assembly in the determined direction.

[0059] In one embodiment, the portable electronic device includes a depth sensor, and wherein an image captured by a camera depicts a face, and wherein a computer program, when executed by a processor, causes the processor to: receive the output of the depth sensor, which indicates the distance from the camera to a plurality of points depicted in the image; determine, based on the received output of the depth sensor, an angle between the plane of the portable electronic device and the coronal plane of the face; determine, based on the determined angle, a direction for moving the eye drop assembly such that the plane of the portable electronic device is parallel to the coronal plane of the face; and prompt the user to move the eye drop assembly in the determined direction.

[0060] In one embodiment, when executed by a processor, the computer program causes the processor to segment the image captured by the camera to form a segmented image.

[0061] In one embodiment, when executed by a processor, the computer program causes the processor to: use the segmented image to identify a predetermined region of the eye.

[0062] In an embodiment, when executed by a processor, the computer program will cause the processor to: select a predetermined area of ​​the eye or receive the selection of a predetermined area of ​​the eye as input; and determine, based on the image, the direction of the moving eye drop assembly such that the spray nozzle is aligned with the selected predetermined area of ​​the eye.

[0063] In one embodiment, when executed by a processor, the computer program will prompt the processor to: instruct the user in which direction to move the eye drop assembly so that the spray nozzle is aligned with a predetermined area of ​​the selected eye.

[0064] In an embodiment, the predetermined region includes at least one or more of the iris, pupil, and sclera.

[0065] In one embodiment, the portable electronic device includes multiple cameras, and wherein a computer program, when executed by a processor, causes the processor to selectively operate one of the multiple cameras to capture an image of the eye.

[0066] In one embodiment, when executed by a processor, the computer program causes the processor to: operate a first camera of the portable electronic device to capture one or more images of the eye until the eye drop assembly has been moved to a position where the spray nozzle is aligned with the eye; and after the spray nozzle has been aligned with the eye, operate a second camera to capture one or more images of the eye.

[0067] In one embodiment, the computer program, when executed by the processor, causes the processor to: operate a second camera to capture one or more images of the eye after the spray nozzle has been aligned with the eye and while the processor triggers the eye drop sprayer device to spray fluid from the spray nozzle.

[0068] In an embodiment, the plurality of cameras mentioned above includes one or more of a wide-angle camera, a video camera for monitoring eye images, a time-of-flight camera, and an infrared camera.

[0069] In this embodiment, the above prompt is used to guide the user to move the eye drop assembly to the left or right.

[0070] In an embodiment, the above prompt is for the user to further move the eye drop assembly away from or closer to the eye.

[0071] In this embodiment, the above prompt is a prompt for the user to rotate the eye drop assembly.

[0072] In this embodiment, the above prompt is a prompt for the user to adjust the tilt of the eye drop assembly.

[0073] In this embodiment, the above prompt is in the form of text displayed on the screen of the portable electronic device.

[0074] In this embodiment, the above-mentioned prompts include tactile prompts.

[0075] In one embodiment, the tactile cues are vibrations from the portable electronic device.

[0076] In this embodiment, the above prompts include audio prompts.

[0077] In an embodiment, when executed by a processor, the computer program further causes the processor to: detect whether the eye drop spray device is correctly connected to the portable electronic device to form the eye drop assembly; and trigger the display of a first signal or trigger the display of a second signal, the first signal indicating whether the eye drop spray device is correctly connected to the portable electronic device, and the second signal indicating whether the eye drop spray device is incorrectly connected to the portable electronic device.

[0078] In one embodiment, the portable electronic device includes a port, and the eye drop spray device includes a plug, wherein the eye drop spray device is connected to the portable electronic device by inserting the plug into the port; wherein, when executed by a processor, the computer program further causes the processor to: detect whether the plug of the eye drop spray device is correctly inserted into the port of the portable electronic device; and trigger the display of either the first signal or the second signal, the first signal indicating whether the plug of the eye drop spray device is correctly inserted into the port of the portable electronic device, and the second signal indicating whether the plug of the eye drop spray device is not correctly inserted into the port of the portable electronic device.

[0079] In one embodiment, when executed by a processor, the computer program causes the processor to either trigger the portable electronic device to display the first signal or trigger the portable electronic device to display the second signal.

[0080] In one embodiment, the first signal is a message displayed on the screen of the portable electronic device indicating that the eye drop spray device is correctly connected to the port of the portable electronic device; the second signal is a message displayed on the screen of the portable electronic device indicating that the eye drop spray device is not correctly connected to the port of the portable electronic device.

[0081] In an embodiment, when executed by a processor, the computer program will cause the processor to either trigger the eye drop spray device to display the first signal or trigger the eye drop spray device to display the second signal.

[0082] In one embodiment, the first signal is the activation of a first colored light source on the eye drop sprayer device; the second signal is the activation of a second colored light source on the eye drop sprayer device, wherein the color of the first colored light source is different from the color of the second colored light source.

[0083] In this embodiment, the fluid includes a drug.

[0084] According to another aspect of the present invention, a portable electronic device is provided, which has the aforementioned computer program stored in the memory of the portable electronic device. Attached Figure Description

[0085] Exemplary embodiments of the invention are disclosed in this specification, some of which are referenced in the following figures: Figure 1 A portable electronic device is shown, which is connected to an eye drop sprayer device having a spray nozzle to form an eye drop assembly; and the eye drop assembly is positioned such that the spray nozzle is aligned with the user's eye; Figure 2 A grid model is shown, which is applied to images captured by a camera of a portable electronic device in order to identify the location of eyes in the captured images; Figure 3a An example is shown prompting the user to move the eye drop assembly to the left; Figure 3b An example is shown prompting the user to move the eye drop assembly to the right; and Figure 3c This example shows a message that can be displayed on a screen to notify the user that the spray nozzle has been successfully aligned with their eyes; Figure 4a An example is shown prompting the user to move the eye drop container closer to the eye; Figure 4b An example is shown that prompts the user to move the eye drop container away from the eye; Figure 5 The diagram illustrates a first signal triggered by a computer program if the eye drop spray device is correctly connected to the portable electronic device, and a second signal triggered by a computer program if the eye drop spray device is not correctly connected to the portable electronic device. Detailed Implementation

[0086] Unless otherwise defined in the specification, or unless the specific context indicates or requires otherwise, the following terms or expressions used herein shall generally be interpreted as set forth in this section: The words “comprising,” “including,” and “containing,” as well as similar expressions, shall be interpreted in an open-ended and inclusive manner as “including, but not limited to,” in this specification and claims. Conversely, the terms “consisting of,” “comprises of,” and “forms of” as used herein are so-called closed-ended languages, meaning that only the mentioned components exist.

[0087] The terms “a” or “an” do not exclude multiple; that is, the singular forms “a,” “an,” and “the” should be understood to include the plural referent unless the context clearly indicates or requires otherwise. In other words, all references to the singular feature or limitation in this disclosure should include the corresponding plural feature or limitation, and vice versa, unless otherwise expressly stated or implied to the contrary in the context of the reference. The terms “a,” “an,” and “the” therefore have the same meaning as “at least one” or “one or more”, unless otherwise defined.

[0088] The terms "an embodiment," "an embodiment," "specific embodiment," etc., mean a particular feature, property, or characteristic, or a specific combination or combination of features, properties, or characteristics, as mentioned in the corresponding description, present in at least one embodiment of the invention. These descriptions appearing in different places throughout the specification do not necessarily refer to the same embodiment. Furthermore, in one or more embodiments, a particular feature, property, or characteristic may be combined in any suitable manner.

[0089] According to a first aspect of the invention, a computer program stored on a portable electronic device is provided for assisting a user in aligning the spray nozzle of an eye drop spray device with the eye. The portable electronic device has a processor and at least one camera. The portable electronic device can be connected to an eye drop spray device having a spray nozzle to form an eye drop assembly. When the portable electronic device and the eye drop spray device are connected to form the eye drop assembly, the portable electronic device and the eye drop spray device are in a predetermined orientation relative to each other. The eye drop spray device is configured to contain fluid. When executed by the processor, the computer program causes the processor to: use an image captured by the camera of the portable electronic device to determine a direction for moving the eye drop assembly such that the spray nozzle is aligned with the eye, wherein at least a portion of the image depicts the eye; and prompt the user to move the eye drop assembly in the determined direction. In an embodiment, the processor receives the captured image from the camera.

[0090] It should be understood that any feature described subsequently may be an optional feature. Even if a feature is described in this disclosure as a feature of an embodiment, it should be understood that the feature may be an optional feature of any other embodiment of the invention. Any embodiment disclosed in this disclosure may have any one or more features of any other embodiment disclosed in this disclosure.

[0091] The fluid preferably includes liquids and / or semi-solid formulations and / or semi-solid mixtures.

[0092] Unless otherwise stated, the term "fluid" as used herein should be understood in a broad sense and means that a fluid can be a liquid or liquid composition comprising a liquid carrier or solvent and at least one other component dissolved or dispersed (e.g., in the form of a suspension or colloidal dispersion). In some embodiments, a fluid can be a physiologically acceptable fluid, such as a cosmetically or pharmaceutically acceptable fluid, preferably a pharmaceutically acceptable fluid. In some embodiments, a fluid can be an aqueous liquid or liquid composition comprising at least one of excipients and an active pharmaceutical ingredient, such as an ophthalmic active pharmaceutical ingredient. Unless otherwise stated, the term "excipient" as used herein refers to a substance formulated in a pharmaceutical composition together with the active pharmaceutical ingredient, including, for example, salts, preservatives, antioxidants, buffers or pH adjusters, thickeners, tension modifiers, surfactants, adjuvants, colorants, etc.

[0093] Unless otherwise stated, the term "active pharmaceutical ingredient" (API) as used herein refers to a compound or combination of compounds that has pharmaceutical activity against an undesirable condition (of the subject). In certain embodiments, the fluid may be an ophthalmologically acceptable liquid for application (in an ophthalmic manner) to the ocular surface, as described above. In certain embodiments, the fluid may be a liquid provided in a sterile form to be applied to the subject's body surface (specifically, to the ocular surface).

[0094] In some embodiments, the fluid or active pharmaceutical ingredient optionally contained in a fluid to be dispensed by the device according to the invention is suitable for the prevention, delay or treatment of an ophthalmic disease or condition, and is suitable for topical application to the eyes of a subject requiring topical application.

[0095] In some embodiments, the fluid may contain a physiologically or pharmaceutically acceptable solvent for topical application, such as water, alcohols, such as ethanol, 2-propanol (isopropanol), glycerol or benzyl alcohol, ethylene glycol, especially 1,2-propanediol (propylene glycol), polyethylene glycol, mineral oil, paraffin, isopropyl myristate, oleic acid, etc. In a further embodiment, the fluid may contain ophthalmologically acceptable solvents such as water, ethanol, glycerin, 1,2-propanediol, propylene glycol, polyethylene glycol, mineral oil, linseed oil, castor oil, or mixtures thereof (e.g., compositions sometimes referred to as "artificial tears," which may include modifiers such as carboxymethyl cellulose (CMC), hydroxypropyl methylcellulose (hydroxypropyl methylcellulose), hydroxyethyl cellulose, methylcellulose, dextran 70, gelatin, glycerin, polyethylene glycol (300, 400), polysorbate 80, polyvinyl alcohol, and / or polyvinylpyrrolidone (povidone)). The solvent may be in the form of an aqueous mixture or solution, or in a non-aqueous form.

[0096] The term "eye" as used in this article preferably refers to the eyes of humans or animals, preferably warm-blooded animals, and especially human eyes.

[0097] The term "portable electronic device" as used herein may also be interpreted broadly, and unless otherwise stated, the term may refer to any of the following: smartphone, tablet computer, (handheld) game console, basic telephone, flip phone, slider phone, QWERTY phone, rugged phone, phablet, folding phone, netbook, laptop computer, digital media player, handheld personal computer, wearable computer, or smartwatch, etc., preferably smartphone or tablet computer, especially smartphone.

[0098] Eye drop sprayers can take any suitable form. An eye drop sprayer can be any device capable of dispensing fluid; the fluid can be a liquid or semi-solid formulation / mixture. An eye drop sprayer can be configured to dispense fluid in the form of coarse droplets, and / or can be configured to dispense fluid in the form of fine droplets (e.g., in the form of a mist), for example, it can be a fine droplet micromist sprayer, and / or can be configured to dispense fluid in the form of a predetermined amount of liquid flow (e.g., a fine stream). In a preferred embodiment, an eye drop sprayer can be configured to dispense a fluid volume in the range of 1-50 ml / cl, more preferably in the range of 5-25 ml / cl, and most preferably in the range of 10-20 ml / cl. An eye drop sprayer can be configured to dispense fluid by any suitable means; for example, an eye drop sprayer can be configured to dispense fluid by mechanical and / or electromechanical means.

[0099] The spray nozzle of an eye drop spritz can take any suitable form. For example, the spray nozzle can be a tip, a simple opening, a functional structure, or an outlet valve. For example, the spray nozzle can be a truncated conical member or a conical member with a central opening through which fluid can be dispensed. In embodiments, the spray nozzle may include electromechanical components (e.g., a vibrating mesh, and / or an ultrasonic jetting system, and / or an electro-jetting system). In embodiments, the spray nozzle may include a mechanical system comprising a single-outlet nozzle or a multi-outlet nozzle (e.g., the Raleigh principle). In embodiments, the spray nozzle may include a nozzle with impact characteristics (e.g., an impact or a baffle). In embodiments, the spray nozzle may include a multi-compound nozzle (e.g., a nozzle having an outlet from which liquid is dispensed and another outlet from which gas is dispensed, wherein the gas can be used to support delivery / distance / jetting performance).

[0100] Figure 1A perspective view of an eye drop assembly 1 is provided. The eye drop assembly 1 includes an eye drop sprayer device 2 having a spray nozzle 3. The eye drop sprayer device 2 is connected to a portable electronic device 4. It should be understood that the eye drop sprayer device 2 and the portable electronic device 4 are detachably connected to each other; in other words, the portable electronic device 4 and the eye drop sprayer device 2 can be selectively connected to or disconnected from each other.

[0101] The portable electronic device 4 includes at least one camera 5a, 5b, a processor 6, and a memory 7. Preferably, as Figure 1 In the example shown, the portable electronic device 4 includes at least two cameras 5a and 5b; specifically, in Figure 1 In the example shown, the portable electronic device 4 includes a first camera 5a facing a first direction and a second camera 5b facing the opposite second direction. More specifically, the portable electronic device 4 includes a front-facing camera 5a and a rear-facing camera 5b. A processor 6 is preferably operatively connected to the at least one camera 5a, 5b and a memory 7. In this embodiment, the processor 6 is operatively connected to the first camera 5a, the second camera 5b, and the memory 7.

[0102] The portable electronic device 4 also includes a display screen 8. The display screen 8 is configured as a touchscreen 8 (i.e., configured to have touchscreen functionality). In this application, the terms "display screen 8" and "touchscreen 8" are used interchangeably as they refer to the same part of the portable electronic device 4. Images captured by the front-facing camera 5a and / or the rear-facing camera 5b of the portable electronic device 4 are displayed on the display screen 8.

[0103] It should be noted that the first camera 5a (front-facing camera 5a) faces the same direction as the display screen 8. The second camera 5b (rear-facing camera 5b) faces the opposite direction to the display screen 8. In other words, the "first direction" facing the first camera 5a (front-facing camera 5a) is defined as the direction facing the display screen 8, and the "second direction" facing the second camera 5b (rear-facing camera 5b) is defined as the opposite direction to the direction facing the display screen 8. In this application, the first camera 5a will be referred to as the front-facing camera 5a, and the second camera 5b will be referred to as the rear-facing camera 5b.

[0104] The front-facing camera 5a and the rear-facing camera 5b can take any suitable form. The front-facing camera 5a and the rear-facing camera 5b can be the same type of camera or different types of cameras; in other words, the front-facing camera 5a can be a first-type camera, and the rear-facing camera 5b can be a second-type camera, different from the first type. The front-facing camera 5a can include a wide-angle camera, a narrow-angle camera, a video camera, a time-of-flight camera, or an infrared camera. The rear-facing camera 5b can include a wide-angle camera, a narrow-angle camera, a video camera, a time-of-flight camera, or an infrared camera.

[0105] As an alternative to a portable electronic device 4 having two cameras 5a and 5b, i.e., as an alternative to a portable electronic device 4 having a separate front camera 5a and a rear camera 5b, the portable electronic device 4 may include a single camera that can be selectively configured to face a first direction or a second direction. In other words, alternatively, the portable electronic device 4 may include a single camera that can be selectively configured as a front camera or a rear camera.

[0106] Portable electronic device 4 may include multiple cameras. In addition to the front-facing camera 5a and the rear-facing camera 5b, portable electronic device 4 may also include one or more additional cameras. For example, portable electronic device 4 may further include a time-of-flight camera. Portable electronic device 4 may include one or more of a wide-angle camera, a video camera, a time-of-flight camera, and an infrared camera.

[0107] exist Figure 1 In the example shown, the portable electronic device 4 is a smartphone 4. However, it should be understood that the portable electronic device 4 is not limited to a smartphone, and can take any suitable form, such as a smartphone, or tablet computer, or (handheld) game console, or basic telephone, or flip phone, or slider phone, or QWERTY phone, or rugged phone, or phablet, or folding phone, or netbook, or laptop computer, or digital media player, or handheld personal computer, or wearable computer, or smartwatch, etc., preferably a smartphone or tablet computer, especially a smartphone.

[0108] The eye drop spray device 2 is configured to store fluid to be sprayed into the eye. For example, the eye drop spray device 2 may include a disposable cartridge containing fluid; the cartridge can be inserted into the eye drop spray device 2 and arranged to selectively connect fluidly to the spray nozzle 3. When the disposable cartridge is empty, the empty cartridge can be removed from the eye drop spray device 2 and replaced with another new disposable cartridge filled with fluid, thereby allowing the eye drop spray device 2 to be reused. In other embodiments, the cartridge is fixed in the eye drop spray device 2 and can be refilled.

[0109] The eye drop spray device 2 also includes a stylus 9 having a tip 9a. The stylus 9 (or more specifically, the tip 9a of the stylus 9) and the spray nozzle 3 are in a fixed predetermined position relative to each other.

[0110] It should be understood that the eye drop spray device 2 can be selectively connected to the portable electronic device 4 in either a first predetermined configuration or a second predetermined configuration.

[0111] In a first predetermined configuration, the eye drop spray device 2 is connected to the portable electronic device 4 such that the spray nozzle 3 points in the same direction as the display screen 8. In an embodiment, in the first predetermined configuration, the eye drop spray device 2 is connected to the portable electronic device 4 such that the spray nozzle 3 points in the same direction as the front-facing camera 5a (i.e., the spray nozzle 3 faces the first direction). In other words, when the eye drop spray device 2 is connected to the portable electronic device 4 in the first predetermined configuration, the spray direction of the spray nozzle 3 is along the first direction. Figure 1 An eye drop spray device 2 is shown connected to a portable electronic device 4 in a first predetermined configuration.

[0112] In the second predetermined configuration, the eye drop spray device 2 is connected to the portable electronic device 4 such that the spray nozzle 3 points in the opposite direction to the direction facing the display screen 8. In an embodiment, in the second predetermined configuration, the eye drop spray device 2 is connected to the portable electronic device 4 such that the spray nozzle 3 points in the same direction as the direction facing the rear camera 5a (i.e., the spray nozzle 3 faces the second direction). In other words, when the eye drop spray device 2 is connected to the portable electronic device 4 in the second predetermined configuration, the spray direction of the spray nozzle 3 is along the second direction.

[0113] The eye drop spray device 2 is configured such that when the portable electronic device 4 is connected to the eye drop spray device 2 in a first predetermined configuration, the tip 9a of the stylus 9 will contact the touch screen 8 of the portable electronic device 4.

[0114] When the portable electronic device 4 and the eye drop spray device 2 are properly connected to form the eye drop assembly 1, the portable electronic device 4 and the eye drop spray device 2 will preferably be in a predetermined orientation relative to each other. Preferably, when the portable electronic device 4 and the eye drop spray device 2 are connected to (preferably mechanically and electrically) the portable electronic device 4, the eye drop spray device 2 will be connected to (preferably mechanically and electrically) the portable electronic device 4. Figure 1In the example shown, the portable electronic device 4 includes a port 22, which is an electrical port; the eye drop spray device 2 includes a plug member 31, which can be selectively inserted into the port 22 of the portable electronic device 4, such that the portable electronic device 4 and the eye drop spray device 2 are connected to form an eye drop assembly 1. The portable electronic device 4 has its own power source 30 (such as a battery 30). In this example, once the plug member 31 of the eye drop spray device 2 is selectively inserted into the port 22 of the portable electronic device 4, the eye drop spray device 2 and the portable electronic device 4 are immediately electrically connected to each other, and the portable electronic device 4 provides power to the eye drop spray device 2 via this electrical connection. In other words, in this example, the eye drop spray device 2 does not require its own power supply; instead, the eye drop spray device 2 is powered by the power source (e.g., a battery) of the portable electronic device 4. In other embodiments, the eye drop spray device 2 may include its own power source. In other embodiments, the connection between the eye drop spray device 2 and the portable electronic device 4 will be purely mechanical. In other embodiments, the connection between the eye drop spray device 2 and the portable electronic device 4 will be purely electrical, connecting the eye drop spray device 2 to the power source of the portable electronic device 4, such that the connection allows the eye drop spray device 2 to be powered solely by the power source of the portable electronic device 4. In other embodiments, the connection between the eye drop spray device 2 and the portable electronic device 4 will be purely communicative (wired or wireless), allowing the eye drop spray device 2 to communicate with the portable electronic device 4 (e.g., sending and receiving data / information / signals to and from the portable electronic device 4). In embodiments, the eye drop spray device 2 will be connected (preferably mechanically and electrically) to a USB port or a lighting port of the portable electronic device 4. In any of the foregoing embodiments, where the eye drop spray device 2 is electrically connected to the portable electronic device 4, data / information / signals can communicate between the eye drop spray device 2 and the portable electronic device 4 (e.g., between the eye drop spray device 2 and the processor 6 of the portable electronic device 4) via this electrical connection. In other embodiments, the eye drop spray device 2 is mechanically connected to the portable electronic device 4, but not electrically; in this embodiment, the eye drop spray device 2 may be wirelessly connected to the portable electronic device 4, and communication between the eye drop spray device 2 and the portable electronic device 4 may be conducted through this wireless connection.It should be understood that the eye drop spray device 2 can be mechanically connected to the portable electronic device 4 using any suitable means. For example, the eye drop spray device 2 may include a non-conductive plug member (or a conductive plug member) that can be received in a port of the portable electronic device 4 to mechanically connect the eye drop spray device 2 to the portable electronic device 4.

[0115] In this example, the memory 7 of the portable electronic device 4 stores a computer program according to an embodiment of the present invention; the computer program can be executed by the processor 6. When executed by the processor, the computer program will cause the processor to: receive an image captured by the front camera 5a and / or the rear camera 5b of the portable electronic device 4, wherein at least a portion of the image depicts an eye; use the image to determine the direction of moving the eye drop assembly 1 such that the spray nozzle 3 is aligned with the eye; and prompt the user to move the eye drop assembly 1 in the determined direction. One or more prompts may be provided.

[0116] like Figure 1 As shown, during use, the user 10 will connect the portable electronic device 4 to the eye drop sprayer device 2 in a first predetermined configuration, such that the spray nozzle 3 points in the same direction as the front-facing camera 5a (i.e., the spray nozzle 3 faces the first direction). Once connected in the first predetermined configuration, the tip 9a of the stylus 9 will contact the touchscreen 8 of the portable electronic device 4.

[0117] In this specific example, user 10 wishes to apply fluid from eye drop spray device 2 to their own eye 11. The computer program of the present invention can be used to assist user 10 in aligning the spray nozzle 3 of eye drop spray device 2 with their own eye 11. Figure 1 As shown, when using the eye drop assembly 1 to apply fluid from the eye drop sprayer device 2 to one's own eye 11, the portable electronic device 4 should be connected to the eye drop sprayer device 2 in a first predetermined configuration. However, as will be described later in other embodiments, the computer program of the present invention can also be used to assist the user 10 in aligning the spray nozzle 3 of the eye drop sprayer 2 with the eye of a third party (such as the eye of another person (e.g., the eye of a patient, or the eye of an animal)).

[0118] In one embodiment, when executed by processor 6, the computer program causes processor 6 to: detect whether the eye drop spray device 2 is correctly connected to the portable electronic device 4; and trigger the display of a first signal and a second signal, the first signal indicating whether the eye drop spray device 2 is correctly connected to the portable electronic device 4, and the second signal indicating whether the eye drop spray device 2 is incorrectly connected to the portable electronic device 4. In another embodiment, when executed by processor 6, the computer program causes processor 6 to: detect whether the eye drop spray device 2 is correctly connected to port 22 of the portable electronic device 4; and trigger the display of a first signal and a second signal, the first signal indicating whether the eye drop spray device 2 is correctly connected to port 22, and the second signal indicating whether the eye drop spray device 2 is incorrectly connected to the port of the portable electronic device 4. In this application, "correctly connected" means connected in a predetermined manner; preferably, the eye drop spray device 2 is "correctly connected" to the portable electronic device 4 when the plug 31 of the eye drop spray device 2 is in a predetermined position in port 22 of the portable electronic device 4 (i.e., when the plug 31 is correctly inserted into port 22).

[0119] In one embodiment, when executed by the processor 6, the computer program causes the processor 6 to: trigger the portable electronic device 4 to display a first signal, and trigger the portable electronic device 4 to display a second signal. For example, the first signal may be a message (e.g., a text message) displayed on the display screen 8 of the portable electronic device 4 indicating that the eye drop spray device 2 is correctly connected to the port 22 of the portable electronic device 4; and the second signal may be a message (e.g., a text message) displayed on the display screen 8 of the portable electronic device 4 indicating that the eye drop spray device 2 is not correctly connected to the port 22 of the portable electronic device 4. In other embodiments, when executed by the processor, the computer program causes the processor 6 to: trigger the eye drop spray device 2 to display a first signal, and trigger the eye drop spray device 2 to display a second signal. For example, the first signal may be the activation of a first colored light source on the eye drop spray device 2; and the second signal may be the activation of a second colored light source on the eye drop spray device 2, wherein the first colored light source and the second colored light source are different colors.

[0120] Figure 5 An embodiment is shown in which the computer program, when executed by the processor 6, causes the processor 6 to: trigger both the portable electronic device 4 and the eye drop spray device 2 to display a corresponding first signal when the eye drop spray device 2 is correctly connected to the portable electronic device 4; and trigger both the portable electronic device 4 and the eye drop spray device 2 to display a corresponding second signal when the eye drop spray device 2 is not correctly connected to the portable electronic device 4.

[0121] Specifically, in Figure 5 In the example shown, when executed by the processor 6, the computer program will further cause the processor 6 to: detect whether the plug 31 of the eye drop spray device 2 is correctly connected to the port 22 of the portable electronic device 4 (e.g., detect whether the plug 31 is in a predetermined position in the port 22); and if the plug 31 is correctly connected to the port 22 (e.g., if the plug 31 is in the aforementioned predetermined position in the port 22), trigger the portable electronic device 4 to display a first signal, in the form of the text “Connection successful” 25 on the display screen 8, and trigger the eye drop spray device 2 to display a first signal, in the form of the activation of a first colored light source 24 (e.g., a “green” light source) on the eye drop spray device 2. When executed by the processor 6, the computer program will further cause the processor 6 to: trigger the portable electronic device 4 to display a second signal, in the form of the text "Connection unsuccessful" 27 on the display screen 8, and trigger the eye drop spray device 2 to display a second signal, in the form of the activation of the second colored light source 26 (e.g., an "orange" light source) on the eye drop spray device 2, if the plug 31 is not properly connected to the port 22 (e.g., if the plug 31 is not in the aforementioned predetermined position in the port 22), and trigger the eye drop spray device 2 to display a second signal, in the form of the activation of the second colored light source 26 (e.g., an "orange" light source) on the eye drop spray device 2.

[0122] Return to reference Figure 1 Since, in this particular example, the user 10 wishes to apply the fluid from the eye drop spray device 2 to their own eye 11, after correctly connecting the eye drop spray device 2 to the portable electronic device 4 in the first predetermined configuration, the user arranges the eye drop assembly 1 such that the front-facing camera 5a faces their face, as shown below. Figure 1 As shown. In this position, since the eye drop spray device 2 and the portable electronic device 4 are connected in a first predetermined configuration, the spray nozzle 3 will be pointed at the user 10.

[0123] The front-facing camera 5a of the portable electronic device 4 is then operated to capture images (or multiple images, such as video), wherein at least a portion of the captured images (or multiple images, such as video) depicts the eyes 11 of the user 10. In a preferred embodiment, the front-facing camera 5a of the portable electronic device 4 is operated to capture multiple images (such as video (i.e., an image stream)), each image depicting the user's eyes. The images or multiple images (such as video) captured by the front-facing camera 5a are displayed on the display screen 8 of the portable electronic device 4, making them visible to the user.

[0124] In a first embodiment, when executed by processor 6, the computer program causes processor 6 to: determine the position of front-facing camera 5a relative to the user's eye 11 using images (or multiple images (e.g., video)) captured by front-facing camera 5a; and determine the direction of moving eye drop assembly 1 such that spray nozzle 3 is aligned with the eye using the determined position of front-facing camera 5a relative to the eye 11. The images (or multiple images (e.g., video)) captured by front-facing camera 5a depict the user's eye.

[0125] As described above, when the portable electronic device 4 and the eye drop spray device 2 are connected in a first predetermined configuration, the tip 9a of the stylus 9 contacts the touchscreen of the portable electronic device 4; and the position of the tip 9a of the stylus 9a relative to the spray nozzle 3 is fixed. Preferably, in the first embodiment, the memory 7 of the portable electronic device 4 has stored a predetermined fixed position of the tip 9a of the stylus 9a relative to the spray nozzle 3, and stores a computer program that, when executed by the processor 6, will preferably cause the processor 6 to: (a) The position of the tip 9a of the stylus 9 on the touch screen 8 in contact with the touch screen 8 is received as input; (b) Using the input received above, a first position data is determined, which is the position of the tip 9a of the stylus 9 relative to the front camera 5a; (c) Retrieve from the memory 7 of the portable electronic device 4 the predetermined fixed position of the tip 9a of the stylus 9 relative to the spray nozzle 9; (d) Using the first position data and the predetermined fixed position of the tip 9a of the stylus 9 retrieved above relative to the spray nozzle 3, the second position data is the position of the spray nozzle 3 relative to the front camera 5a. (e) Use second position data to determine a reference position, wherein the reference position is the relative position of the front camera 5a with respect to the eye 11, at which the spray nozzle 3 will be aligned with the eye 11; (f) Using images (or multiple images (e.g., video) captured by the front camera 5a) to determine third position data, wherein the third position data is the position of the front camera 5a relative to the eye 11; (g) The third position data is compared with the reference position to determine the direction of the moving eye drop assembly 1, so that the front camera 5a reaches the reference position, where the spray nozzle 3 is aligned with the eye 11.

[0126] Preferably, in the first embodiment, when the computer program is executed by the processor 6, the processor 6 will further prompt the user to move the eye drop assembly 1 in the direction determined above, so that the user 10 knows in which direction he should move the eye drop assembly 1 so that the spray nozzle 3 is aligned with the eye 11.

[0127] Preferably, in the first embodiment, the computer program, when executed by the processor 6, causes the processor 6 to: detect when the spray nozzle 3 is aligned with the eye 11. Preferably, in the first embodiment, the computer program, when executed by the processor 6, causes the processor 6 to: detect when the front-facing camera 5a reaches a reference position. By detecting when the front-facing camera 5a reaches the reference position, the processor 6 detects whether / when the spray nozzle 3 is aligned with the eye 11. Preferably, the computer program, when executed by the processor 6, causes the processor 6 to repeat at least the above-described series of steps (f)-(g) until the processor 6 detects when the spray nozzle 3 is aligned with the eye 11 (i.e., until the processor 6 detects that the front-facing camera 5a has reached the reference position).

[0128] Preferably, when executed by the processor 6, the computer program further causes the processor 6 to trigger the eye drop spray device 2 when the spray nozzle 3 is aligned with the eye 11, so as to spray fluid from the spray nozzle 3. Therefore, the fluid will be applied to the user 10's eye 11 at the moment the spray nozzle 3 is aligned with the eye 11. Preferably, when executed by the processor 6, the computer program further causes the processor 6 to use an image (or multiple images, such as video) captured by the front-facing camera 5a to detect when the spray nozzle 3 is aligned with the eye 11. In this embodiment, when executed by the processor 6, the computer program causes the processor 6 to detect when the front-facing camera 5a reaches a reference position. By detecting when the front-facing camera 5a reaches the reference position, the processor 6 detects whether / when the spray nozzle 3 is aligned with the user 10's eye 11. In response to detecting that the front-facing camera 5a has reached the reference position, the processor 6 triggers the eye drop spray device 2 to spray fluid from the spray nozzle 3.

[0129] Preferably, in the first embodiment, when executed by the processor 6, the computer program causes the processor 6 to determine third position data by processing images (or multiple images (e.g., video)) captured by the front-facing camera 5a, the third position data being the position of the front-facing camera 5a relative to the eye 11. Image processing techniques known in the art can be used to process the images (or multiple images (e.g., video) captured by the front-facing camera 5a) to determine the third position data. For example, such as... Figure 2As shown, in an embodiment, in order to identify the location of the user 10's eyes 11 in an image (or multiple images (e.g., video)) captured by the front-facing camera 5a, the computer program, when executed by the processor 6, causes the processor 6 to: (a) apply a mesh model 35 to an image 36 captured by the front-facing camera 5a; (b) use the mesh model 35 to determine the position of the user 10's eyes 11' depicted in the captured image 36; and (c) use the determined position of the eyes 11' depicted in the captured image 36 to determine the position of the front-facing camera 5a relative to the user 10's eyes 10. Preferably, for step (c), the computer program, when executed by the processor 6, causes the processor 6 to receive an image of the user's face captured by the front-facing camera 5a; and to calculate the position of the front-facing camera 5a relative to the user's eyes using a predetermined distance value, which represents a predetermined distance (preferably a predetermined horizontal distance) between the user's eyes. The predetermined distance value, representing a predetermined distance (preferably a predetermined horizontal distance) between the user's eyes, is used by the processor 6 as a reference scale to allow the processor to determine the distance between features depicted in the image captured by the front camera, and thus allow the processor to determine the position of the front camera 5a relative to the user's eyes 10 based on the aforementioned image.

[0130] In this embodiment, when executed by processor 6, the computer program causes processor 6 to determine third position data by: receiving an image of the user's face captured by front-facing camera 5a; and using a predetermined distance value representing a predetermined distance (preferably a predetermined horizontal distance) between the user's eyes as a reference scale to allow the processor to determine the position of front-facing camera 5a relative to the user's eyes 10 based on the image captured by front-facing camera 5a. In this embodiment, it is assumed that the distance between the user's eyes is a fixed constant for all users (i.e., the predetermined distance value (preferably a predetermined horizontal distance) between the eyes is the same fixed predetermined constant for all users, which is used as a reference scale by the processor); in other words, in this embodiment, once the first predetermined distance is determined, it does not need to be determined again because the computer program uses the same predetermined distance value for all users. The predetermined distance value can be determined by determining the distance between the grid vertices of the user's eyes depicted in the image of the user's face captured by front-facing camera 5a. The predetermined distance value can be pre-established based on, for example, human morphological studies.

[0131] In an embodiment, when executed by processor 6, the computer program causes processor 6 to calculate at least a second predetermined distance value (e.g., the diameter of the iris of the eye). This second predetermined distance value (e.g., the diameter of the iris of the eye) can be used as a reference scale (i.e., to allow distance calibration), even if the image captured by the front-facing camera only depicts one eye of the user. Preferably, when executed by processor 6, the computer program causes processor 6 to calculate at least a second predetermined distance value (e.g., the diameter of the iris of the eye) based on images depicting both eyes, such that a first predetermined distance value (i.e., a predetermined horizontal distance between the user's eyes) can be used as a reference scale when determining the second predetermined distance value. It is assumed that the second predetermined distance value is a fixed constant across all users; in other words, for all users, the second predetermined distance value is the same fixed predetermined constant, which is used by the processor as a reference scale. If the second predetermined distance value is, for example, the diameter of the iris of the eye, then the second predetermined distance value can be used by processor 6 as a reference scale to allow processor 6 to determine the position of the front-facing camera 5a relative to the eye 10 of user 10 based on images depicting only one eye of the user. The second predetermined distance value (e.g., the diameter of the iris of the eye) is used by the processor 6 as a reference scale to allow the processor to determine the distance between features depicted in the image captured by the front camera 5a, and thus allow the processor 6 to determine the position of the front camera 5a relative to the eyes 10 of the user 10 based on the aforementioned image.

[0132] The processor 6 can use a first predetermined distance value (which in this example is a predetermined horizontal distance between the eyes) as a first reference scale to determine the position of the front-facing camera 5a relative to the user 10's eyes 10 based on an image depicting the user's eyes; and the processor 6 can use a second predetermined distance value (which in this example is the diameter of the iris) as a second reference scale to allow the processor to determine the position of the front-facing camera 5a relative to the user 10's eyes 10 based on an image captured by the front-facing camera 5a depicting only one of the user's eyes. Most preferably, the second predetermined distance value is determined based on an image from which the first predetermined distance value can be used as a reference scale (i.e., the processor 6 determines the second predetermined distance value based on an image depicting the user's eyes (so that the horizontal distance between the eyes can be measured from the image); the first predetermined distance value (e.g., the predetermined horizontal distance between the eyes) is then used as a reference scale to enable the determination of the second predetermined distance value (e.g., the diameter of the iris) based on the image.

[0133] For all users, the second predetermined distance value is the same fixed predetermined constant, which is used by the processor as a reference scale; in other words, in the embodiment, once the second predetermined distance is determined, it does not need to be determined again, because the computer program uses the same second predetermined distance value for all users.

[0134] It should be understood that any number of different predetermined reference values ​​can be determined. In another embodiment, the software may use other predetermined distance values ​​as reference scales. For example, in other embodiments, when processing images captured by the front-facing camera 5a to determine the position of the front-facing camera 5a relative to an eye belonging to a third party, the processor 6 uses the triangular distance between the eyes and the mouth as a reference scale. In other embodiments, the portable electronic device may further include a calibration gauge.

[0135] In another embodiment, when executed by processor 6, the computer program causes processor 6 to determine the position of the front-facing camera 5a relative to the eyes 10 of user 10 using a qualitative distance measurement method based on the image captured by the front-facing camera 5a. For example, when executed by processor 6, the computer program causes processor 6 to: detect the user's eyes in the image captured by the front-facing camera 5a; and create a grid on the detected eyes in the image. When executed by processor 6, the computer program causes processor 6 to determine (e.g., count) the number of pixels within the grid (i.e., determine (e.g., count) the number of pixels in the image that constitute a depiction of the eyes). The number of pixels defines an area of ​​the eye surface. When executed by processor 6, the computer program causes processor 6 to use the determined eye surface area to determine the position of the front-facing camera 5a relative to the eyes 10 of user 10. At the predetermined eye surface area, the spray device delivers fluid to the eyes. Preferably, users with smaller eyes should place the spray device closer to their eyes to deliver fluid; users with larger eyes will benefit from placing the spray device further away from their eyes.

[0136] In this embodiment, the stylus 9 with the tip 9a is not mounted on the eye drop sprayer device 2 (or is mounted but not used). In this embodiment, steps (a)-(c) above can be omitted. When executed by the processor 6, the computer program will preferably cause the processor 6 to use a predetermined size of the portable electronic device 4 to determine second position data, which is stored in memory accessible to the processor 6. For example, in this embodiment, when the eye drop sprayer device 2 is connected in a first predetermined configuration, the spray nozzle 3 will have a predetermined position relative to the front-facing camera 5a; this predetermined position of the spray nozzle 3 relative to the front-facing camera 5a is stored in memory, and when executed by the processor 6, the computer program will preferably cause the processor 6 to retrieve the predetermined position from memory, wherein the retrieved predetermined position defines the second position data. Then, when executed by the processor 6, the computer program will preferably cause the processor 6 to use the retrieved predetermined position to perform steps (e) and (g) above.

[0137] In another embodiment, steps (a)-(e) are omitted; in this embodiment, a predetermined reference position is stored in memory, which is the relative position of the front-facing camera 5a with respect to the eye 11, at which the spray nozzle 3 will be aligned with the eye 11; when executed by the processor 6, the computer program will preferably cause the processor 6 to retrieve the predetermined reference position from the memory. Then, when executed by the processor 6, the computer program will cause the processor 6 to use the retrieved predetermined reference position to perform steps (f) and (g) described above.

[0138] In the second embodiment, when executed by the processor, the computer program will cause the processor to: use the image (or multiple images (e.g., video) captured by the front-facing camera 5a) to determine the position of the spray nozzle 3 relative to the user's eye 11; and use the determined position of the spray nozzle 3 relative to the eye 11 to determine the direction of the moving eye drop assembly 1, such that the spray nozzle 3 is aligned with the eye. The image (or multiple images (e.g., video)) captured by the front-facing camera 5a depicts the user's eye.

[0139] As described above, when the portable electronic device 4 and the eye drop spray device 2 are connected in a first predetermined configuration, the tip 9a of the stylus 9 contacts the touchscreen of the portable electronic device 4; and the position of the tip 9a of the stylus 9a relative to the spray nozzle 3 is fixed. Preferably, in the second embodiment, the memory 7 of the portable electronic device 4 stores the predetermined fixed position of the tip 9a of the stylus 9a relative to the spray nozzle 3, and preferably, when the computer program is executed by the processor 6, the processor 6 will preferably: (a) The position of the tip 9a of the stylus 9 on the touch screen 8 in contact with the touch screen 8 is received as input; (b) Using the input received above, a first position data is determined, which is the position of the tip 9a of the stylus 9 relative to the front camera 5a; (c) Retrieve from the memory 7 of the portable electronic device 4 the predetermined fixed position of the tip 9a of the stylus 9 relative to the spray nozzle 9; (d) Using the first position data and the predetermined fixed position of the tip 9a of the stylus 9 retrieved above relative to the spray nozzle 3, the second position data is the position of the spray nozzle 3 relative to the front camera 5a. (e) Using images (or multiple images (e.g., video) captured by the front-facing camera 5a) to determine third position data, wherein the third position data is the position of the front-facing camera 5a relative to the eye 11; and (f) Using the second and third position data, a fourth position data is determined, which is the position of the spray nozzle 3 relative to the eye 11; (g) Using the position of the spray nozzle 3 relative to the eye 11 determined above, the direction of the moving eye drop assembly 1 is determined such that the spray nozzle 3 is aligned with the eye 11.

[0140] Preferably, in the second embodiment, when the computer program is executed by the processor 6, the processor 6 will further prompt the user to move the eye drop assembly 1 in the direction determined above, so that the user 10 knows in which direction he should move the eye drop assembly 1 so that the spray nozzle 3 is aligned with the eye 11.

[0141] Preferably, in the second embodiment, when executed by the processor 6, the computer program causes the processor 6 to detect whether / when the spray nozzle 3 is aligned with the eye 11. For example, when executed by the processor 6, the computer program causes the processor 6 to use second position data and third position data (wherein, in the second embodiment, the second position data is the position of the spray nozzle 3 relative to the front-facing camera 5a; and the third position data is the position of the front-facing camera 5a relative to the eye 11) to detect whether / when the spray nozzle 3 is aligned with the eye 11. Preferably, when executed by the processor 6, the computer program causes the processor 6 to repeat at least the above-described series of steps (e)-(g) until the processor 6 detects when the spray nozzle 3 is aligned with the eye 11.

[0142] Preferably, when executed by the processor 6, the computer program further causes the processor 6 to trigger the eye drop spray device 2 to spray fluid from the spray nozzle 3 when the spray nozzle 3 is aligned with the eye 11. Therefore, the fluid will be applied to the user 10's eye 11 at the moment the spray nozzle 3 is aligned with the eye 11. Preferably, when executed by the processor 6, the computer program further causes the processor 6 to use an image (or multiple images, such as video) captured by the front-facing camera 5a to detect when the spray nozzle 3 is aligned with the eye 11. Preferably, in this second embodiment, when executed by the processor 6, the computer program causes the processor 6 to use second and third position data (wherein, in this embodiment, the second position data is the position of the spray nozzle 3 relative to the front-facing camera 5a; the third position data is the position of the front-facing camera 5a relative to the eye 11) to detect whether / when the spray nozzle 3 is aligned with the eye 11. In response to detecting that the spray nozzle 3 is aligned with the eye 11, the processor 6 triggers the eye drop spray device 2 to spray fluid from the spray nozzle 3.

[0143] In this embodiment, the stylus 9 with the tip 9a is not mounted on the eye drop spray device 2 (or is mounted but not used). In this embodiment, steps (a)-(c) above are omitted. When executed by the processor 6, the computer program will preferably cause the processor 6 to use a predetermined size of the portable electronic device 4 to determine the second position data. For example, in this embodiment, when the eye drop spray device 2 is connected to the portable electronic device 4 in a first predetermined configuration, the spray nozzle 3 will have a predetermined position relative to the front-facing camera 5a; this predetermined position is stored in memory, and when executed by the processor 6, the computer program will preferably cause the processor 6 to retrieve this predetermined position from memory, wherein the retrieved predetermined position defines the second position data (wherein the second position data is the position of the spray nozzle 3 relative to the front-facing camera 5a). When executed by the processor 6, the computer program will preferably cause the processor 6 to perform steps (e) and (g) above.

[0144] The computer program of the present invention can also be used to assist the user in aligning the spray nozzle 3 of the eye drop sprayer 2 with the eye of a third party (such as the eye of a patient or animal), so that the fluid in the eye drop sprayer device 2 can be applied to the eye of the third party. In this case, the user will first connect the eye drop sprayer device 2 and the portable electronic device 4 in a first predetermined configuration.

[0145] As described above, when the portable electronic device 4 and the eye drop spray device 2 are connected in a first predetermined configuration, the tip 9a of the stylus 9 contacts the touchscreen of the portable electronic device 4; and the position of the tip 9a of the stylus 9a relative to the spray nozzle 3 is fixed. In this embodiment, the memory 7 of the portable electronic device 4 stores the predetermined fixed position of the tip 9a of the stylus 9a relative to the spray nozzle 3, and stores a computer program that, when executed by the processor 6, will cause the processor 6 to: (a) The position of the tip 9a of the stylus 9 on the touch screen 8 in contact with the touch screen 8 is received as input; (b) Retrieve from the memory 7 of the portable electronic device 4 the predetermined fixed position of the tip 9a of the stylus 9 relative to the spray nozzle 9; (d) Using the input and the predetermined fixed position of the tip 9a of the stylus 9 retrieved above relative to the spray nozzle 3, a first position data is determined, wherein the first position data is the position that the spray nozzle 3 will have relative to the rear camera 5b when the eye drop spray device 2 and the portable electronic device 4 are connected in a second predetermined configuration.

[0146] The position of the tip 9a of the stylus 9 of the input processor 6 relative to the spray nozzle is fixed, and the position of the rear camera 5b in the portable electronic device 4 is also fixed. The processor 6 will know the position of the rear camera 5b in the portable electronic device 4; at least this information is stored in memory and can be retrieved by the processor 6. In an exemplary embodiment, when executed by the processor 6, the computer program will cause the processor 6 to determine first position data by first using the input and the aforementioned retrieved predetermined fixed position of the tip 9a of the stylus 9 relative to the spray nozzle 3 to determine intermediate position data, wherein the intermediate position data is the position of the spray nozzle 3 relative to the rear camera 5b when the eye drop spray device 2 and the portable electronic device 4 are connected in a first predetermined configuration. The memory 7 of the portable electronic device 4 may store a transformation indicating how the position of the spray nozzle 9 relative to the rear camera 5b changes when the eye drop spray device 2 and the portable electronic device 4 are connected in the first predetermined configuration from the first predetermined configuration to the second predetermined configuration. In an exemplary embodiment, when executed by the processor 6, the computer program further causes the processor 6 to retrieve the transformation from memory and apply the retrieved transformation to intermediate data to determine the aforementioned first position data.

[0147] After determining the first position data (wherein the first position data is the position that the spray nozzle 3 will have relative to the rear camera 5b when the eye drop spray device 2 and the portable electronic device 4 are connected in the second predetermined configuration), the user will then connect the eye drop spray device 2 and the portable electronic device 4 in the second predetermined configuration. In an embodiment, when executed by the processor 6, the computer program will prompt the processor 6 to connect the eye drop spray device 2 and the portable electronic device 4 in the second predetermined configuration after the first position data has been determined.

[0148] In the second predetermined configuration, the tip 9a of the stylus 9 contacts the back of the portable electronic device 4. In a preferred embodiment, the position where the tip 9a of the stylus 9 on the back contacts the back corresponds to the position where the tip 9a of the stylus 9 on the touchscreen 8 contacts the touchscreen 8 when the eye drop spray device 2 and the portable electronic device 4 are connected in the first predetermined configuration.

[0149] In other embodiments, the stylus 9 with the tip 9a is not mounted on the eye drop sprayer device 2 (or is mounted but not used). In this other embodiment, steps (a)-(d) above are omitted. When executed by the processor 6, the computer program will preferably cause the processor 6 to use a predetermined size of the portable electronic device 4 to determine a reference position, wherein the reference position is the relative position of the rear camera 5b relative to an eye belonging to a third party, at which the spray nozzle 3 will be aligned with the eye. For example, in an embodiment, when the eye drop sprayer device 2 is connected to the portable electronic device 4 in a second predetermined configuration, the spray nozzle 3 will have a predetermined position relative to the rear camera 5b; this predetermined position is stored in a memory accessible to the processor 6, and when executed by the processor 6, the computer program will preferably cause the processor 6 to retrieve the predetermined position from the memory, wherein the retrieved predetermined position defines first position data (wherein the first position data is the position that the spray nozzle 3 will have relative to the rear camera 5b when the eye drop sprayer device 2 and the portable electronic device 4 are connected in the second predetermined configuration).

[0150] When executed by processor 6, the computer program causes processor 6 to: (e) use first position data to determine a reference position, wherein the reference position is the relative position of the rear camera 5b relative to an eye belonging to a third party, at which the spray nozzle 3 will be aligned with the eye. When executed, the computer program can cause processor 6 to perform step (e) described above before or after the eye drop spray device 2 and the portable electronic device 4 are connected in a second predetermined configuration.

[0151] In another embodiment, a reference position (wherein the reference position is the relative position of the rear camera 5b with respect to an eye belonging to a third party, at which the spray nozzle 3 will be aligned with the eye) is predefined and stored in a memory accessible to the processor 6. In this embodiment, steps (a)-(e) above are omitted. In this embodiment, when executed by the processor 6, the computer program will preferably cause the processor 6 to retrieve the (predetermined) reference position from the memory. The reference position may have already been determined and stored in the memory during the calibration step.

[0152] However, in the second predetermined configuration, the rear camera 5b is operated to capture images (or multiple images (e.g., video)) wherein at least a portion of the captured images (or multiple images (e.g., video)) depicts an eye belonging to a third party. In a preferred embodiment, the rear camera 5b of the portable electronic device 4 is operated to capture multiple images (e.g., video (i.e., image stream)), each depicting a third party's eye. The images (or multiple images (e.g., video)) captured by the rear camera 5b are displayed on the display screen 8 of the portable electronic device 4, thus the images (e.g., video (i.e., image stream)) captured by the rear camera 5b will be visible to a user attempting to align the spray nozzle 3 with a third party's eye.

[0153] When executed by the processor 6, the computer program will cause the processor 6 to use the image (or multiple images (e.g., video) captured by the rear camera 5b) to determine the position of the rear camera 5b relative to the third party's eye; and use the determined position of the rear camera 5b relative to the eye to determine the direction of the moving eye drop assembly 1, such that the spray nozzle 3 is aligned with the eye belonging to the third party.

[0154] Specifically, in this embodiment, when the computer program is executed by the processor 6, the processor 6 will: (f) Receive an image (or multiple images (e.g., video) captured by the rear camera 5b, which depicts an eye belonging to a third party; (g) Using images (or multiple images (e.g., video) captured by the rear camera 5b) to determine second position data, wherein the second position data is the position of the rear camera 5b relative to a third-party eye; and (h) The second position data is compared with the reference position (determined in step (e)) to determine the direction of the moving eye drop assembly 1 such that the rear camera 5b reaches the reference position, where the spray nozzle 3 is aligned with a third party's eye.

[0155] In an embodiment, when executed by the processor 6, the computer program will further prompt the processor 6 to move the eye drop assembly 1 in the aforementioned determined direction, so that the user 10 knows in which direction he should move the eye drop assembly 1 so that the spray nozzle 3 is aligned with the aforementioned third-party eye.

[0156] Preferably, when executed by the processor 6, the computer program will cause the processor 6 to detect when the rear camera 5b reaches the reference position. In this way, the processor 6 detects whether / when the spray nozzle 3 is aligned with a third party's eye. Preferably, when executed by the processor 6, the computer program will cause the processor 6 to repeat at least a series of steps (f)-(h) until the processor 6 detects when the spray nozzle 3 is aligned with the eye 11 (i.e., until the processor 6 detects that the rear camera 5b has reached the reference position).

[0157] Preferably, when executed by the processor 6, the computer program further causes the processor 6 to trigger the eye drop spray device 2 to spray fluid from the spray nozzle 3 when the spray nozzle 3 is aligned with the third party's eye. Therefore, the fluid will be applied to the third party's eye at the moment the spray nozzle 3 is aligned with the eye. Preferably, when executed by the processor 6, the computer program causes the processor 6 to use images (or multiple images, such as video) captured by the rear camera 5b to further detect when the spray nozzle 3 is aligned with the third party's eye. In this embodiment, when executed by the processor 6, the computer program causes the processor 6 to detect when the rear camera 5b reaches a reference position. By detecting when the rear camera 5b reaches the reference position, the processor 6 detects whether / when the spray nozzle 3 is aligned with the third party's eye. In response to detecting that the rear camera 5b has reached the reference position, the processor 6 triggers the eye drop spray device 2 to spray fluid from the spray nozzle 3.

[0158] In an alternative embodiment, when executed by the processor 6, the computer program causes the processor 6 to perform steps (a)–(d) described above to determine first position data (wherein, the first position data is the position that the spray nozzle 3 will have relative to the rear camera 5b when the eye drop spray device 2 and the portable electronic device 4 are connected in the second predetermined configuration). The user then connects the eye drop spray device 2 and the portable electronic device 4 in the second predetermined configuration. In this embodiment, when executed by the processor 6, the computer program causes the processor 6 to prompt the user to connect the eye drop spray device 2 and the portable electronic device 4 in the second predetermined configuration.

[0159] However, in the second predetermined configuration, the rear camera 5b is operated to capture images (or multiple images, such as video), wherein at least a portion of the captured images (or multiple images, such as video) depicts an eye belonging to a third party. In a preferred embodiment, the rear camera 5b of the portable electronic device 4 is operated to capture multiple images (such as video (i.e., an image stream)), each image depicting an eye belonging to a third party. The computer program, when executed by the processor 6, will cause the processor 6 to: (e) Using images (or multiple images (e.g., video) captured by the rear camera 5b) to determine second position data, wherein the second position data is the position of the rear camera 5b relative to an eye belonging to a third party; and (f) Using the first position data and the second position data, a third position data is determined, which is the position of the spray nozzle 3 relative to the eye belonging to a third party; (g) Using the position of the spray nozzle 3 relative to the third eye as determined above, the direction of the moving eye drop assembly 1 is determined such that the spray nozzle 3 is aligned with the eye.

[0160] Preferably, for step (e), an embodiment of the computer program, when executed by the processor 6, causes the processor 6 to determine the second position data (wherein the second position data is the position of the rear camera 5b relative to the eyes belonging to a third party) by: receiving a third-party facial image captured by the rear camera 5b; and using a predetermined distance value representing a predetermined distance (preferably a predetermined horizontal distance) between the eyes of the third parties to determine the position of the rear camera 5b relative to the eyes of the third parties. The predetermined distance value (preferably a predetermined horizontal distance) between the eyes of the third parties can be used as a reference value to determine the position of the rear camera 5b relative to the eyes of the third parties. In this embodiment, it is assumed that the distance between the eyes of the third parties is a fixed constant among all third parties (i.e., the predetermined distance value (preferably a predetermined horizontal distance) is the same fixed predetermined constant for all third parties, which is used as a reference scale by the processor); in other words, in this embodiment, once the first predetermined distance is determined, it does not need to be determined again because the computer program uses the same predetermined distance value for all third parties.

[0161] A predetermined distance value can be determined by measuring the distance between the grid vertices applied to a third-party facial image captured by the rear camera 5b. This predetermined distance value can be established in advance based on, for example, human morphological studies.

[0162] Preferably, for step (e), when executed by processor 6, the computer program causes processor 6 to: receive a user's facial image captured by rear camera 5b; and calculate the position of rear camera 5b relative to the third-party eyes using a predetermined distance value representing a predetermined distance (preferably a predetermined horizontal distance) between the third-party eyes. The predetermined distance value representing the predetermined distance (preferably a predetermined horizontal distance) between the third-party eyes is used by processor 6 as a reference scale to allow processor to determine the distance between features depicted in the image captured by rear camera 5b, and thus allow processor to determine the position of rear camera 5b relative to the third-party eyes based on the aforementioned image.

[0163] In an embodiment, when executed by processor 6, the computer program causes processor 6 to determine third position data by: receiving a third-party facial image captured by rear camera 5b; and using a predetermined distance value representing a predetermined distance (preferably a predetermined horizontal distance) between the third-party eyes as a reference scale to allow the processor to determine the position of rear camera 5b relative to the third-party eyes based on the image captured by rear camera 5b. In this embodiment, it is assumed that the distance between the third-party eyes is a fixed constant for all third parties (i.e., the predetermined distance value (preferably a predetermined horizontal distance) between the eyes is the same fixed predetermined constant for all third parties, which is used as a reference scale by the processor); in other words, in this embodiment, the computer program uses the same predetermined distance value for all third parties. The predetermined distance value can be determined by determining the distance between the mesh vertices of the third-party eyes depicted in the third-party facial image captured by rear camera 5b. The predetermined distance value can be pre-established based on, for example, human morphological studies.

[0164] In an embodiment, when executed by processor 6, the computer program causes processor 6 to calculate at least a second predetermined distance value (e.g., the diameter of the iris of the eye). This second predetermined distance value (e.g., the diameter of the iris of the eye) can be used as a reference scale (i.e., allowing distance calibration), even if the image captured by rear camera 5b only depicts a third-party monocular. Preferably, when executed by processor 6, the computer program causes processor 6 to: calculate at least a second predetermined distance value (e.g., the diameter of the iris of the eye) based on an image depicting both eyes, such that a first predetermined distance value (i.e., a predetermined horizontal distance between the third-party eyes) can be used as a reference scale when determining the second predetermined distance value. It is assumed that the second predetermined distance value is a fixed constant between all third parties; in other words, the second predetermined distance value is the same fixed predetermined constant for all third parties, which is used as a reference scale by the processor. If the second predetermined distance value is, for example, the diameter of the iris of the eye, then the second predetermined distance value can be used by processor 6 as a reference scale to allow processor 6 to determine the position of rear camera 5b relative to the third-party eye based on an image depicting only a third-party monocular. The second predetermined distance value (e.g., the diameter of the iris of the eye) is used by the processor 6 as a reference scale to allow the processor to determine the distance between features depicted in the image captured by the rear camera 5b, and thus allow the processor 6 to determine the position of the rear camera 5b relative to a third eye based on the aforementioned image.

[0165] The processor 6 can use a first predetermined distance value (in this example, a predetermined horizontal distance between the eyes) as a first reference scale to determine the position of the rear camera 5b relative to a third party's eye based on an image depicting the user's two eyes; and the processor 6 can use a second predetermined distance value (in this example, the diameter of the eye's iris) as a second reference scale to allow the processor to determine the position of the rear camera 5b relative to the third party's eye based on an image captured by the rear camera 5b depicting only the third party's monocular eye. Most preferably, the second predetermined distance value is determined based on an image from which the first predetermined distance value can be used as a reference scale, i.e., the processor 6 determines the second predetermined distance value based on an image depicting the third party's two eyes (such that the horizontal distance between the eyes can be measured from the image); the first predetermined distance value (e.g., the predetermined horizontal distance between the eyes) is then used as a reference scale to enable the determination of the second predetermined distance value (e.g., the diameter of the iris) based on the image.

[0166] For all third parties, the second predetermined distance value is the same fixed predetermined constant, which is used by the processor as a reference scale; in other words, in the embodiment, once the second predetermined distance value is determined, the computer program uses the same second predetermined distance value for all third parties.

[0167] It should be understood that any number of different predetermined reference values ​​can be determined. In another embodiment, the software may use other predetermined distance values ​​as a reference scale; for example, in another embodiment, when processing an image captured by the rear camera 5b to determine the position of the rear camera 5b relative to an eye belonging to a third party, the processor 6 uses the triangular distance between the eyes and the mouth as a reference scale. In other embodiments, the portable electronic device may further include a calibrator.

[0168] In another embodiment, when executed by processor 6, the computer program causes processor 6 to: determine the position of rear camera 5b relative to a third eye using a qualitative distance measurement method, based on an image captured by rear camera 5b. For example, when executed by processor 6, the computer program causes processor 6 to: detect a third eye in an image captured by rear camera 5b; and create a grid on the detected eye in the image. When executed by processor 6, the computer program causes processor 6 to determine (e.g., count) the number of pixels within the grid (i.e., determine (e.g., count) the number of pixels in the image that constitute a depiction of the eye). The number of pixels defines an eye surface area. When executed by processor 6, the computer program causes processor 6 to use the determined eye surface area of ​​the third eye to determine the position of rear camera 5b relative to the third eye. At the predetermined eye surface area, a jetting device delivers fluid to the eye.

[0169] Preferably, when executed by the processor 6, the computer program causes the processor 6 to detect whether / when the spray nozzle 3 is aligned with a third party's eye. In this embodiment, preferably, when executed by the processor 6, the computer program causes the processor 6 to use first position data and second position data (wherein, in this embodiment, the first position data is the position that the spray nozzle 3 will have relative to the rear camera 5b when the eye drop sprayer device 2 and the portable electronic device 4 are connected in a second predetermined configuration; the second position data is the position of the rear camera 5b relative to a third party's eye) to detect whether / when the spray nozzle 3 is aligned with a third party's eye. In this embodiment, preferably, when executed by the processor 6, the computer program causes the processor 6 to repeat at least the above-described series of steps (e)-(g) until the processor 6 detects when the spray nozzle 3 is aligned with a third party's eye.

[0170] Preferably, when executed by the processor 6, the computer program further causes the processor 6 to trigger the eye drop sprayer device 2 to spray fluid from the spray nozzle 3 when the spray nozzle 3 is aligned with the third party's eye. Therefore, the fluid will be applied to the third party's eye at the moment the spray nozzle 3 is aligned with the eye. In this embodiment, preferably, when executed by the processor 6, the computer program further causes the processor 6 to use an image (or multiple images, such as video) captured by the rear camera 5b to detect when the spray nozzle 3 is aligned with the third party's eye. In this embodiment, preferably, when executed by the processor 6, the computer program causes the processor 6 to use first position data and second position data (wherein, in this embodiment, the first position data is the position that the spray nozzle 3 will have relative to the rear camera 5b if the eye drop sprayer device 2 and the portable electronic device 4 are connected in a second predetermined configuration; the second position data is the position of the rear camera 5b relative to the third party's eye) to detect whether / when the spray nozzle 3 is aligned with the third party's eye. In response to detecting that the spray nozzle 3 is aligned with the eye 11, the processor 6 triggers the eye drop sprayer device 2 to spray fluid from the spray nozzle 3.

[0171] In any of the embodiments described in this disclosure, a computer program can assist a user in aligning the spray nozzle of an eye drop sprayer with a specific part of the eye.

[0172] In any embodiment of this disclosure, when executed by processor 6, the computer program may further cause processor 6 to: segment images (or multiple images, such as video) captured by cameras (front camera 5a and / or rear camera 5b) to provide segmented images; and use the segmented images to identify predetermined regions of the eye. The predetermined regions may include any one or more of the iris, pupil, and / or sclera.

[0173] In embodiments, when executed by processor 6, the computer program further causes processor 6 to: select a predetermined area of ​​the eye (the user's eye 11 or a third-party eye) or receive the selection of a predetermined area of ​​the eye (the user's eye 11 or a third-party eye) as input; and the alignment steps described in any embodiment herein are performed relative to the selected predetermined area of ​​the eye to assist the user in aligning the spray nozzle 3 with the selected predetermined area of ​​the eye (the user's eye 11 or a third-party eye). For example, the processor may receive user input that fluid is to be delivered to the pupil of the eye; processor 6 will segment images (or multiple images, such as video) captured by cameras (front camera 5a and / or rear camera 5b) to provide segmented images; and use the segmented images to identify the location of the pupil of the eye; processor 6 will use the identified location of the pupil of the eye to determine the direction of moving the eye drop assembly 1 such that the spray nozzle 3 is aligned with the pupil of the eye; and will prompt the user to move the eye drop assembly in the direction determined above.

[0174] In any of the embodiments described in this disclosure, the computer program, when executed by the processor 6, can cause the processor 6 to: detect whether the user has failed to align the spray nozzle 3 with their eyes (the user's eyes 11 or a third party's eyes) within a predetermined time period; and, in response to detecting that the user has failed to align the spray nozzle 3 with their eyes (the user's eyes 11 or a third party's eyes) within the predetermined time period, send an alarm to a remote server or platform. This alarm can be used to notify an administrator that the user is having difficulty successfully aligning the spray nozzle 3 with their eyes. In response to receiving the alarm, the administrator can then establish communication with the portable electronic device 4 of the eye drop assembly to provide assistance to the user.

[0175] In any embodiment of the invention, when executed by a processor, the computer program can cause the processor 6 to: determine one or more different directions for moving the eye drop assembly 1, such that the spray nozzle 3 is aligned with the eye (the user's eye 11 or a third-party eye), and / or to place the eye drop assembly 1 in a predetermined orientation relative to the eye (the user's eye 11 or a third-party eye). These directions can be linear and / or rotary.

[0176] For example, in one embodiment, the computer program, when executed by the processor, causes the processor 6 to determine whether the eye drop assembly 1 should be moved to the left or right relative to the eye so that the spray nozzle 3 is aligned with the eye. (See also...) Figure 3a and Figure 3bThe computer program has been executed by the processor 6, and the processor 6 has determined that the eye drop assembly 1 should be moved to the left so that the spray nozzle 3 is aligned with the eye 11. In this example, when executed by the processor, the computer program will cause the processor 6 to display a prompt 14 on the display screen 8 of the portable electronic device 4, in the form of the text "Move to the left". When the user follows the prompt and moves the eye drop assembly 1 in the direction indicated above, the user will move the eye drop assembly 1 toward the position where the spray nozzle 3 is aligned with the eye 11.

[0177] In this embodiment, when executed by the processor, the computer program causes the processor 6 to determine whether the spray nozzle 3 is aligned with the eye 11. In response to determining that the spray nozzle 3 is aligned with the eye 11, the processor 6 generates a message or alarm to inform the user that alignment has been successfully achieved. Figure 3c As shown, once the eye drop assembly 1 has been successfully positioned so that the spray nozzle 3 is aligned with the eye 11, a message or alarm is immediately generated to inform the user that successful alignment has been achieved. In this example, the message "Correct Position" is displayed on the display screen 8 of the portable electronic device 4, and / or a light signal (such as a green light) is displayed on the display screen 8 of the portable electronic device 4, and / or a light signal (such as the illumination of a green light source) is displayed on the eye drop sprayer device 2.

[0178] In one embodiment, when executed by a processor, the computer program further instructs the processor 6 to: process images (or multiple images (e.g., video)) captured by a camera (front camera 5a and / or rear camera 5b) to determine whether the eye drop component 1 should be moved closer to or further away from the eye so that the spray nozzle 3 reaches a position at a predetermined distance between the spray nozzle 3 and the eye. In another embodiment, when executed by the processor 6, the computer program further instructs the processor 6 to: process images (or multiple images (e.g., video)) captured by a camera (front camera 5a and / or rear camera 5b) to determine the distance between a predetermined reference and the eye (the user 10's eye 11 or a third party's eye); and to provide the user with prompts to move the eye drop component 1 closer to the eye or further away from the eye until the distance between the predetermined reference and the eye equals the predetermined distance. The predetermined reference may be the spray nozzle 3 or the camera (front camera 5a and / or rear camera 5b). The camera (front camera 5a and / or rear camera 5b) may include a time-of-flight camera, and images (or multiple images (e.g., video)) may be captured by the time-of-flight camera. The predetermined distance may be any suitable distance, for example, the predetermined distance may be 10 cm.

[0179] For example, such as Figure 4a and Figure 4bAs shown, when executed by processor 6, the computer program further instructs processor 6 to: process the image (or multiple images (e.g., video) captured by the front-facing camera 5a) to determine the distance between a predetermined reference and the eye 11; compare the determined distance with a predetermined distance; and prompt the user 10 to further move the eye drop assembly 1 away from or closer to the eye until the distance between the spray nozzle 3 and the eye 11 equals the predetermined distance. For example, the predetermined reference may be the tip of the spray nozzle 3. The predetermined distance may be any suitable distance; in a preferred embodiment, the predetermined distance is in the range of 2cm-20cm; most preferably, the predetermined distance is 10cm. Figure 4a In the example shown, processor 6 processes the image (or multiple images (e.g., video) captured by the front-facing camera 5a) and determines that the distance between the spray nozzle 3 and the eye 11 is greater than a predetermined distance (10 cm in this example); therefore, the computer program, when executed by processor 6, prompts processor 6 to provide a prompt in the form of the text "Closer" displayed on the display screen 8, so that the user moves the eye drop assembly 1 closer to the eye 11 until the distance between the spray nozzle 3 and the eye 11 equals the predetermined distance of 10 cm. Figure 4b As shown, the processor 6 processes the image (or multiple images (e.g., video) captured by the front-facing camera 5a) and determines that the distance between the spray nozzle 3 and the eye 11 is less than a predetermined distance of 10 cm; therefore, when executed by the computer program, the processor 6 provides a prompt in the form of the text "Move Back" displayed on the display screen 8, so that the user moves the eye drop assembly 1 away from the eye 11 until the distance between the spray nozzle 3 and the eye 11 is equal to the predetermined distance of 10 cm.

[0180] exist Figure 3a , Figure 3b , Figure 4a and Figure 4b In the example shown, the prompt 14 is text displayed on the display screen 8 of the portable electronic device 4. However, it should be understood that the form of the prompt 14 is not limited to text displayed on the display screen 8, and the prompt 14 can take any suitable form. For example, in an embodiment, the prompt may include a haptic prompt. A haptic prompt may be a vibration of the portable electronic device 4. In an embodiment, the prompt may include an audio prompt. The prompt may include any combination of different types of prompts. For example, the prompt may include a combination of text displayed on the display screen 8 plus an audio prompt (such as the audio of the text displayed on the display screen); or the prompt may include a combination of text displayed on the display screen 8 plus a haptic prompt (such as the vibration of the portable electronic device 4).

[0181] It should be understood that when executed by processor 6, the computer program causes the processor to perform any of the above steps on the images (or multiple images (e.g., video)) captured by the rear camera 5b. Specifically, processor 6 can perform reference... Figure 3a , Figure 3b , Figure 4a and Figure 4b Any step described.

[0182] In one embodiment, when executed by a processor, the computer program further causes the processor 6 to process images (or multiple images (e.g., video) captured by the cameras (front camera 5a and / or rear camera 5b) to determine whether the eye drop assembly 1 should be rotated or tilted to bring the eye drop assembly 1 to a predetermined orientation.

[0183] For example, in one embodiment, when executed by the processor 6, the computer program further causes the processor 6 to: process images (or multiple images (e.g., video) captured by the camera (front camera 5a and / or rear camera 5b) to determine the offset between a predetermined reference axis and the optical axis of the eye 11; and, based on the determined offset, determine the direction in which to adjust the tilt of the eye drop assembly 1 so that the predetermined reference axis is parallel to the optical axis of the eye 11; and prompt the user to move the eye drop assembly 1 in the direction determined above. In one embodiment, the predetermined reference axis may be the optical axis of the camera (front camera 5a and / or rear camera 5b); in other embodiments, the predetermined reference axis may be the axis of the spray nozzle 3 extending in the spray direction of the spray nozzle 3 (e.g., the axis of the spray nozzle 3 extending from the center of the opening of the spray nozzle 3 through which fluid is sprayed in the spray direction of the spray nozzle 3).

[0184] In other exemplary embodiments, when executed by the processor 6, the computer program further causes the processor 6 to: process images (or multiple images (e.g., video) captured by the cameras (front camera 5a and / or rear camera 5b) to determine the rotation of the portable electronic device 4 and / or the eye drop assembly 1 about a predetermined reference axis; and determine, based on the determined rotation, the direction of rotation of the eye drop assembly 1 so that the portable electronic device 1 and / or the eye drop assembly 1 is in a vertical orientation; and prompt the user to move the eye drop assembly 1 in the determined direction. In one embodiment, the predetermined reference axis may be the optical axis of the camera (front camera 5a and / or rear camera 5b) of the portable electronic device 4.

[0185] In an embodiment, the portable electronic device 4 may further include an accelerometer, and wherein images (or multiple images (e.g., videos)) captured by a camera (front camera 5a and / or rear camera 5b) further depict the face; and the computer program, when executed by a processor, may cause the processor to: receive the output of the accelerometer, which indicates the tilt of the portable electronic device 4 about one or more reference axes and / or the tilt of the eye drop assembly 1 about one or more reference axes; process the images (or multiple images (e.g., videos)) captured by the camera (front camera 5a and / or rear camera 5b) to determine the orientation of the coronal plane of the face depicted in the images; use the determined orientation of the coronal plane of the face depicted in the images and the received accelerometer output to determine the direction of movement of the eye drop assembly 1 such that the portable electronic device 4 and / or the eye drop assembly 1 are parallel to the coronal plane of the face; and prompt the user to move the eye drop assembly in the direction determined above.

[0186] In an embodiment, images (or multiple images (e.g., video) captured by a camera (front camera 5a and / or rear camera 5b) further depict the face, and the computer program, when executed by a processor, causes the processor to: process the images (or multiple images (e.g., video)) to determine the angle between the plane of the portable electronic device 4 and the coronal plane of the face; determine the direction of moving the eye drop assembly 1 based on the determined angle, such that the plane of the portable electronic device 4 is parallel to the coronal plane of the face; and prompt the user to move the eye drop assembly 1 in the direction determined above.

[0187] In an embodiment, the portable electronic device 4 may further include a depth sensor, and wherein the images (or multiple images (e.g., video) captured by the camera (front camera 5a and / or rear camera 5b) further depict the face, and wherein the computer program, when executed by the processor, causes the processor to: receive the output of the depth sensor, which indicates the distance from the camera (front camera 5a and / or rear camera 5b) to a single point or multiple points depicted in the received images (or multiple images (e.g., video)); determine the angle between the plane of the portable electronic device 4 and the coronal plane of the face based on the received depth sensor output; determine the direction of moving the eye drop assembly 1 based on the determined angle, such that the plane of the portable electronic device 4 is parallel to the coronal plane of the face; and prompt the user to move the eye drop assembly in the determined direction.

[0188] In any of the above embodiments, when executed by the processor 6, the computer program may further instruct the processor 6 to trigger the eye drop sprayer device 2 to spray fluid from the spray nozzle 3 when the spray nozzle 3 is aligned with the eye (the user's eye or a third party's eye). Therefore, the fluid can be applied to the user's eye or a third party's eye at the moment the spray nozzle 3 is aligned with the eye.

[0189] Preferably, the eye drop spray device 2 includes an actuator operable to actuate the eye drop spray device 2 to spray fluid from the spray nozzle 3. Preferably, in any embodiment of the invention, the computer program, when executed by the processor 6, causes the processor 6 to: trigger the eye drop spray device 2 to spray fluid from the spray nozzle 3 by sending a start signal to the actuator; and wherein the actuator is configured to actuate the eye drop spray device 2 to spray fluid from the spray nozzle 3 in response to receiving the start signal.

[0190] In any embodiment, when executed by the processor 6, the computer program may further cause the processor 6 to use images captured by the camera (front camera 5a and / or rear camera 5b) to detect when the spray nozzle 3 is aligned with the eye (the user 10's eye 11 or the eye of a third party). In any embodiment, when executed by the processor 6, the computer program may further cause the processor 6 to: receive at least a second image (or multiple images (e.g., video)) captured by the camera (front camera 5a and / or rear camera 5b) of the portable electronic device 4, wherein the at least second image (or multiple images (e.g., video)) depicts the eye (the user 10's eye 11 or the eye of a third party); and use the at least second image (or multiple images (e.g., video)) to detect when the spray nozzle 3 is aligned with the eye (the user 10's eye 11 or the eye of a third party); and in response to detecting that the spray nozzle 3 is aligned with the eye, trigger the eye drop sprayer device 2 to spray fluid from the spray nozzle 3.

[0191] The portable electronic device 4 may include multiple cameras. These multiple cameras may include one or more of a wide-angle camera, a video camera for monitoring eye images, a time-of-flight camera, and an infrared camera.

[0192] For example, the portable electronic device 4 may include multiple rear cameras and / or multiple front cameras. The multiple rear cameras may be of different types. The multiple front cameras may be of different types. In an embodiment, when executed by the processor 6, the computer program will cause the processor 6 to select one of the multiple cameras to capture an image (or multiple images, such as video) of the eye (the user 10's eye 11 or an eye belonging to a third party). In an embodiment, when executed by the processor 6, the computer program will cause the processor 6 to prompt the user to activate the selected camera to capture an image (or multiple images, such as video) of the eye.

[0193] In an embodiment, when executed by processor 6, the computer program will cause processor 6 to: operate a first front-facing camera of portable electronic device 4 to capture one or more images of user 10's eyes 11 until the eye drop assembly 1 has been moved to a position where the spray nozzle 3 is aligned with user 10's eyes 11; and then, after the spray nozzle has been aligned with the eyes, operate a second front-facing camera of portable electronic device 4 to capture one or more images of user 10's eyes 11. Preferably, when executed by processor 6, the computer program will cause processor 6 to: operate a second front-facing camera to capture one or more images of user 10's eyes 11 after the spray nozzle 3 has been aligned with user 10's eyes 11, and before (e.g., immediately before) the processor triggers the eye drop spray device 2 to spray fluid from the spray nozzle, or simultaneously with the processor triggering the eye drop spray device 2 to spray fluid from the spray nozzle. The first and second front-facing cameras can be different types of cameras; for example, the first front-facing camera can be a wide-angle camera and the second front-facing camera can be a video camera; or, for example, the first front-facing camera can be a time-of-flight camera and the second front-facing camera can be a video camera.

[0194] In an embodiment, when executed by processor 6, the computer program will cause processor 6 to: operate the first rear camera of portable electronic device 4 to capture one or more images of a third party's eye until the eye drop assembly 1 has been moved to a position where the spray nozzle 3 is aligned with the third party's eye; and then, after the spray nozzle has been aligned with the third party's eye, operate the second rear camera of portable electronic device 4 to capture one or more images of the third party's eye. Preferably, when executed by processor 6, the computer program will cause processor 6 to: operate the second rear camera to capture one or more images of the third party's eye after the spray nozzle 3 has been aligned with the third party's eye, and before (e.g., immediately before) the processor triggers the eye drop spray device 2 to spray fluid from the spray nozzle, or simultaneously with the processor triggering the eye drop spray device 2 to spray fluid from the spray nozzle. The first and second rear cameras can be different types of cameras; for example, the first rear camera can be a wide-angle camera and the second rear camera can be a video camera; or, for example, the first rear camera can be a time-of-flight camera and the second rear camera can be a video camera.

[0195] In an embodiment, when executed by the processor 6, the computer program further causes the processor 6 to: receive at least a second image depicting the user's eye 11, the second image being captured by the front-facing camera 5a of the portable electronic device 4 when the eye drop assembly 1 is in a position where the spray nozzle 3 is aligned with the user's eye 11; determine, based on the received at least the second image, when the user's eye 11 is open; and when the user's eye is open, trigger the eye drop sprayer device 2 to spray fluid from the spray nozzle 3.

[0196] In an embodiment, when executed by the processor 6, the computer program causes the processor 6 to: receive multiple images (e.g., videos) captured by the front-facing camera 5a of the portable electronic device 4; determine the blinking frequency of the user's eyes 11; use the determined blinking frequency to determine the expected time when the user's eyes are to open; and trigger the eye drop spray device 2 at the determined time to spray fluid such that when the user's eyes 11 are open, the fluid is sprayed from the spray nozzle 3 into the user's eyes 11.

[0197] In an embodiment, when executed by the processor 6, the computer program further instructs the processor 6 to: receive at least a third image depicting the user's eye 11 as input, the third image being captured by the front-facing camera 5a of the portable electronic device 4 at a moment corresponding to the triggering of the eye drop spray device 2 to spray fluid from the spray nozzle 3; and determine, based on the at least third image, whether the user's eyes are closed when the fluid reaches the user's eye 11. Preferably, when executed by the processor 6, the computer program further instructs the processor 6 to: upon determining, based on the at least third image, if the eyes are closed when the fluid reaches the user's eye 11, provide a prompt to repeat the step of aligning the spray nozzle 3 with the eye 11 (so that additional fluid can be sprayed onto the user's eye 11).

[0198] In an embodiment, when executed by the processor 6, the computer program further causes the processor 6 to: receive at least a second image depicting the user's eye 11, the second image being captured by the front-facing camera 5a of the portable electronic device 4 when the eye drop assembly 1 is in a position where the spray nozzle 3 is aligned with the user's eye 11; determine, based on the received at least the second image, when the user's eye 11 is closed; and when the user's eye is closed, trigger the eye drop sprayer device 2 to spray fluid from the spray nozzle 3.

[0199] In an embodiment, when executed by the processor 6, the computer program causes the processor 6 to: receive multiple images (e.g., videos) captured by the front-facing camera 5a of the portable electronic device 4; determine the blinking frequency of the user's eyes 11; use the determined blinking frequency to determine the expected moment when the user's eyes are to close; and trigger the eye drop spray device 2 at the determined moment to spray fluid such that when the user's eyes 11 are closed, the fluid is sprayed from the spray nozzle 3 into the user's eyes 11.

[0200] In an embodiment, when executed by the processor 6, the computer program further instructs the processor 6 to: receive at least a third image depicting the user's eye 11 as input, the third image being captured by the front-facing camera 5a of the portable electronic device 4 at a moment corresponding to the triggering of the eye drop spray device 2 to spray fluid from the spray nozzle 3; and determine, based on the at least third image, whether the user's eyes are closed when the fluid reaches the user's eye 11. Preferably, when executed by the processor 6, the computer program further instructs the processor 6 to: if, based on the at least third image, determine that the user's eyes are open when the fluid reaches the user's eye 11, provide a prompt to repeat the step of aligning the spray nozzle 3 with the eye 11 (so that additional fluid can be sprayed onto the user's eye 11).

[0201] In one embodiment, when executed by processor 6, the computer program further causes processor 6 to receive a signal as input indicating whether the fluid in the eye drop sprayer 2 is to be applied to an open or closed eye. In another embodiment, when executed by processor 6, the computer program further causes processor 6 to receive a signal from the eye drop sprayer device 2 indicating whether the fluid is to be applied to an open or closed eye. When executed by processor 6, the computer program further causes processor 6 to perform any of the steps described above in the foregoing embodiments, depending on whether the fluid in the eye drop sprayer 2 is to be applied to the user's open or closed eye.

[0202] In an embodiment, when executed by the processor 6, the computer program further causes the processor 6 to: receive at least a second image depicting the eye of a third party, the second image being captured by the rear camera 5b of the portable electronic device 4 when the eye drop assembly 1 is in a position where the spray nozzle 3 is aligned with the eye of the third party; determine, based on the received at least the second image, when the eye of the third party is open; and trigger the eye drop sprayer device 2 to spray fluid from the spray nozzle 3 when the eye of the third party is open.

[0203] In an embodiment, when executed by the processor 6, the computer program causes the processor 6 to: receive multiple images (e.g., videos) captured by the rear camera 5b of the portable electronic device 4; determine the blinking frequency of the eye belonging to a third party; use the determined blinking frequency to determine the expected moment when the eye belonging to the third party is expected to open; and trigger the eye drop spray device 2 at the determined moment to spray fluid such that when the eye is open, the fluid is sprayed from the spray nozzle 3 into the eye belonging to the third party.

[0204] In an embodiment, when executed by the processor 6, the computer program further causes the processor 6 to: receive at least a third image depicting the eye of a third party as input, the third image being captured by the rear camera 5b of the portable electronic device 4 at a moment corresponding to the triggering of the eye drop sprayer device 2 to spray fluid from the spray nozzle 3; and determine, based on the at least third image, whether the eye of the third party is closed when the fluid reaches the eye of the third party. Preferably, when executed by the processor 6, the computer program further causes the processor 6 to: upon determining, based on the at least third image, if the eye of the third party is closed when the fluid reaches the eye of the third party, provide a prompt to repeat the step of aligning the spray nozzle 3 with the eye of the third party (so that additional fluid can be sprayed onto the eye of the third party).

[0205] In an embodiment, when executed by the processor 6, the computer program further causes the processor 6 to: receive at least a second image depicting the eye of a third party, the second image being captured by the rear camera 5b of the portable electronic device 4 when the eye drop assembly 1 is in a position where the spray nozzle 3 is aligned with the eye of the third party; determine, based on the received at least the second image, when the eye of the third party is closed; and when the eye of the third party is closed, trigger the eye drop sprayer device 2 to spray fluid from the spray nozzle 3.

[0206] In an embodiment, when executed by the processor 6, the computer program will cause the processor 6 to: receive multiple images (e.g., videos) captured by the rear camera 5b of the portable electronic device 4; determine the blinking frequency of the eye belonging to a third party; use the determined blinking frequency to determine the expected moment when the eye belonging to the third party is to close; and trigger the eye drop spray device 2 at the determined moment to spray fluid such that when the eye is closed, the fluid is sprayed from the spray nozzle 3 into the eye belonging to the third party.

[0207] In an embodiment, when executed by the processor 6, the computer program further causes the processor 6 to: receive at least a third image depicting the eye of a third party as input, the third image being captured by the rear camera 5b of the portable electronic device 4 at a moment corresponding to the triggering of the eye drop sprayer device 2 to spray fluid from the spray nozzle 3; and determine, based on the at least third image, whether the eye of the third party is closed when the fluid reaches the eye of the third party. Preferably, when executed by the processor 6, the computer program further causes the processor 6 to: upon determining, based on the at least third image, if the eye is open when the fluid reaches the eye of the third party, provide a prompt to repeat the step of aligning the spray nozzle 3 with the eye of the third party (so that additional fluid can be sprayed onto the eye of the third party).

[0208] In one embodiment, when executed by processor 6, the computer program further causes processor 6 to: receive a signal as input indicating that the fluid in the eye drop sprayer 2 is to be applied to an open or closed eye. In another embodiment, when executed by processor 6, the computer program further causes processor 6 to receive a signal from the eye drop sprayer device 2 indicating that the fluid is to be applied to an open or closed eye. When executed by processor 6, the computer program causes processor 6 to perform any of the steps described above in the foregoing embodiments, depending on whether the fluid in the eye drop sprayer 2 is to be applied to the open or closed eye of a third party.

[0209] According to another embodiment, when executed by the processor 6, the computer program further causes the processor 6 to: receive at least a second image captured by the front-facing camera 5a of the portable electronic device 4 as input, the at least second image depicting the user's eye 11; and process the received at least the second image to detect whether an obstacle is covering the user's eye 11. The processor 6 may use image processing techniques known in the art to process the received at least the second image to detect whether an obstacle is covering the user's eye 11. Preferably, when executed by the processor 6, the computer program causes the processor 6 to: provide a prompt to remove the obstacle if an obstacle is detected covering the user's eye 11. The obstacle may take any form; for example, the obstacle may include at least one of glasses, eye patch, eye cover, adhesive bandage, cosmetic patch, and / or bandage. Preferably, the at least the second image is an image captured by the front-facing camera 5a when the eye drop assembly 1 has been moved to a position where the spray nozzle 3 is aligned with the user's eye 11. In an embodiment, the processor 6 may further process the received at least the second image to detect whether a prosthetic eye is positioned in the eye socket, and / or detect whether the eye socket is empty. This can be accomplished using image processing techniques known in the art. When executed by processor 6, the computer program will prompt the user to insert their prosthetic eye into the eye socket if an empty eye socket is detected. Alternatively (depending on the fluid to be applied), when executed by processor 6, the computer program will prompt the user to remove the prosthetic eye from the eye socket if a prosthetic eye is detected in the eye socket.

[0210] According to another embodiment, when executed by processor 6, the computer program further causes processor 6 to: receive at least a second image captured by the rear camera 5b of portable electronic device 4 as input, the at least second image depicting a third party's eye; and process the received at least second image to detect whether an obstacle is covering the third party's eye. Processor 6 may use image processing techniques known in the art to process the received at least second image to detect whether an obstacle is covering the third party's eye. Preferably, when executed by processor 6, the computer program causes processor 6 to: provide a prompt to remove the obstacle if an obstacle is detected covering the third party's eye. The obstacle may take any form; for example, the obstacle may include at least one of glasses, an eye patch, and / or a bandage. Preferably, the at least second image is an image captured by the rear camera 5b when the eye drop assembly 1 has been moved to a position where the spray nozzle 3 is aligned with the third party's eye.

[0211] Various modifications and variations to the embodiments of the present invention will be apparent to those skilled in the art, and do not depart from the scope of the invention as defined in the appended claims. Although the invention has been described in conjunction with specific preferred embodiments, it should be understood that the claimed invention should not be unduly limited to such specific embodiments.

Claims

1. A computer program for assisting a user in aligning the spray nozzle (3) of an eye drop sprayer device (2) with the eye, the computer program being stored on a portable electronic device (4) having a processor (6) and a camera (5a, 5b); and in, The portable electronic device (4) is capable of being connected to the eye drop sprayer device (2) having a spray nozzle (3) to form an eye drop assembly (1), wherein, when the portable electronic device (4) and the eye drop sprayer device (2) are connected to form the eye drop assembly (1), the portable electronic device (4) and the eye drop sprayer device (2) are in a predetermined orientation relative to each other; and The eye drop spray device (2) contains fluid; and When the computer program is executed by the processor (6), the processor (6) will: Images captured by the camera (5a, 5b) of the portable electronic device (4) are used to determine the orientation of the moving eye drop assembly (1) such that the spray nozzle (3) is aligned with the eye, wherein at least a portion of the image depicts the eye; The user is prompted to move the eye drop assembly (1) in the determined direction.

2. The computer program according to claim 1, wherein, When the computer program is executed by the processor, it will cause the processor to: The image was used to determine the position of the spray nozzle relative to the eye; and The determined position of the spray nozzle relative to the eye is used to determine the direction of moving the eye drop assembly (1) so that the spray nozzle (3) is aligned with the eye.

3. The computer program according to claim 2, wherein, The portable electronic device includes a touchscreen, and wherein the eye drop sprayer includes a stylus with a tip in a predetermined fixed position relative to the sprayer nozzle, and wherein, when the portable electronic device and the eye drop sprayer assembly are connected to form the eye drop assembly, the stylus contacts the touchscreen of the portable electronic device, and wherein, when the computer program is executed by the processor, it further causes the processor to: The position of the stylus tip touching the touchscreen is received as input. The input and the image are used to determine the position of the sprayer nozzle relative to the eye; The determined position of the spray nozzle relative to the eye is used to determine the direction of movement of the eye drop assembly, such that the spray nozzle is aligned with the eye.

4. The computer program according to claim 4, wherein, The portable electronic device includes a memory storing a predetermined fixed position of the stylus tip relative to the spray nozzle, and wherein the computer program, when executed by a processor, causes the processor to determine the position of the spray nozzle relative to the eye in the following manner: The input is used to determine first position data, which is the position of the stylus tip relative to the camera. Retrieve the predetermined fixed position of the stylus tip relative to the spray nozzle from the memory of the portable electronic device; The first position data and the retrieved predetermined fixed position of the stylus tip relative to the spray nozzle are used to determine the second position data, which is the position of the spray nozzle relative to the camera. The image is used to determine third positional data, which is the position of the camera relative to the eye; The position of the spray nozzle relative to the eye is determined using the second and third position data.

5. The computer program according to claim 1, wherein, When the computer program is executed by the processor, it will cause the processor to: The image is used to determine the position of the camera relative to the eye; as well as The determined position of the camera relative to the eye is used to determine the direction of movement of the eye drop assembly, such that the spray nozzle is aligned with the eye.

6. The computer program according to claim 5, wherein, The portable electronic device includes a touchscreen, and wherein the eye drop sprayer includes a stylus with a tip, the stylus tip being in a predetermined fixed position relative to the sprayer nozzle, and wherein, when the portable electronic device and the eye drop sprayer assembly are connected to form the eye drop assembly, the stylus contacts the touchscreen of the portable electronic device, and wherein, when the computer program is executed by the processor, it further causes the processor to: The position of the stylus tip touching the touchscreen is received as input. The input and the image are used to determine the position of the camera relative to the eye; The determined position of the camera relative to the eye is used to determine the direction of movement of the eye drop assembly, such that the spray nozzle is aligned with the eye.

7. The computer program according to claim 6, wherein, The portable electronic device includes a memory storing a predetermined fixed position of the stylus tip relative to the spray nozzle, and wherein the computer program, when executed by a processor, causes the processor to: The input is used to determine first position data, which is the position of the stylus tip relative to the camera. Retrieve the predetermined fixed position of the stylus tip relative to the spray nozzle from the memory of the portable electronic device; Using the first position data and the retrieved predetermined fixed position of the stylus tip relative to the spray nozzle, second position data is determined, the second position data being the position of the spray nozzle relative to the camera; The second position data is used to determine a reference position, wherein the reference position is the relative position of the camera with respect to the eye, at which the spray nozzle will be aligned with the eye; The image captured by the camera is used to determine third position data, wherein the third position data is the position of the camera relative to the eye; The third position data is compared with the reference position to determine the direction of moving the eye drop assembly such that the camera reaches the reference position and the spray nozzle is aligned with the eye.

8. The computer program according to any one of the preceding claims, wherein, The portable electronic device includes a display screen, and wherein the eye drop spray device is connected to the portable electronic device in a first predetermined configuration, wherein the spray nozzle points in the same direction as the display screen.

9. The computer program according to any one of the preceding claims, wherein, The eye is a third party's eye; and wherein the portable electronic device includes a touchscreen, and wherein the eye drop sprayer includes a stylus with a tip, the stylus tip being in a predetermined fixed position relative to the sprayer nozzle, and wherein, when the eye drop sprayer device is connected to the portable electronic device in the first predetermined configuration, the stylus contacts the touchscreen of the portable electronic device, in which the eye drop sprayer device is connected to the portable electronic device such that the spray nozzle points in the same direction as the display screen. Wherein, the computer program, when executed by the processor, will further cause the processor to: The position of the stylus tip touching the touchscreen is received as input. The input and retrieved stylus tip relative to the spray nozzle are used to determine first position data, wherein the first position data is the position that the spray nozzle will have relative to the camera when the eye drop spray device and the portable electronic device are connected in a second predetermined configuration, wherein in the second predetermined configuration, the eye drop spray device is connected to the portable electronic device such that the spray nozzle points in a direction opposite to the direction in which the display screen is facing; The first position data is used to determine a reference position, wherein the reference position is the relative position of the camera with respect to the eye, at which the spray nozzle will be aligned with the eye; When the eye drop spray device and the portable electronic device are connected in the second predetermined configuration, an image captured by the camera is used to determine second position data, wherein the image depicts a third-party eye, and wherein the second position data is the position of the camera relative to the third-party eye; The second position data is compared with the reference position to determine the direction of moving the eye drop assembly such that the camera reaches the reference position and the spray nozzle is aligned with the third party's eye.

10. The computer program according to any one of claims 1 to 8, wherein, The eye is a third party's eye; and wherein the portable electronic device includes a touchscreen, and wherein the eye drop sprayer includes a stylus with a tip, the stylus tip being in a predetermined fixed position relative to the sprayer nozzle, and wherein, when the eye drop sprayer device is connected to the portable electronic device in a first predetermined configuration, the stylus contacts the touchscreen of the portable electronic device, in which the eye drop sprayer device is connected to the portable electronic device such that the spray nozzle points in the same direction as the direction the display screen faces, and wherein, when the computer program is executed by the processor, it further causes the processor to: The position of the stylus tip touching the touchscreen is received as input. The input and retrieved stylus tip relative to the spray nozzle are used to determine first position data, wherein the first position data is the position that the spray nozzle will have relative to the camera when the eye drop spray device and the portable electronic device are connected in a second predetermined configuration, wherein in the second predetermined configuration, the eye drop spray device is connected to the portable electronic device such that the spray nozzle points in a direction opposite to the direction in which the display screen is facing; When the eye drop spray device and the portable electronic device are connected in the second predetermined configuration, an image captured by the camera is used to determine second position data, wherein the image depicts a third-party eye, and wherein the second position data is the position of the camera relative to the third-party eye; The first and second position data are used to determine third position data, which is the position of the spray nozzle relative to an eye belonging to a third party; The determined position of the spray nozzle relative to the eye is used to determine the direction of movement of the eye drop assembly, such that the spray nozzle is aligned with the third party's eye.

11. The computer program according to claim 10, wherein, When executed by the processor, the computer program will further prompt the processor, after determining the first location data, to connect the portable electronic device and the eye drop spray device in the second predetermined configuration.

12. The computer program according to any one of claims 10 or 11, wherein, When the computer program is executed by the processor, it will cause the processor to: Detect when the eye drop spray device and the portable electronic device are connected in the second predetermined configuration.

13. The computer program according to any one of the preceding claims, wherein, When the computer program is executed by the processor, it will cause the processor to: The system receives an instruction as input, which is an instruction regarding whether the fluid is to be applied to the user's own eyes or to a third party's eyes.

14. The computer program according to any one of the preceding claims, wherein, When the computer program is executed by the processor, it will further cause the processor to: When the spray nozzle is aligned with the eye, the eye drop spray device is triggered to spray fluid from the spray nozzle.

15. The computer program according to any one of the preceding claims, wherein, When the computer program is executed by the processor, it will further cause the processor to: Receive at least a second image captured by the camera of the portable electronic device as input, wherein at least a portion of the captured second image depicts an eye; The at least second image is used to detect when the spray nozzle is aligned with the eye.

16. The computer program according to any one of the preceding claims, wherein, When the computer program is executed by the processor, it will cause the processor to: Detect whether the user fails to aim the spray nozzle at their eyes within a predetermined time period; as well as In response to the detection that the user has failed to align the spray nozzle with their eyes within a predetermined time period, an alarm is sent to a remote server or platform.

17. The computer program according to any one of the preceding claims, wherein, When the computer program is executed by the processor, it will further cause the processor to: Receive at least a second image depicting an eye as input, the at least second image being captured by the camera of the portable electronic device when the eye drop assembly is positioned with the spray nozzle aligned with the user's eye; Determine when the eyes open based on the received at least second image; as well as When the eyes are opened, the eye drop spray device is triggered to spray fluid from the spray nozzle.

18. The computer program according to claim 17, wherein, When the computer program is executed by the processor, it will cause the processor to: Receive multiple images captured by the camera of the portable electronic device as input; as well as The blinking frequency of the eyes is determined based on the input; Use the determined blink frequency to determine when the eyes are expected to open; as well as The eye drop spray device is triggered at a predetermined time to spray fluid, such that fluid is sprayed from the spray nozzle when the eye is expected to open.

19. The computer program according to any one of claims 17 or 18, wherein, When the computer program is executed by the processor, it will further cause the processor to: Receive at least a third image depicting the eye as input, the at least third image being captured by the camera at a moment corresponding to the triggering of the eye drop sprayer device to eject fluid from the spray nozzle; The at least third image is used to determine whether the eyes are closed when the fluid reaches the user's eyes.

20. The computer program according to claim 19, wherein, When executed by the processor, the computer program will further instruct the processor to: prompt the user to align the spray nozzle with the eye if, based on the at least third image, the eye is closed when the fluid reaches it.

21. The computer program according to any one of the preceding claims, wherein, When the computer program is executed by the processor, it will further cause the processor to: Receive at least a second image depicting an eye as input, the at least second image being captured by the camera of the portable electronic device when the eye drop assembly is positioned with the spray nozzle aligned with the user's eye; Determine when the eyes are closed based on at least the second image received; as well as When the eye is closed, the eye drop spray device is triggered to spray fluid from the spray nozzle.

22. The computer program according to claim 21, wherein, When the computer program is executed by the processor, it will further cause the processor to: Receive at least a third image depicting the eye as input, the at least third image being captured by the camera at a moment corresponding to the triggering of the eye drop sprayer device to eject fluid from the spray nozzle; The at least third image is used to determine whether the eyes are open when the fluid reaches the user's eyes.

23. The computer program according to claim 22, wherein, When executed by a processor, the computer program will further instruct the processor to: prompt the user to align the spray nozzle with the eye if, based on the at least third image, the eye opens when the fluid reaches it.

24. The computer program according to any one of the preceding claims, wherein, When the computer program is executed by the processor, it will further cause the processor to: The device receives a signal from the eye drop sprayer indicating that fluid is to be applied to an open or closed eye; or receives input from the user indicating that fluid is to be applied to an open or closed eye.

25. The computer program according to claim 24, wherein, When the computer program is executed by the processor, it will further cause the processor to: The steps of any one of claims 17-20 shall be performed when the received signal indicates that fluid should be applied to an open eye or when the user inputs an instruction that fluid should be applied to an open eye; and / or The steps of any one of claims 21-23 are performed when the received signal indicates that fluid should be applied to a closed eye or when the user inputs that fluid should be applied to a closed eye.

26. The computer program according to any one of the preceding claims, wherein, When the computer program is executed by the processor, it will further cause the processor to: The system receives at least a second image as input, said second image being captured by the camera when the eye drop assembly is positioned with the spray nozzle aligned with the eye. The received second image is processed to detect whether there is an obstacle covering the eye.

27. The computer program according to claim 26, wherein, When executed by a processor, the computer program will further enable the processor to: if an obstacle is detected covering the eyes, provide a prompt to remove the obstacle.

28. The computer program according to claim 2 or 27, wherein, The obstacle includes at least one of glasses, eye masks, and / or bandages.

29. The computer program according to any one of the preceding claims, wherein, The received image depicts the user's face, and the computer program, when executed by a processor, causes the processor to apply a mesh model to the image captured by the camera.

30. The computer program according to claim 29, wherein, When the computer program is executed by the processor, it will further cause the processor to: The mesh model is used to determine the location of the depicted eye in the captured image; as well as The position of the camera relative to the user's eyes is determined using the position of the depicted eyes in the captured image.

31. The computer program according to any one of the preceding claims, wherein, When the computer program is executed by the processor, it will further cause the processor to: The images captured by the camera are processed to determine the distance between a predetermined reference and the eye; The user is prompted to move the eye drop assembly closer to the eye or to move the eye drop assembly away from the eye until the distance between the predetermined reference and the eye is equal to the predetermined distance.

32. The computer program according to claim 31, wherein, The predetermined reference is the spray nozzle through which the fluid is sprayed.

33. The computer program according to claim 31, wherein, The predetermined reference is the camera.

34. The computer program according to claim 31, wherein, The portable electronic device includes a time-of-flight camera.

35. The computer program according to claim 34, wherein, The predetermined reference is a time-of-flight camera.

36. The computer program according to any one of the preceding claims, wherein, When the computer program is executed by the processor, it will further cause the processor to: The images captured by the camera are processed to determine the offset between a predetermined reference axis and the optical axis of the eye; The direction of tilt adjustment of the eye drop assembly is determined based on the determined offset, so that the predetermined reference axis is parallel to the optical axis of the eye; The user is prompted to move the eye drop assembly in the determined direction.

37. The computer program according to claim 36, wherein, The predetermined reference axis is the optical axis of the camera.

38. The computer program according to claim 36, wherein, The predetermined reference axis is the axis of the spray nozzle that extends in the spray direction of the spray nozzle.

39. The computer program according to claim 38, wherein, The predetermined reference axis is an axis extending from the center of the opening of the spray nozzle in the spray direction of the spray nozzle, through which fluid is sprayed.

40. The computer program according to any one of the preceding claims, wherein, When the computer program is executed by the processor, it will further cause the processor to: The images captured by the camera are processed to determine the rotation of the portable electronic device and / or the eye drop assembly about a predetermined reference axis; The direction of rotation of the eye drop assembly is determined based on the determined rotation, so that the portable electronic device and / or the eye drop assembly reaches a predetermined orientation; The user is prompted to move the eye drop assembly in the determined direction.

41. The computer program according to claim 40, wherein, The predetermined orientation is a vertical orientation.

42. The computer program according to claim 40 or 41, wherein, The predetermined reference axis is the optical axis of the camera.

43. The computer program according to any one of the preceding claims, wherein, The portable electronic device includes an accelerometer, and wherein the computer program, when executed by the processor, will cause the processor to: Receive the output of the accelerometer, the output of which indicates the tilt of the portable electronic device about one or more reference axes and / or the tilt of the eye drop assembly; The direction of movement of the eye drop assembly is determined based on the received accelerometer output, such that the portable electronic device and / or the eye drop assembly is parallel to the coronal plane of the face depicted in the image captured by the camera; The user is prompted to move the eye drop assembly in the determined direction.

44. The computer program according to any one of the preceding claims, wherein, The image captured by the camera depicts a face, and wherein the computer program, when executed by the processor, will cause the processor to: The captured image is processed to determine the angle between the plane of the portable electronic device and the coronal plane of the face depicted in the image; The direction of movement of the eye drop assembly is determined based on the determined angle, such that the plane of the portable electronic device is parallel to the coronal plane of the face depicted in the image; The user is prompted to move the eye drop assembly in the determined direction.

45. The computer program according to any one of the preceding claims, wherein, The portable electronic device includes a depth sensor, wherein the image captured by the camera depicts a face, and wherein the computer program, when executed by the processor, will cause the processor to: The camera receives the output of the depth sensor, which indicates the distance from the camera to a plurality of points depicted in the image. The angle between the plane of the portable electronic device and the coronal plane of the face is determined based on the received output of the depth sensor; The direction of movement of the eye drop assembly is determined based on the determined angle, such that the plane of the portable electronic device is parallel to the coronal plane of the face; The user is prompted to move the eye drop assembly in the determined direction.

46. ​​The computer program according to any one of the preceding claims, wherein, When executed by a processor, the computer program will cause the processor to segment the image captured by the camera to form a segmented image.

47. The computer program according to claim 46, wherein, When executed by a processor, the computer program will cause the processor to use the segmented image to identify a predetermined region of the eye.

48. The computer program according to claim 47, wherein, When the computer program is executed by the processor, it will cause the processor to: Select a predetermined area of ​​the eye or receive the selection of a predetermined area of ​​the eye as input; as well as The direction of moving the eye drop assembly is determined based on the image, such that the spray nozzle is aligned with a predetermined area of ​​the selected eye.

49. The computer program according to claim 48, wherein, When executed by a processor, the computer program will prompt the user in which direction to move the eye drop assembly so that the spray nozzle is aligned with a predetermined area of ​​the selected eye.

50. The computer program according to any one of claims 47 to 49, wherein, The predetermined area includes at least one or more of the iris, pupil, and sclera.

51. The computer program according to any one of the preceding claims, wherein, The portable electronic device includes multiple cameras, and wherein the computer program, when executed by a processor, causes the processor to selectively operate one of the multiple cameras to capture an image of the eye.

52. The computer program according to claim 51, wherein, When the computer program is executed by the processor, it will cause the processor to: The first camera of the portable electronic device is operated to capture one or more images of the eye until the eye drop assembly has been moved to a position where the spray nozzle is aligned with the eye; as well as After the spray nozzle has been aligned with the eye, the second camera is operated to capture one or more images of the eye.

53. The computer program according to claim 52, wherein, When executed by the processor, the computer program will cause the processor to: operate a second camera to capture one or more images of the eye after the spray nozzle has been aligned with the eye and while the processor triggers the eye drop sprayer device to spray fluid from the spray nozzle.

54. The computer program according to any one of claims 51 to 53, wherein, The plurality of cameras includes one or more of a wide-angle camera, a video camera for monitoring images of the eye, a time-of-flight camera, and an infrared camera.

55. The computer program according to any one of the preceding claims, wherein, The prompt is used to guide the user to move the eye drop assembly to the left or right.

56. The computer program according to any one of the preceding claims, wherein, The prompt is used to guide the user to move the eye drop assembly further away from or closer to the eye.

57. The computer program according to any one of the preceding claims, wherein, The prompt is for the user to rotate the eye drop assembly.

58. The computer program according to any one of the preceding claims, wherein, The prompt is for the user to adjust the tilt of the eye drop assembly.

59. The computer program according to any one of the preceding claims, wherein, The prompt is in the form of text displayed on the screen of the portable electronic device.

60. The computer program according to any one of the preceding claims, wherein, The cues include tactile cues.

61. The computer program according to claim 60, wherein, The tactile cues are the vibrations of the portable electronic device.

62. The computer program according to any one of the preceding claims, wherein, The prompts include audio prompts.

63. The computer program according to any one of the preceding claims, wherein, When the computer program is executed by the processor, it will further cause the processor to: Detecting whether the eye drop spray device is correctly connected to the portable electronic device to form the eye drop assembly; and The display of a first signal or a second signal is triggered, the first signal indicating whether the eye drop spray device is correctly connected to the portable electronic device, and the second signal indicating whether the eye drop spray device is incorrectly connected to the portable electronic device.

64. The computer program according to claim 63, wherein, The portable electronic device includes a port, and the eye drop spray device includes a plug, wherein the eye drop spray device is connected to the portable electronic device by inserting the plug into the port; Wherein, the computer program, when executed by the processor, will further cause the processor to: Check whether the plug of the eye drop spray device is correctly inserted into the port of the portable electronic device; and The first signal is triggered to display or the second signal is triggered to display. The first signal indicates whether the plug of the eye drop spray device is correctly inserted into the port of the portable electronic device, and the second signal indicates whether the plug of the eye drop spray device is not correctly inserted into the port of the portable electronic device.

65. The computer program according to claim 63 or 64, wherein, When executed by a processor, the computer program will cause the processor to trigger the portable electronic device to display the first signal or to trigger the portable electronic device to display the second signal.

66. The computer program according to claim 65, wherein, The first signal is a message displayed on the screen of the portable electronic device indicating that the eye drop spray device is correctly connected to the port of the portable electronic device; The second signal is a message on the display screen of the portable electronic device indicating that the eye drop spray device is not properly connected to the port of the portable electronic device.

67. The computer program according to claim 63 or 64, wherein, When executed by a processor, the computer program will cause the processor to trigger the eye drop spray device to display the first signal or trigger the eye drop spray device to display the second signal.

68. The computer program according to claim 67, wherein, The first signal is the activation of the first colored light source on the eye drop spray device; The second signal is the activation of the second colored light source on the eye drop spray device, wherein the color of the first colored light source is different from the color of the second colored light source.

69. The computer program according to any one of the preceding claims, wherein, The fluid includes a drug.

70. The computer program according to any one of the preceding claims, wherein, The portable electronic device is a smartphone.

71. A portable electronic device having a memory storing a computer program according to any one of the preceding claims.

Images