Method of operating a medical application on a mobile device having at least one camera

The method on mobile devices with cameras tracks user attention to ensure comprehension of critical medical information, reducing errors and enhancing safety by prompting confirmation and using reminders.

WO2025162740A1PCT designated stage Publication Date: 2025-08-07ROCHE DIABETES CARE GMBH +1
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/EP2025/051263
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-01-30
Filing Date
2025-01-20
Publication Date
2025-08-07

AI Technical Summary

Technical Problem

Users often fail to adequately assess critical information displayed on medical applications on mobile devices, leading to potential safety and accuracy issues in medical operations without professional medical training.

Method used

A method using a mobile device with a camera to derive perceptivity information by tracking user eye movements on critical screens, prompting confirmation only when the user has perceived the content, and employing reminder signals if necessary.

Benefits of technology

Ensures users attentively engage with critical information, reducing handling errors and enhancing safety in medical operations by confirming comprehension before proceeding.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure EP2025051263_07082025_PF_FP_ABST
    Figure EP2025051263_07082025_PF_FP_ABST
Patent Text Reader

Abstract

A method of operating a medical application on a mobile device (112) having at least one camera (114) and at least one display (116) is disclosed. The method comprises deriving at least one item of perceptivity information about a user's attention to at least one displayed critical screen and further comprises: a) receiving a predefined set of critical screens comprising critical content, wherein the critical content comprises information about one or more of, or wherein the critical content comprises a request for confirmation of one or more of: - applying of a sample of bodily fluid to at least one test field of an optical test element, - an occurred error, - injecting a bolus, - controlling an insulin pump, - delivering a medicament, - a user authentication; b) displaying to a user, on the display (116) of the mobile device (112), the at least one critical screen and deriving the at least one item of perceptivity information about the user's attention to the displayed critical screen by i) receiving at least one eye movement of the user from the camera (114), and ii) evaluating the user's eye movement, thereby deriving the item of perceptivity information; c) if the item of perceptivity information indicates that the user has perceived the critical content, prompting the user to confirm the critical content. Further, a mobile device (112) having at least one camera (114) and at least one display (116) and being configured for operating a medical application on the mobile device (112) is disclosed. Further disclosed are a kit (110), a computer program and a computer-readable storage medium.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Method of operating a medical application on a mobile device having at least one camera

[0002] Technical Field

[0003] The present invention relates to a method of operating a medical application on a mobile device having at least one camera. The invention further relates to a mobile device having at least one camera and to a kit comprising the mobile device. Further, the invention relates to a corresponding computer program and a computer readable storage medium. The invention specifically may be used in a medical environment, such as in medical therapy and / or in medical diagnostics, specifically in home care scenarios. Other fields of application of the present invention, however, are also feasible.

[0004] Background art

[0005] In the medical environment, such as in the fields of medical therapy and / or medical diagnostics, in many cases users without professional medical training are typically required to detect one or more analytes in samples of a bodily fluid or to set a dose of medication. Especially a qualitatively and / or quantitatively detection of one or more analytes in a sample of bodily fluid, such as for example deriving a blood glucose concentration and / or the presence of the SARS-CoV-2 coronavirus, is typically performed by the user without assistance from professionally trained medical staff. In the field of diabetes therapy, for example, it is further common that the user without professional training sets a dose of insulin to be injected, e.g. via an insulin infusion pump device or the like. Generally, mobile devices, such as smartphones and computers, are known to the skilled person, which run applications to assist the user in carrying out such therapeutic and / or diagnostic tasks.

[0006] In their everyday life, when using smartphones and computers, users are typically confronted with many confirmation and / or acknowledgement screens, for example requiring the user’s consent for terms of use, information gathering and general acknowledgements. Due to this constant confrontation, users generally have developed a tendency to confirm or continue many screens that requires consent and / or acknowledgement without actually reading and / or assessing the displayed information. Thus, relevant information may be skipped and / or discarded without actually being read. For some cases, e.g. for electronic devices executing more than one application at a time or for file management applications, means for detecting whether users are attentive to an electronic device are known.

[0007] US10572104B2 describes an electronic device for executing a plurality of applications and a method for controlling the electronic device. The method includes determining a first application related to an acquired user input from among the plurality of applications, and executing a task corresponding to the user input in the first application.

[0008] US20210325960A1 describes gaze-based control of an electronic device. The gaze-based control can include enabling an option to provide user authorization when it is determined that the user has viewed and / or read text associated with a request for the user authorization. The gaze-based control can also include modifying a user interface or a user interface element based on user views and / or reads. The gaze-based control can be based on determining whether a user has viewed and / or read an electronic document and / or a physical document.

[0009] Despite the advantages achieved by known methods or devices, several technical challenges remain. Thus, a technical challenge may lie in the circumstance of medical applications, where strict requirements are to be upheld in order not to compromise safety and / or accuracy of the medical application.

[0010] Problem to be solved

[0011] It is therefore desirable to provide methods and devices, which at least partially address the above-mentioned technical challenges. Specifically, methods and devices shall be proposed, which increase the chances of the mobile device’s user actually assessing displayed information.

[0012] Summary

[0013] This problem is addressed by a method a method of operating a medical application on a mobile device having at least one camera, a mobile device having at least one camera, a kit comprising the mobile device, a corresponding computer program and a computer readable storage medium with the features of the independent claims. Advantageous embodiments which might be realized in an isolated fashion or in any arbitrary combinations are listed in the dependent claims as well as throughout the specification. As used in the following, the terms “have”, “comprise” or “include” or any arbitrary grammatical variations thereof are used in a non-exclusive way. Thus, these terms may both refer to a situation in which, besides the feature introduced by these terms, no further features are present in the entity described in this context and to a situation in which one or more further features are present. As an example, the expressions “A has B”, “A comprises B” and “A includes B” may both refer to a situation in which, besides B, no other element is present in A (i.e. a situation in which A solely and exclusively consists of B) and to a situation in which, besides B, one or more further elements are present in entity A, such as element C, elements C and D or even further elements.

[0014] Further, it shall be noted that the terms “at least one”, “one or more” or similar expressions indicating that a feature or element may be present once or more than once typically will be used only once when introducing the respective feature or element. In the following, in most cases, when referring to the respective feature or element, the expressions “at least one” or “one or more” will not be repeated, non-withstanding the fact that the respective feature or element may be present once or more than once.

[0015] Further, as used in the following, the terms "preferably", "more preferably", "particularly", "more particularly", "specifically", "more specifically" or similar terms are used in conjunction with optional features, without restricting alternative possibilities. Thus, features introduced by these terms are optional features and are not intended to restrict the scope of the claims in any way. The invention may, as the skilled person will recognize, be performed by using alternative features. Similarly, features introduced by "in an embodiment of the invention" or similar expressions are intended to be optional features, without any restriction regarding alternative embodiments of the invention, without any restrictions regarding the scope of the invention and without any restriction regarding the possibility of combining the features introduced in such way with other optional or non-optional features of the invention.

[0016] In a first aspect of the present invention, a method of operating a medical application on a mobile device having at least one camera, e.g. a front camera, and having at least one display is disclosed. The method comprises deriving at least one item of perceptivity information about a user’s attention to at least one displayed critical screen. The method may also be referred to as “operation method”, “detection method” and / or simply as “method”. The method comprises the following steps, which specifically may be performed in the given order. However, a different order may also be possible. It is further possible to perform more than one of the method steps in a timely overlapping fashion and / or fully or partially simultaneously. The method may comprise additional method steps, which are not listed. Further, it is possible to perform one, more than one or even all of the method steps repeatedly.

[0017] The method comprises the following steps: a) receiving, e.g. from a cloud storage, a predefined set of critical screens comprising critical content, wherein the critical content comprises information about one or more of, or wherein the critical content comprises a request for confirmation of one or more of: applying of a sample of bodily fluid to at least one test field of an optical test element, an occurred error, injecting a bolus, controlling an insulin pump, delivering a medicament, a user authentication; b) displaying to a user, on the display of the mobile device, the at least one critical screen and deriving the at least one item of perceptivity information about the user’s attention to the displayed critical screen by i) receiving at least one eye movement of the user from the camera, e.g. capturing the eye movement by using the camera of the mobile device, and ii) evaluating the user’ s eye movement, thereby deriving the item of perceptivity information; c) if the item of perceptivity information indicates that the user has perceived the critical content, prompting the user to confirm the critical content, e.g. by one or more of displaying a confirmation screen, activating a confirmation button, such as a previously greyed out confirmation button, displaying a confirmation button, such as a previously invisible information button.

[0018] It shall be noted that the indicated order of the method steps may be changed. Specifically, the method steps may be performed in a different order than indicated or may be repeated. Specifically, the method may comprise repeating one or more of steps b) to c) for each of the critical screens of the set of critical screens received in step a). In particular, step b) may be repeated for each of the critical screens of the set of critical screens received in step a).

[0019] The term “operating a medical application on a mobile device” as used herein is a broad term of this to be given its ordinary and customary meaning to person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to performing at least one medical operation, such as one or more of a diagnostic and / or therapeutic method, by using a mobile device. As an example, the medical application may be or may comprise one or more of detecting an analyte in a sample of bodily fluid, monitoring a blood glucose level, determining a bolus amount, controlling an insulin pump, delivering a medicament, user authentication, for example, to ensure that rights reserved for medical personnel are only granted to persons who have these rights. Specifically, the medical application further may be or may comprise one or more of detecting vital signs, such as determining one or more of a body temperature, a pulse rate, a respiration rate and a blood pressure; detecting a critical health condition, e.g. acute heart failure, such as for example by determining a change in one or more vital sign and / or a change in skin color. Thus, as an example, the medical application may be or may comprise one or more of detecting an analyte in a sample of bodily fluid, monitoring a blood glucose level, determining a bolus amount, controlling an insulin pump, delivering a medicament, user authentication to ensure that rights reserved for medical personnel are only granted to persons who have these rights, detecting vital signs, detecting a critical health condition.

[0020] The term “mobile device” as used herein is a broad term of this to be given its ordinary and customary meaning to person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer without limitation, to the mobile electronics device, more specifically to a mobile communication device, such as a cell phone and / or a smart phone. Additionally or alternatively, the mobile device may also refer to a notebook, a tablet computer or another type of portable computer having at least one camera. Thus, generally, the mobile device may be selected from the group consisting of a cell phone having at least one camera, specifically a smart phone; a portable computer having at least one camera, specifically at least one notebook and a tablet computer. The mobile device may specifically be used for the operation method, particularly for performing the method, as will be outlined in further detail below. The mobile device, besides the at least one camera e.g. a touchscreen. As an example, the mobile device may comprise more than one camera, such as a front camera, e.g. arranged on the same side as the one or more displays, and a back camera, e.g. arranged on a side opposing the side on which the front camera is arranged. Further, the mobile device, besides the at least one camera and the at least one display, may comprise more elements, such as a processor.

[0021] The term “camera” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a device having at least one imaging element configured for recording or capturing spatially resolved onedimensional, two-dimensional or even three-dimensional optical data or information. As an example, the camera may comprise at least one camera chip, such as at least one CCD chip and / or at least one CMOS chip configured for recording images. As used herein, without limitation, the term “image” specifically may relate to data recorded by using the camera, such as a plurality of electronic readings from the imaging device, such as the pixels of the camera chip.

[0022] The camera, besides the at least one camera chip or imaging chip, may comprise further elements, such as one or more optical elements, e.g. one or more lenses. As an example, the camera may be affixed focused camera, having at least one lens, which is 60 adjusted with respect to the camera. Alternatively, however, the camera may also comprise one or more variables lenses, which may be adjusted, automatically or manually. The invention specifically shall be applicable to cameras as usually used in mobile applications, such as notebook computers, tablets or, specifically, cell phones, such as smart phones. Thus, specifically, the camera may be part of the mobile device which, besides the at least one camera, comprises one or more data processing devices such as one or more data processors. Other cameras, however, are feasible.

[0023] The term “processor” as used herein is a broad term it is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special customized meaning. The term specifically may refer, without limitation, to an arbitrary logic circuitry configured for performing basic operations of a computer or system, and / or, generally, to a device which is configured for performing calculations are logic operations. In particular, the medical application may be operated and / or run on the processor of the mobile device. Thus, the processor may be configured for processing basic instructions that drive the computer or system. Specifically, the processor may comprise at least one arithmetic logic unit (ALU), at least one floating-point unit (FPU), such as a math co-processor or a numeric co-processor, a plurality of registers, specifically registers configured for supplying operands to the ALU and storing results of operations, and a memory, such as an LI and L2 cache memory. In particular, the processor may be a multi-core processor. Specifically, the processor may be or may comprise a central processing unit (CPU). Additionally or alternatively, the processor may be or may comprise a microprocessor, thus specifically the processor’s elements may be contained in one single integrated circuitry (IC) chip. Addition-ally or alternatively, the processor may be or may comprise one or more application-specific integrated circuits (ASICs) and / or one or more field-programmable gate arrays (FPGAs) and / or one or more tensor processing unit (TPU) and / or one or more chip. The processor specifically may be configured, such as by software programming, for performing one or more medical application operating procedures.

[0024] The term “set of critical screens” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special customized meaning. The term specifically may refer, without limitation, to a defined quantity, such as a finite number, of critical screens. Thus, the set of critical screens may contain two or more, more preferably three or more, critical screens, specifically screens comprising the critical content. However, the set of critical screens may also be or may comprise just one critical screen. In particular, the set of critical screens as described herein is a predefined set of critical screens, for example, a pre-identified and / or predetermined set of critical screens, e.g. defined in a set-up and / or programming phase of the medical application. As used herein, the term “critical screen” is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special customized meaning. The term specifically may refer, without limitation, to at least one arbitrary two-dimensional image and / or picture comprising the critical information. In particular, the critical screen may be displayable on the at least one display of the mobile device and may, for example, comprise the critical content at least partially in writing, in at least one symbol, and / or in at least one picture, image, video and / or animation.

[0025] In particular, in step a), the critical content may comprise information about one or more of an occurred error, injecting a bolus, controlling an insulin pump, delivering a medicament, and a user authentication. Alternatively, in step a), the critical content may comprise a request for confirmation of one or more of applying of a sample of bodily fluid to at least one test field of an optical test element, an occurred error, injecting a bolus, controlling an insulin pump, delivering a medicament, and a user authentication.

[0026] The term “sample of bodily fluid” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special customized meaning. The term specifically may refer, without limitation, to an arbitrary aliquot part or aliquant part of a biological fluid, such as a droplet of biological fluid, which directly is a bodily fluid or, which is derived from a bodily fluid, such as by one or more pre-processing steps, e.g. by transferring a bodily fluid to at least one sampling fluid, by diluting a bodily fluid, by centrifugation of the body fluid or the like. The bodily fluid may comprise one or more of saliva, blood, interstitial fluid, urine or other types of body fluids. The sample of bodily fluid may specifically comprise at least one preparation of the bodily fluid, such as a cell preparation of the bodily fluid, e.g. a stain cell preparation of the bodily fluid. The sample of bodily fluid may also be referred to as a “drop of bodily fluid”, a “droplet of bodily fluid” or simply as “sample”.

[0027] The term “optical test element” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to an arbitrary element or device configured for performing an optical detection reaction, for example a color change detection reaction and / or a reaction during which one or more optically detectable features on or within the test element become observable and / or discernable, such as one or more markings, such as linear markings known from rapid CO VID testing. The optical test element may also simply be referred to as “test element”. The optical test element may be embodied as a test strip, a test card, a test paper, a test tape or as a test stick. The optical test element may particularly have the at least one test field containing at least one test chemical being sensitive for a property of the sample, such as for example for detecting at least one analyte. In particular, the test field may be or may comprise a coherent amount of the test chemical and may be a field of round, polygonal or rectangular shape, e.g. having one or more layers of material, with at least one layer of the test field having the test chemical comprised therein. The optical test element may, as an example, comprise one or more application sites for applying the at least one sample of bodily fluid. The application side may be different from the position of the test field and may be fluidically connected to the test field, such as by one or more capillary elements, such as one or more porous elements capable of transporting liquid. The optical test element, as an example, may comprise at least one substrate, such as at least one carrier, with the at least one test field applied thereto or integrated therein. Additionally or alternatively, the optical test element may be embodied as a stick, such as a dip-stick, configured for applying the sample of bodily fluid to the test field by being dipped into the sample of bodily fluid. These test elements are generally widely in use and available. One optical test element may carry a single test field or a plurality of test fields having identical or different test chemicals comprised therein. For example, the optical test element may be configured for performing at least one color change detection reaction for detecting blood glucose in the sample of bodily fluid, such as a blood glucose test. Alternatively or additionally, as another example, the test element may comprise at least one lateral flow essay, specifically at least one lateral flow essay configured for performing at least one reaction during which one or more optically detectable features on or within the test element become observable, e.g. visible, for detecting a presence of an analyte in the sample of the body fluid, such as in a urine sample. Various further options may also be feasible. The term “bolus” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a dosage or discrete amount of fluid. Specifically, the bolus may be a bolus of insulin and may be an amount of insulin essential for controlling cellular glucose and amino acid uptake in the human or animal body after a meal. As an example, the bolus of insulin may regulate a blood glucose level caused by the intake of a meal into the human or animal body.

[0028] The term “prompting as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to at least one of requesting, asking, suggesting and inviting the user to perform a specific action. Specifically, the prompting may comprise providing a notification to the user, such as a visual notification, the notification specifically requesting the user to perform the specific action.

[0029] The term “item of perceptivity information” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to at least one item of information indicating a user’s perceptivity and / or attention to a displayed screen, such as an item of information on and / or about an attention of the user to the content and / or information displayed on a display, e.g. on the display of the mobile device. In particular, the item of perceptivity information may comprise information about and / or on whether or not the user has read a displayed text, watched a displayed video and / or animation or the like. The item of perceptivity information may comprise at least one numerical and / or alphanumerical item of information, configured for indicating the user’s attention to the display.

[0030] The item of perceptivity information may comprise Boolean information, such as “perceived” or “not perceived”. Specifically, the item off perceptivity information may comprise Boolean information indicating one of the user has perceived the critical content; and the user has not (yet) perceived the critical content.

[0031] The item of perceptivity information may, for example, indicate that the user has perceived the critical content, e.g. by reading a displayed text and / or by watching a displayed video and / or animation or the like. Alternatively, the item of perceptivity information may, for example, indicate that the user has not yet perceived the critical content, e.g. since the user has not spent enough time actively looking at the display of the mobile device or has been looking somewhere else instead of reading and / or watching the display of the mobile device.

[0032] For the purpose of deriving the item of perceptivity information, as an example, step b) ii) may comprise determining an amount of time tg. The time tgmay specifically be a period of time during which the user’s eyes gaze on the display. The item of perceptivity information may for example indicate that the user has perceived the critical content, if the amount of time tgis equal to, or larger than, a predefined time threshold tmin. Thus, the item of perceptivity information, derived in step b), may indicate “perceived” in case tg> tmin. Alternatively, in Case tgtmin, the item of perceptivity information may indicate “not perceived”.

[0033] As an example, tmin may be adapted according to a user’s experience level. The user’s experience level may specifically be set automatically based on a number of performed analyte detections by the user. Thus, in step b) ii), the minimum amount of time tmin for watching the screen may be adapted based on a user’s experience level. In particular, for an experienced user, tmin may be smaller than for an inexperienced user, such as for a user performing the medical application for the first time.

[0034] Step b) ii) may specifically comprise comparing the eye movement to a predefined eye movement pattern, such as a line of sight tracking pattern, for deriving the item of perceptivity information. For example, in case the captured eye movement corresponds to one of the predefined patterns, the item of perceptivity information may indicate that the critical content was perceived by the user. In particular, the user’s eye movement may be tracked by using one or more known software modules, such as a wide variety of software modules available to a broad range of mobile devices. As an example, reference may be made to K. Krafka et al.: Eye Tracking for Everyone. 2016 IEEE Conf Comput Vis Pattern Recognit CVPR-84. Other types of eye tracking software and / or modules are possible and may be used for performing the present invention.

[0035] The camera of step b) i) may specifically be a front camera of the mobile device, particularly a camera arranged on a front side of the mobile device, such as on the same side of the mobile device on which the display is arranged.

[0036] The method, specifically before performing any of steps a) to c), e.g. in an initial set-up run, may further comprise the following step: d) prompting the user to one or more of indicate whether or not the user has at least one vision condition, specifically a vision condition preventing a standard line of sight, such as a vision condition from a predefined list of vision conditions, and select none, one or more than one vision conditions that apply to the user from a predefined list of vision conditions.

[0037] The predefined list of vision conditions may specifically comprise one or more of nystagmus, amblyopia, strabism, anisocoria, and ocular prosthesis.

[0038] The method may further comprise: e) automatically detecting whether or not a vision condition applies to the user from the eye movement received in step b) i).

[0039] In particular, evaluating the user’s eye movement may be or may comprise a comparison of the captured user’s eye movement to a predefined pattern of eye movements typical for vision conditions. Alternatively however, evaluating the user’s eye movement may be or may comprise simply registering an error in the tracking and / or capturing of the user’s eye movements. In particular, the tracking and / or capturing of the eye movement or movements may also be referred to as line of sight control and / or line of sight tracking. As outlined above, these tracking techniques are generally known to the skilled person. Thus, in step e), it may be detected that a vision condition applies to the user in case an error occurs during step b), e.g. indicating that the eye tracking and / or capturing the user’s eye movement, i.e. the deriving of the item of control information from the item of perceptivity information about the user’s attention to the displayed critical screen, is faulty.

[0040] In step e), in case a standard line of sight is not detectable within a predefined amount of time, a vision condition may be detected. As an example, in step e), it may be considered that a vision condition applies to the user, if a standard line of sight is not detectable within a predefined amount of time.

[0041] Specifically, in case a vision condition is detected, e.g. in case it is considered that a vision condition applies to the user, the method may further comprise one or more of considering none of the predefined set of critical screens received in step a) to be critical and thus not performing steps a) to c) of the method for a predefined number of measurements, and taking the vision condition into account when performing step b), e.g. by comparing the user’s eye movements to one or more of a predefined adapted set of eye movements, such as to an adapted eye movement pattern.

[0042] As an example, one or both of the limitations referred to in the previous paragraph may also be accompanied by an information and / or a confirmation request to the user. Such an information and / or confirmation request may specifically be provided to the user visually and / or auditory. For example, visually via the display of the mobile device, e.g. by showing an error message, and / or auditory via one or more speakers of the mobile device, e.g. by generating at least one error indicating sound.

[0043] The method, specifically after performing step c), may further comprise the following step: f) if the item of perceptivity information indicates, for a predefined amount of waiting time tw, that the user has not perceived the critical content, generating a reminder signal, wherein for this purpose, step b) comprises starting a control timer indicating the amount of time ts for which the critical screen is displayed, wherein the reminder signal is generated if ts > tw.

[0044] The reminder signal may specifically be one or more of an acoustic signal and a haptic signal, such as a vibration, e.g. generated by one or more elements of the mobile device, such as by a loudspeaker and / or a vibrator of the mobile device. Other suitable elements for generating the reminder signal are possible.

[0045] In particular, the medical application may be or may comprise detecting at least one analyte in a sample of bodily fluid, wherein the critical content for at least one critical screen of the set of critical screens may specifically relate to the application of the sample of bodily fluid to the at least one test field of the optical test element. In this case, the method may further comprise, specifically after the user has confirmed the application of the sample of bodily fluid on the confirmation screen displayed in step c), the following steps: g) receiving at least one image of at least a part of the test field of the optical test element, e.g. capturing the image by using the camera of the mobile device; h) detecting the analyte by evaluating the at least one image.

[0046] The term “detecting an analyte in a sample” as used herein is a broad term and is to be given its ordinary and customary meaning to person of ordinary skill in the art and is not to be limited to a special customized meaning. The term specifically may refer, without limitation, to a quantitative and / or qualitative determination of at least one analyte in an arbitrary sample, such as in the sample of bodily fluid, for example comprising a body fluid, such as blood, interstitial fluid, urine, saliva or other types of body fluids. Thus, the method of operating a medical application may be an analytical method and the result of the analytical method, as an example, may be a concentration of the analyte and / or the presence or absence of the analyte to be determined. Specifically, as an example, the medical application may be or may comprise a blood glucose measurement, thus the result of the analytical method may for example be a blood glucose concentration. Additionally or alternatively, as an example, the analytical method may be a urine test, thus the result of the analytical method may for example be on may comprise information on the presence or absence of one of my analytes in the urine sample. In particular, an analytical measurement result value may be determined by the analytical method. Thus, as an example, specifically step h) of the method, may comprise determining the analytical measurement result value, indicating one or more of the concentration of the analyte and / or the presence or absence of the analyte in the sample of bodily fluid.

[0047] As an example, in step g), a back camera of the mobile device may be used for capturing the image of the at least part of the test field. The back camera may specifically be arranged on a back side of the mobile device, such as on a side opposing the side of the mobile device on which the display, e.g. the display on which the critical screen is displayed to the user, is arranged.

[0048] In particular, the method may be fully or partially computer-implemented. Specifically, at least steps a) to c), and optionally one or more of steps d), e), f), g) and h), of the method may be computer-implemented, e.g. performed by the mobile device.

[0049] The term “computer-implemented” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to a method involving at least one computer and / or at least one computer network, such as the mobile device. The computer and / or computer network, e.g. the mobile device as defined above, may comprise at least one processor which is configured for performing at least one of the method steps of the method according to the present invention, such as of the operation method. Preferably, each of the method steps may be performed by the mobile device. In a further aspect of the present invention, a mobile device having at least one camera and at least one display is disclosed. The mobile device is configured for operating a medical application on the mobile device by using the following steps:

[0050] A) receiving, e.g. from a cloud storage, a predefined set of critical screens comprising critical content, wherein the critical content comprises information about one or more of, or wherein the critical content comprises a request for confirmation of one or more of: applying of a sample of bodily fluid to the at least one test field of the optical test element, an occurred error, injecting a bolus, controlling an insulin pump, delivering a medicament, a user authentication;

[0051] B) displaying to a user, on the display of the mobile device, at least one critical screen and deriving at least one item of perceptivity information about the user’s attention to the displayed critical screen by

[0052] I) receiving at least one eye movement of the user from the camera, e.g. capturing the eye movement by using the camera of the mobile device, and

[0053] II) evaluating the user’s eye movement, thereby deriving the item of perceptivity information;

[0054] C) if the item of perceptivity information indicates that the user has perceived the critical content, displaying a confirmation screen for the critical content.

[0055] As an example, the medical application may be or may comprise detecting at least one analyte in a sample of bodily fluid, resulting in the mobile device, e.g. by operating the medical application, being configured for detecting the at least one analyte in the sample of bodily fluid. In this case, the critical content for at least one critical screen of the set of critical screens may specifically relate to the application of the sample of bodily fluid to the at least one test field of the optical test element. Further in this case, i.e. after the user has confirmed the application of the sample of bodily fluid on the confirmation screen displayed in step C), the mobile device may perform the following steps:

[0056] D) receiving at least one image of at least part of the test field of the optical test element, e.g. capturing the image by using the camera of the mobile device;

[0057] E) detecting the analyte by evaluating the at least one image. It shall be noted that the indicated order of the steps performed by the mobile device, specifically steps A) to C) and optionally steps D) and E), may be changed. As an example, the steps may be performed in a different order than indicated. Additionally or alternatively, one or more of the steps may be performed repeatedly, such that for example step B) may be repeatedly performed, e.g. additionally after one or more of steps C), D) and / or E).

[0058] The mobile device may specifically be configured for performing the method as outlined herein. Thus, for definitions and options of the mobile device, reference may be made to the description of the method given above or as further outlined below. The mobile device may specifically be configured for performing at least steps a) to c), and optionally one or more of steps d), e), f), g) and h), of the method according to the present invention, such as according to any one of the embodiments disclosed above and / or according to any one of the embodiments described in further detail below. Thus, the processor of the mobile device may be software-configured for performing and / or controlling the execution of the method, e.g. at least one of steps a) to c) of the analytical method, wherein optionally also steps d) to h) may at least partially be controlled and / or supported by the processor.

[0059] As outlined above, the mobile device may comprise at least one processor being programmed for controlling at least steps a) to c), and optionally at least one of steps d) to h), of the method. For definitions and options regarding the design of the processor, reference may be made to the description given above.

[0060] In a further aspect of the present invention, a kit is described. The kit comprises the mobile device as described herein above or as described in further detail below. The kit further comprises at least one optical test element having at least one test field configured for performing at least one optical detection reaction in the presence of the analyte in the sample of the bodily fluid, wherein the optical detection reaction is observable at at least one predetermined position on the test field.

[0061] In particular, in case the medical application is or comprises detecting at least one analyte in a sample of bodily fluid, the kit may be configured for detecting the at least one analyte in the sample of bodily fluid. For definitions and options of the mobile device and of the optical test element, reference may be made to the description of the method given above or as further outlined below. The term “kit” as used herein is a broad term and is to be given its ordinary and customary meaning to a person of ordinary skill in the art and is not to be limited to a special or customized meaning. The term specifically may refer, without limitation, to an assembly of a plurality of components, wherein the components each may function and may be handled independently from each other, wherein the components of the kit may interact to perform a common function.

[0062] In a further aspect of the present invention, a computer program is disclosed. The computer program comprises instructions which, when the program is executed by the mobile device as described herein, cause the mobile device to perform the method as also described herein. In particular, the computer program may include computer-executable instructions for performing the method in one or more of the embodiments enclosed herein when the instructions are executed on the mobile device. Specifically, the computer program may be stored on a computer-readable data carrier and / or on a computer-readable storage medium.

[0063] In a further aspect of the present invention, a computer-readable storage medium is disclosed. The computer-readable storage medium comprising instructions, which, when the instructions are executed by the mobile device as described herein, cause the mobile device to perform the method as also described herein.

[0064] As used herein, the terms “computer-readable data carrier” and “computer-readable storage medium” specifically may refer to non-transitory data storage means, such as a hardware storage medium having stored thereon computer-executable instructions. The computer- readable data carrier or storage medium specifically may be or may comprise a storage medium such as a random-access memory (RAM) and / or a read-only memory (ROM).

[0065] Thus, specifically, one, more than one or even all of method steps a) to c), and optionally one or more of steps d) to h), as indicated above, may be performed by using a computer or a computer network, e.g. the mobile device, preferably by using the computer program.

[0066] The invention in any one of the aspects described herein may provide for a large number of advantages over known methods and devices of this kind. Thus, specifically, the methods and devices of the present invention may address the technical challenges referred to above.

[0067] Specifically, the present invention may significantly increase the safety of medical operations. In particular, the proposed methods and devices may increase the chances of the user actually paying attention to critical information, i.e. ensuring that critical pieces of information are well digested. Thus, by deriving the item of perceptivity information about the user’s attention to the displayed critical screen, the proposed methods and devices may ensure that the user is actually watching the display of the mobile device, for example blocking a progression in the medical application until the user has actually perceived the critical information, thereby limiting handling errors and thus increasing safety of the medical operation.

[0068] Summarizing and without excluding further possible embodiments, the following embodiments may be envisaged:

[0069] Embodiment 1. A method of operating a medical application on a mobile device having at least one camera, e.g. a front camera, and having at least one display, wherein said method comprises deriving at least one item of perceptivity information about a user’s attention to at least one displayed critical screen, and wherein said method further comprises: a) receiving, e.g. from a cloud storage, a predefined set of critical screens comprising critical content, wherein the critical content comprises information about one or more of, or wherein the critical content comprises a request for confirmation of one or more of: applying of a sample of bodily fluid to at least one test field of an optical test element, an occurred error, injecting a bolus, controlling an insulin pump, delivering a medicament, a user authentication; b) displaying to a user, on the display of the mobile device, the at least one critical screen and deriving the at least one item of perceptivity information about the user’s attention to the displayed critical screen by i) receiving at least one eye movement of the user from the camera, e.g. capturing the eye movement by using the camera of the mobile device, and ii) evaluating the user’s eye movement, thereby deriving the item of perceptivity information; c) if the item of perceptivity information indicates that the user has perceived the critical content, prompting the user to confirm the critical content, e.g. by one or more of displaying a confirmation screen, activating a confirmation button, such as a previously greyed out confirmation button, displaying a confirmation button, such as a previously invisible information button.

[0070] Embodiment 2. The method according to the preceding embodiment, wherein the method comprises repeating steps b) to c) for each of the critical screens of the set of critical screens received in step a).

[0071] Embodiment s. The method according to any one of the preceding embodiments, wherein the item of perceptivity information comprises Boolean information, such as “perceived” or “not perceived”, specifically indicating one of the user has perceived the critical content; and the user has not (yet) perceived the critical content.

[0072] Embodiment 4. The method according to any one of the preceding embodiments, wherein the step b) ii) comprises determining an amount of time tg, wherein the time tgis a period of time during which the user’s eyes gaze on the display.

[0073] Embodiment 5. The method according to the preceding embodiment, wherein the item of perceptivity information indicates that the user has perceived the critical content if the amount of time tgis equal to, or larger than, a predefined time threshold tmin, e.g. tg> tmin.

[0074] Embodiment 6. The method according to the preceding embodiment, wherein tmin is adapted according to a user’s experience level, wherein the user’s experience level is set automatically based on a number of performed analyte detections by the user.

[0075] Embodiment 7. The method according to any one of the preceding embodiments, wherein step b) ii) comprises comparing the eye movement to a predefined eye movement pattern, such as a line of sight tracking pattern, for deriving the item of perceptivity information.

[0076] Embodiment 8. The method according to any one of the preceding embodiments, wherein the camera of step b) i) is a front camera of the mobile device, specifically a camera arranged on a front side of the mobile device, such as on the same side of the mobile device on which the display is arranged. Embodiment 9. The method according to any one of the preceding embodiments, wherein the method, specifically before performing any of steps a) to c), e.g. in an initial setup run, comprises d) prompting the user to one or more of indicate whether or not the user has at least one vision condition, specifically a vision condition preventing a standard line of sight, such as a vision condition from a predefined list of vision conditions, and select none, one or more than one vision conditions that apply to the user from a predefined list of vision conditions.

[0077] Embodiment 10. The method according to the preceding embodiment, wherein the predefined list of vision conditions comprises one or more of nystagmus, amblyopia, strabism, anisocoria, and ocular prosthesis.

[0078] Embodiment 11. The method according to any one of the preceding embodiments, wherein the method comprises e) automatically detecting whether or not a vision condition applies to the user from the eye movement received in step b) i).

[0079] Embodiment 12. The method according to the preceding embodiment, wherein in step e), in case a standard line of sight is not detectable within a predefined amount of time, a vision condition is detected.

[0080] Embodiment 13. The method according to any one of the four preceding embodiments, wherein in case a vision condition is detected, the method comprises one or more of considering none of the predefined set of critical screens received in step a) to be critical and thus not performing steps a) to c) of the method for a predefined number of measurements, and taking the vision condition into account when performing step b), e.g. by comparing the user’s eye movements to one or more of a predefined adapted set of eye movements, such as to an adapted eye movement pattern.

[0081] Embodiment 14. The method according to any one of the preceding embodiments, wherein the method, specifically after performing step c), further comprises: f) if the item of perceptivity information indicates, for a predefined amount of waiting time tw, that the user has not perceived the critical content, generating a reminder signal, wherein for this purpose, step b) comprises starting a control timer indicating the amount of time ts for which the critical screen is displayed, wherein the reminder signal is generated if ts > tw.

[0082] Embodiment 15. The method according to the preceding embodiment, wherein the reminder signal is one or more of an acoustic signal and a haptic signal, such as a vibration, e.g. generated by one or more elements of the mobile device, such as by a loudspeaker and / or a vibrator of the mobile device.

[0083] Embodiment 16. The method according to any one of the preceding embodiments, wherein the medical application comprises detecting at least one analyte in a sample of bodily fluid, wherein the critical content for at least one critical screen of the set of critical screens relates to the application of the sample of bodily fluid to the at least one test field of the optical test element, wherein, i.e. after the user has confirmed the application of the sample of bodily fluid on the confirmation screen displayed in step c), the method further comprises: g) receiving at least one image of at least a part of the test field of the optical test element, e.g. capturing the image by using the camera of the mobile device; h) detecting the analyte by evaluating the at least one image.

[0084] Embodiment 17. The method according to the preceding embodiment, wherein in step g), a back camera of the mobile device is used for capturing the image of the at least part of the test field, wherein the back camera is arranged on a back side of the mobile device, such as on a side opposing the side of the mobile device on which the display is arranged.

[0085] Embodiment 18. The method according to any one of the preceding embodiments, wherein the method is computer-implemented, specifically steps a) to c), and optionally one or more of steps d), e), f), g) and h), are computer-implemented.

[0086] Embodiment 19. A mobile device having at least one camera and at least one display, the mobile device being configured for operating a medical application on the mobile device by using the following steps:

[0087] A) receiving, e.g. from a cloud storage, a predefined set of critical screens comprising critical content, wherein the critical content comprises information about one or more of, or wherein the critical content comprises a request for confirmation of one or more of: applying of a sample of bodily fluid to the at least one test field of the optical test element, an occurred error, injecting a bolus, controlling an insulin pump, delivering a medicament, a user authentication;

[0088] B) displaying to a user, on the display of the mobile device, at least one critical screen and deriving at least one item of perceptivity information about the user’s attention to the displayed critical screen by

[0089] I) receiving at least one eye movement of the user from the camera, e.g. capturing the eye movement by using the camera of the mobile device, and

[0090] II) evaluating the user’s eye movement, thereby deriving the item of perceptivity information;

[0091] C) if the item of perceptivity information indicates that the user has perceived the critical content, displaying a confirmation screen for the critical content.

[0092] Embodiment 20. The mobile device according to the preceding embodiment, wherein the medical application comprises detecting at least one analyte in a sample of bodily fluid, i.e. the mobile device is configured for detecting the at least one analyte in the sample of bodily fluid, wherein the critical content for at least one critical screen of the set of critical screens relates to the application of the sample of bodily fluid to the at least one test field of the optical test element, wherein, i.e. after the user has confirmed the application of the sample of bodily fluid on the confirmation screen displayed in step C), the mobile device performs the following steps:

[0093] D) receiving at least one image of at least part of the test field of the optical test element, e.g. capturing the image by using the camera of the mobile device;

[0094] E) detecting the analyte by evaluating the at least one image.

[0095] Embodiment 21. The mobile device according to any one of the preceding embodiments referring to a mobile device, wherein the mobile device is configured for performing the method according to any one of the preceding embodiments referring to a method.

[0096] Embodiment 22. A kit comprising the mobile device according to any one of the preceding embodiments referring to a mobile device, the kit further comprising at least one optical test element having at least one test field configured for performing at least one optical detection reaction in the presence of the analyte in the sample of the bodily fluid, wherein the optical detection reaction is observable at at least one predetermined position on the test field.

[0097] Embodiment 23. A computer program comprising instructions which, when the program is executed by the mobile device according to any one of the preceding embodiments referring to a mobile device, cause the mobile device to perform the method according to any one of the preceding embodiments referring to a method.

[0098] Embodiment 24. A computer-readable storage medium comprising instructions which, when the instructions are executed by the mobile device according to any one of the preceding embodiments referring to a mobile device, cause the mobile device to perform the method according to any one of the preceding embodiments referring to a method.

[0099] Short description of the Figures

[0100] Further optional features and embodiments will be disclosed in more detail in the subsequent description of embodiments, preferably in conjunction with the dependent claims. Therein, the respective optional features may be realized in an isolated fashion as well as in any arbitrary feasible combination, as the skilled person will realize. The scope of the invention is not restricted by the preferred embodiments. The embodiments are schematically depicted in the Figures. Therein, identical reference numbers in these Figures refer to identical or functionally comparable elements.

[0101] In the Figures:

[0102] Figure 1 shows an embodiment of a part of a kit and a mobile device configured for operating a medical application; and

[0103] Figures 2 to 5 show different flow charts of a method of operating a medical operation by using a mobile device having at least one camera and at least one display.

[0104] Detailed description of the embodiments

[0105] In Figure 1, an exemplary embodiment of a part of a kit 110 is shown in a perspective view. The kit 110 comprises a mobile device 112, such as for example a smart phone, having at least one camera 114, e.g. a front camera 115, and at least one display 116. The mobile device 112 is configured for operating a medical application, such as for example for detecting at least one analyte in a sample of bodily fluid. The kit 110, besides the mobile device 110, further comprises at least one optical test element (not illustrated) having at least one test field configured for performing at least one optical detection reaction in the presence of the analyte in the sample of the bodily fluid. The optical detection reaction of the optical test element of the kit 110 is observable at at least one predetermined position on the test field. The mobile device 112, besides the camera 114 and the display 116, further comprises at least one processor 118. As an example, the mobile device 112 may comprise more than one camera 114, such as the front camera 115 and a back camera 120. Further, on the left side in Figure 1, a schematic drawing of an eye is illustrated as an example for a user gazing on the screen.

[0106] In particular, the mobile device 112 is configured for operating the medical application on the mobile device 112 by using the following steps:

[0107] A) receiving, e.g. from a cloud storage, a predefined set of critical screens comprising critical content, wherein critical content comprises information on or a request for confirmation of one or more of applying of a sample of bodily fluid to the at least one test field of the optical test element, an occurred error, injecting a bolus, controlling an insulin pump, delivering a medicament, a user authentication;

[0108] B) displaying to a user, on the display 116 of the mobile device 112, at least one critical screen and deriving at least one item of perceptivity information about the user’s attention to the displayed critical screen by

[0109] I) receiving at least one eye movement of the user from the camera 114, e.g. capturing the eye movement by using the camera 114 of the mobile device 112, and

[0110] II) evaluating the user’s eye movement, thereby deriving the item of perceptivity information;

[0111] C) if the item of perceptivity information indicates that the user has perceived the critical content, displaying a confirmation screen for the critical content.

[0112] Specifically, in case the medical application comprises detecting at least one analyte in a sample of bodily fluid, i.e. in case the mobile device 112 is configured for detecting the at least one analyte in the sample of bodily fluid, the critical content for at least one critical screen of the set of critical screens relates to the application of the sample of bodily fluid to the at least one test field of the optical test element, and, i.e. after the user has confirmed the application of the sample of bodily fluid on the confirmation screen displayed in step C), the mobile device may further be configured to perform the following steps:

[0113] D) receiving at least one image of at least part of the test field of the optical test element, e.g. capturing the image by using the camera of the mobile device;

[0114] E) detecting the analyte by evaluating the at least one image.

[0115] In particular, the mobile device 112 may be configured, for example by programming of the processor 118, for performing at least steps a) to c) of a method 122 of operating at least one medical application. The method 122 will be described with references to exemplary embodiments shown in flowcharts illustrated in Figures 2 to 5.

[0116] The method 122 of operating a medical application on a mobile device 112 having at least one camera 114, e.g. a front camera 115, and having at least one display 116 comprises deriving at least one item of perceptivity information about a user’s attention to a displayed critical screen. Further, the method 122 comprises the following steps, which may specifically be performed in the given order. Still, a different order may also be possible. It may be possible to perform two or more of the method steps fully or partially simultaneously. It may further be possible to perform one, more than one or even all of the method steps once or repeatedly. The method may comprise additional method steps, which are not listed. The method steps of the method 122 are the following: a) (denoted by reference number 124) receiving, e.g. from a cloud storage, a predefined set of critical screens comprising critical content, wherein the critical content comprises information about one or more of, or wherein the critical content comprises a request for confirmation of one or more of: applying of a sample of bodily fluid to at least one test field of an optical test element, an occurred error, injecting a bolus, controlling an insulin pump, delivering a medicament, a user authentication; b) (denoted by reference number 126) displaying to a user, on the display 116 of the mobile device 112, the at least one critical screen and deriving the at least one item of perceptivity information about the user’s attention to the displayed critical screen by i) (denoted by reference number 128) receiving at least one eye movement of the user from the camera 114, e.g. capturing the eye movement by using the camera 114 of the mobile device 112, and ii) (denoted by reference number 130) evaluating the user’s eye movement, thereby deriving the item of perceptivity information; c) (denoted by reference number 132) if the item of perceptivity information indicates that the user has perceived the critical content, prompting the user to confirm the critical content, e.g. by one or more of displaying a confirmation screen, activating a confirmation button, such as a previously greyed out confirmation button, displaying a confirmation button, such as a previously invisible information button.

[0117] Further, the method 122 may comprise the following step: d) (denoted by reference number 134) prompting the user to one or more of indicate whether or not the user has at least one vision condition, specifically a vision condition preventing a standard line of sight, such as a vision condition from a predefined list of vision conditions, and select none, one or more than one vision conditions that apply to the user from a predefined list of vision conditions.

[0118] In particular, step d) may be performed before performing any of steps a) to c), as exemplarily illustrated in Figure 3. For example, step d) may be performed in an initial set-up run.

[0119] Further, as an example, the medical application may be or may comprise detecting an analyte in a sample of bodily fluid. If that is the case, at least one of the critical screens may comprise the application of the sample of bodily fluid to the test field and, the method 122 may be referred to as method for detecting at least one analyte in a sample of bodily fluid. In such as case, specifically after the user has confirmed the application of the sample of bodily fluid in response to the confirmation screen of step c), the method 122 may further comprise the following steps: g) (denoted by reference number 136) receiving at least one image of at least a part of the test field of the optical test element, e.g. capturing the image by using the camera of the mobile de-vice; h) (denoted by reference number 138) detecting the analyte by evaluating the at least one image.

[0120] Additionally or alternatively, the method 122 may comprise further steps. As shown in Figure 5, the method 122 of operating a medical application on a mobile device 112 having at least one camera 114 and at least one display 116 may be initiated by starting the method sequence (denoted by reference number 140) and may, optionally, start with performing step d) 134, e.g. by an initial user prompt asking the user for known visual conditions. Further, information may be illustrated (denoted by reference number 142) on the display 116 of the mobile device 112, for example a standard medical application flow, e.g. informing the user about the progress of performing the method 122, this may also simply be referred to as “standard app flow”. Further, the method 122 may comprise a “critical screen” condition query (denoted by reference number 144), checking whether the displayed screen is one of a predefined set of critical screens and thus comprising critical content. In case in this condition query 144, it is decided that the displayed screen is not one of the critical screens, i.e. following a first branch 146, the medical application may be resumed, e.g. by following the standard flow, e.g. further informing the user about the progress of performing the method. Alternatively, however, in case in this condition query 144, it is decided that the displayed screen is one of the critical screens, i.e. following a second branch 148, the user’s eye movements may be received 128 and evaluated 130, e.g. also referred to as starting eye tracking and / or line of sight tracking (denoted by reference number 150.

[0121] In a further condition query (denoted by reference number 152), it may be checked whether a required line of sight is given, i.e. by following a first branch 154, or not, i.e. by following a second branch 156. In case the required line of sight is detected, i.e. following the first branch 154, a timer may be started (denoted by reference number 158), such as for determining tg, indicating the period of time during which the user’s eyes gaze and / or look at the display 116. In a further condition query (denoted by reference number 160), tgmay be compared to a predefined threshold time tmin, wherein, when tg> tmin, it may be considered that the user has perceived the critical content and the item of perceptivity information may be set to “perceived” (denoted by reference number 162).

[0122] In case in the condition query 152, the required line of sight is not detected, i.e. following the second branch 156, a check for defined vision conditions (denoted by reference number 164) may be performed, therefore, in further condition query 166 it may be checked whether a defined vision condition is detected, e.g. following a first branch 168, or not , e.g. following a second branch 170. As an example, specifically in case the detected vision condition is a defined vision condition, such as a vision condition following a predefined pattern, the first branch 168 may lead to yet a further condition query 172 checking whether the line of sight control can be corrected for the detected condition, e.g. following a first branch 174, or not, e.g. following a second branch 176. In case the line of sight is correctable, i.e. following the first branch 174, the vision condition may be taken into account when performing step b) 126. As an example for a correctable condition, in case the user has an ocular prosthesis, the line of sight may be corrected by only tracking the eye movement of the “good” or “alive” eye of the user and ignoring the eye movement of the ocular prosthesis. Thus, in case the line of sight control can be corrected, i.e. following the first branch 174, the line of sight control may be adapted to the detected vision condition (denoted by reference number 178). In case the line of sight is not correctable, i.e. following the second branch 176, as an example, the method 122 may comprise considering none of the predefined set of critical screens received in step a) 124 to be critical and thus not performing steps a) 124 to c) 132 of the method 122 for a predefined number of measurements, in other words, the critical screen line of sight control may be turned off (denoted by reference number 180).

[0123] In case in the condition query 166, no defined vision condition is detected, e.g. in case the vision condition is not identifiable, i.e. following the second branch 170, a counter may be started (denoted by reference number 182), counting the number of “no line of sight is given” events, and, specifically subsequently, a check whether a predefined maximum number of events is reached (denoted by reference number 184) may be performed. As long as the maximum number of events is not reached, e.g. following a first branch 186, the confirmation option may be blocked, i.e. the user may be blocked from confirming the critical content (denoted by reference number 188), wherein optionally the display 114 of the mobile device 112 may be flashed and / or an additional information may be shown as a pop-up window indicating the line of sight requirement. Further optionally a reminder signal may be generated (denoted by reference number 190), an acoustic trigger or vibration alert may be provided by the mobile device 112, e.g. attempting to re-gain the user’s attention. As an example, in case the "line of sight" is recognized, e.g. in block 182, the method may continue with and / or jump back to block 160. This sequence is indicated in Figure 5 by branch 191.

[0124] In block 182, as an example, the counter may be started only after a waiting time tw. In particular, the method may comprise that if no "line of sight" is detected, a waiting time tw may be waited for, e.g. still in block 182, then the user may be reminded, for example either by the flashing screen, e.g. in block 188, or by an acoustic or haptic signal, e.g. in block 190.

[0125] As soon as the maximum number of events is reached, e.g. following a second branch 192, the user may be prompted to disable the standard line of sight control (denoted by reference number 194), e.g. by acknowledging a given vision condition. In other words, the user may only be given the opportunity to switch off the line of sight control of block 194, in case the maximum number of reminders has taken place, as indicated by the query of block 184. Subsequently, e.g. in case the user indicates that the line of sight control is to be turned off and / or disabled, the method 122 may comprise turning off the critical screen line of sight control 180, for example by flagging the at least one critical screen, e.g. all of the screens of the predefined set of critical screens, as “non-critical”. However, in case the user indicates that the line of sight control of block 194 is to be kept on, e.g. the "line of sight control" should be kept activated, the counter in block 182 may be reset, e.g. a “reset counter” (denote by reference number 196) signal may be sent.

[0126] List of reference numbers kit mobile device camera front camera display processor back camera method step a) step b) step b) i) step b) ii) step c) step d) step g) step h) starting the method sequence illustrating information condition query first branch second branch start eye tracking and / or line of sight tracking condition query first branch second branch start timer tgcondition query set item of perceptivity information to “perceived” check for defined vision conditions condition query first branch second branch condition query 172 first branch second branch adapting line of sight control to detected vision condition turn off line of sight control counting number of events “no line of sight given” check of whether a maximum number of events is reached first branch blocking user from confirming the critical content generating reminder signal branch second branch prompting user to disable the standard line of sight control reset counter

Claims

Claims1. A method of operating a medical application on a mobile device (112) having at least one camera (114) and at least one display (116), wherein the medical application is one or more of detecting an analyte in a sample of bodily fluid, monitoring a blood glucose level, determining a bolus amount, controlling an insulin pump, delivering a medicament, user authentication to ensure that rights reserved for medical personnel are only granted to persons who have these rights, detecting vital signs, detecting a critical health condition, wherein said method comprises deriving at least one item of perceptivity information about a user’s attention to at least one displayed critical screen, and wherein said method further comprises: a) Receiving a predefined set of critical screens comprising critical content, wherein the critical content comprises information about one or more of, or wherein the critical content comprises a request for confirmation of one or more of: applying of a sample of bodily fluid to at least one test field of an optical test element, an occurred error, injecting a bolus, controlling an insulin pump, delivering a medicament, a user authentication; b) displaying to a user, on the display (116) of the mobile device (112), the at least one critical screen and deriving the at least one item of perceptivity information about the user’s attention to the displayed critical screen by i) receiving at least one eye movement of the user from the camera (114), and ii) evaluating the user’ s eye movement, thereby deriving the item of perceptivity information; c) if the item of perceptivity information indicates that the user has perceived the critical content, prompting the user to confirm the critical content.

2. The method according to the preceding claim, wherein the method comprises repeating steps b) to c) for each of the critical screens of the set of critical screens received in step a).

3. The method according to any one of the preceding claims, wherein the item of perceptivity information comprises Boolean information, such as “perceived” or “not perceived”.

4. The method according to any one of the preceding claims, wherein the step b) ii) comprises determining an amount of time tg, wherein the time tgis a period of time during which the user’s eyes gaze on the display.

5. The method according to the preceding claim, wherein the item of perceptivity information indicates that the user has perceived the critical content if the amount of time tgis equal to, or larger than, a predefined time threshold tmin, optionally wherein tmin is adapted according to a user’s experience level, wherein the user’s experience level is set automatically based on a number of performed analyte detections by the user.

6. The method according to any one of the preceding claims, wherein step b) ii) comprises comparing the eye movement to a predefined eye movement pattern and wherein the camera (114) of step b) i) is a front camera (115) of the mobile device (112).

7. The method according to any one of the preceding claims, wherein the method comprises d) prompting the user to one or more of indicate whether or not the user has at least one vision condition, and select none, one or more than one vision conditions that apply to the user from a predefined list of vision conditions.

8. The method according to any one of the preceding claims, wherein the method comprises e) automatically detecting whether or not a vision condition applies to the user from the eye movement received in step b) i); wherein in step e), in case a standard line of sight is not detectable within a predefined amount of time, a vision condition is detected.

9. The method according to any one of the two preceding claims, wherein in case a vision condition is detected, the method comprises one or more ofconsidering none of the predefined set of critical screens received in step a) to be critical and thus not performing steps a) to c) of the method for a predefined number of measurements, and taking the vision condition into account when performing step b).

10. The method according to any one of the preceding claims, wherein the method further comprises: f) if the item of perceptivity information indicates, for a predefined amount of waiting time tw, that the user has not perceived the critical content, generating a reminder signal, wherein for this purpose, step b) comprises starting a control timer indicating the amount of time ts for which the critical screen is displayed, wherein the reminder signal is generated if ts > tw, wherein the reminder signal is one or more of an acoustic signal and a haptic signal.

11. The method according to any one of the preceding claims, wherein the medical application comprises detecting at least one analyte in a sample of bodily fluid, wherein the critical content for at least one critical screen of the set of critical screens relates to the application of the sample of bodily fluid to the at least one test field of the optical test element, wherein the method further comprises: g) receiving at least one image of at least a part of the test field of the optical test element; h) detecting the analyte by evaluating the at least one image.

12. A mobile device (112) having at least one camera (114) and at least one display (116), the mobile device (112) being configured for operating a medical application on the mobile device (112) by using the following steps, wherein the medical application is one or more of detecting an analyte in a sample of bodily fluid, monitoring a blood glucose level, determining a bolus amount, controlling an insulin pump, delivering a medicament, user authentication to ensure that rights reserved for medical personnel are only granted to persons who have these rights, detecting vital signs, detecting a critical health condition:A) Receiving a predefined set of critical screens comprising critical content, wherein the critical content comprises information about one or more of, or wherein the critical content comprises a request for confirmation of one or more of:applying of a sample of bodily fluid to the at least one test field of the optical test element, an occurred error, injecting a bolus, controlling an insulin pump, delivering a medicament, a user authentication;B) displaying to a user, on the display (116) of the mobile device (112), at least one critical screen and deriving at least one item of perceptivity information about the user’s attention to the displayed critical screen byI) receiving at least one eye movement of the user from the camera (114), andII) evaluating the user’ s eye movement, thereby deriving the item of perceptivity information;C) if the item of perceptivity information indicates that the user has perceived the critical content, displaying a confirmation screen for the critical content.

13. A kit (110) comprising the mobile device (112) according to any one of the preceding claims referring to a mobile device (112), the kit (110) further comprising at least one optical test element having at least one test field configured for performing at least one optical detection reaction in the presence of the analyte in the sample of the bodily fluid, wherein the optical detection reaction is observable at at least one predetermined position on the test field.

14. A computer program comprising instructions which, when the program is executed by the mobile device (112) according to any one of the preceding claims referring to a mobile device (112), cause the mobile device (112) to perform the method according to any one of the preceding claims referring to a method.

15. A computer-readable storage medium comprising instructions which, when the instructions are executed by the mobile device (112) according to any one of the preceding claims referring to a mobile device (112), cause the mobile device (112) to perform the method according to any one of the preceding claims referring to a method.

Citation Information

Patent Citations

  • Electronic device for executing a plurality of applications and method for controlling the electronic device

    US10572104B2

  • Electronic device, electronic document control program, and electronic document control method

    US20130027302A1

  • Video game to monitor visual field loss in glaucoma

    US20130155376A1

  • Analyte Meter

    US20200365240A1

  • Gaze-based control

    US20210325960A1