Method for determining the concentration of an analyte in a body fluid - Patents.com

By aligning a mobile device camera with a test element using sensor data and validity tests, the method addresses inaccuracies in consumer electronic devices, ensuring precise analyte concentration determination in body fluids with reduced computational demands.

JP7592038B2Active Publication Date: 2024-11-29F HOFFMANN LA ROCHE & CO AG
View PDF 10 Cites 0 Cited by

Patent Information

Application Number
JP2021578088
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-07-01
Filing Date
2020-06-29
Publication Date
2024-11-29
Estimated Expiration
2040-06-29

AI Technical Summary

Technical Problem

Existing methods using consumer electronic devices with cameras for determining analyte concentrations in body fluids face challenges due to varying environmental and geometric conditions, particularly illumination and light reflection, leading to inaccuracies and the need for complex correction algorithms.

Method used

A method and apparatus that utilize a mobile device with a camera and a test element, employing sensor data to determine the angular orientation of the device relative to the test element, subject it to a validity test, and capture images only when aligned within a predetermined tolerance, allowing for accurate analyte concentration determination without complex image corrections.

Benefits of technology

This approach significantly reduces measurement errors by accounting for angular misalignments and light scattering, providing fast and accurate analyte concentration measurements using standard mobile devices with minimal resource usage.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007592038000001
    Figure 0007592038000001
  • Figure 0007592038000002
    Figure 0007592038000002
  • Figure 0007592038000003
    Figure 0007592038000003
Patent Text Reader

Abstract

A method for determining the concentration of at least one analyte in a bodily fluid by using a mobile device (112) and a test element (114) is disclosed. Further disclosed are a mobile device (112), a kit (110), and a computer-readable storage medium. The method comprises: a) determining an angular orientation of the mobile device (112) relative to a test element (114) by using sensor data of at least one sensor device (120) incorporated in the mobile device (112); b) subjecting the angular orientation of the mobile device (112) relative to the test element (114) to at least one validity test; c) capturing at least one image (128) of at least a portion of the test element (114) by using the camera (118), wherein the at least one image (128) includes at least a portion of the test field (116); d) determining the concentration of the analyte in the body fluid from the image (128); At least one of steps c) and d) is carried out by taking into account the results of the validity test of step b).
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a method for determining the concentration of an analyte in a body fluid by using a mobile device with a camera. The present invention further relates to a mobile device with a camera. The present invention further relates to a mobile device with a camera, a kit comprising a mobile device and at least one test element, a computer program, a computer program product and a computer readable storage medium. The present invention can be used in particular in medical diagnostics, for example for qualitatively or quantitatively detecting one or more analytes in one or more body fluids, such as for blood glucose measurement. However, other fields of application of the present invention are possible. [Background technology]

[0002] In the field of medical diagnostics, it is often necessary to detect one or more analytes from a sample of a bodily fluid, such as blood, interstitial fluid, urine, saliva, or other types of bodily fluids. Examples of analytes to be detected are glucose, triglycerides, lactate, cholesterol, or other types of analytes that are typically present in these bodily fluids. Depending on the concentration and / or presence of the analyte, appropriate treatments can be selected as needed. Without narrowing the scope, the present invention is specifically described with respect to blood glucose measurement. However, it should be noted that the present invention can also be used for other types of analytical measurements that use test elements such as test strips.

[0003] Generally, devices and methods known to those skilled in the art utilize test strips that contain one or more test chemicals, which can carry out one or more detectable detection reactions, such as optically detectable detection reactions, in the presence of the analyte to be detected.For these test chemicals, reference can be made, for example, to J.Hoenes et al.:The Technology Behind Glucose Meters:Test Strips,Diabetes Technology&Therapeutics,Volume 10,Supplement 1,2008,S-10 to S-26.Other types of test chemistries are possible and can be used to carry out the present invention.

[0004] Usually, one or more optically detectable changes in the test chemistry are monitored to extract the concentration of at least one analyte to be detected from these changes. In order to detect at least one change in the optical properties of the test field, various types of detectors, in particular customized detectors, are known in the art. Thus, various types of light sources for illuminating the test area and various types of detectors are known.

[0005] Furthermore, in addition to using customized detectors specifically developed for the purpose of optically detecting changes in the test chemicals contained in the corresponding test elements, recent developments aim to use widely available devices such as smartphones. However, when consumer electronic devices with cameras such as smartphones are used to determine analyte concentrations, new challenges arise, especially with regard to accuracy.

[0006] US9892505 discloses a method for determining vital parameters of a human body via a device, in particular a smart device, said device comprising an optical recording unit and a computing unit. The method includes recording a series of individual image data of a limited area of ​​the skin of the human body via the optical recording unit.

[0007] EP 2646809 discloses a test device for performing an assay. The test device comprises a container containing a reagent, the reagent being responsive to an applied test sample by developing a color or pattern change. The test device further comprises a portable device comprising a processor and an image capture device. The processor is adapted to correct the image for any rotational misalignment or skew. The processor is further adapted to determine the degree of error associated with any rotational misalignment or skew to correct the image. The processor is configured to process the data captured by the image capture device and to output a test result of the applied test sample. The test device is configured to reject the image if the degree of error associated with any rotational misalignment or skew is greater than a predetermined value.

[0008] US Patent No. 10,267,743 discloses a method for quantifying the color change of at least one test medium in a diagnostic instrument. The method includes capturing, with a digital camera, a digital image of at least a portion of the diagnostic instrument exposed to a biological sample, the diagnostic instrument comprising at least one color standard including a plurality of reference samples of different colors, and at least one test medium including a reagent that changes color in response to a concentration of a specific analyte in the biological sample. The method further includes identifying at least one reference sample of the plurality of reference samples for the at least one test medium in the diagnostic instrument, and determining a predominant camera-captured color of the at least one reference sample and a predominant camera-captured color of the at least one test medium. The method further includes estimating lighting conditions under which the digital image is captured. The method further includes correcting the predominant camera-captured color of the at least one test medium in response to a color correction factor derived at least in part from the predominant camera-captured color of the at least one reference sample to determine a corrected test medium color. The method ultimately includes determining a test result including an analyte concentration of the biological sample by comparing the corrected test media color to a set of possible test media colors corresponding to a predetermined analyte concentration, the set of possible test media colors responsive to the estimated lighting conditions under which the digital image is captured.

[0009] WO 2012 / 131386 discloses a test device for performing an assay comprising a container containing a reagent that reacts to an applied test sample by developing a colour or pattern change, and a portable device, for example a mobile phone or laptop, comprising a processor and an image capture device, the processor configured to process data captured by the image capture device and to output a test result of the applied test sample.

[0010] WO 2018 / 166533 describes an exemplary method for improving the placement of an adapter on a mobile computing device to measure a test strip coupled to the adapter using a camera and a screen on a face of the mobile computing device. The method can include displaying a light area on a first portion of the screen. The first portion can be adjacent to the camera. The light area and the camera can be aligned with a key area of ​​the test strip such that the camera is configured to capture an image of the key area. The method can further include providing first guide information for a user to place the adapter on the mobile computing device according to a position of the light area on the screen.

[0011] EP 1 801 568 A1 discloses a method in which a camera is placed on a test strip to detect graphically a color indicator and a reference color area. A measurement of the relative position between the camera and the test strip is determined and compared with an area of ​​a desired value. During a deflection between the measurement and the desired value, the camera is moved to reduce the deflection relative to the strip. The image area assigned to the indicator is localized in the color image detected by the camera. The concentration of the analyte is determined in the sample by the comparison value. Independent claims are also included for: a computer program executed on a camera programmed by a microprocessor, a server having a microcomputer including a memory, a test strip for determining an analyte concentration in a sample of a biological fluid.

[0012] EP 3 477 270 A1 describes a method for assessing the suitability of a mobile device having at least one camera for the purpose of performing analytical measurements based on color-forming reactions, the method comprising providing at least one mobile device having at least one camera, providing at least one object having at least one reference color field, obtaining at least one image of at least a part of the reference color field by using the camera, and deriving at least one item of color resolution information by using the image.

[0013] US Patent No. 9,311,520 discloses a method and electronic device for performing color-based reaction testing of biological materials. The method includes capturing and interpreting digital images of unexposed paddles and paddles exposed later at various delay times in an automatically calibrated environment. The test paddles include several test-specific sequences of unique identification features (UIDs), reference color bars (RCBs) that provide standardized color samples for image color calibration, and chemical test pads (CTPs). The method further includes locating the paddles in the images, extracting the UIDs and verifying the paddles, extracting the RCBs, and locating several CTPs in each image. The method further reduces image noise of the CTPs and automatically calibrates the images according to illumination measurements performed on the RCBs. To determine the test results, the method further determines several distances between the CTPs and their possible loci in the color space described by the manufacturer interpretation color chart.

[0014] U.S. Patent No. 9,285,323 describes a method for color quantification of chemical test pads and titration of analytes that can be performed under different lighting conditions. In one embodiment, the lighting conditions under which the digital images are captured are estimated and utilized to select a set of reference colors against which the quantified colors are compared to determine the titration. In another embodiment, multiple comparisons are performed under different lighting conditions and the result with the highest confidence level is selected to determine the titration.

[0015] Thus, despite the advantages associated with using consumer electronic devices with cameras for the purpose of detecting analytes in samples or evaluating analytical measurements, some technical challenges remain, particularly in terms of measurement accuracy. These challenges are mainly due to the fact that measurements are typically performed under various environmental and geometrical conditions when using consumer electronic devices, as opposed to measurements performed under laboratory conditions or using customized analytical measurement devices. In particular, changing conditions of illumination and light reflection remain an issue and remain a major factor to be considered in order to increase measurement accuracy. Furthermore, when using custom electronic devices, fast and simple algorithms and procedures are required to take into account the limited resources of consumer electronic devices and to avoid complex and inconvenient measurement steps. Thus, elaborate correction algorithms should typically be avoided in measurements performed in the field by using consumer electronic devices. Issues to be resolved

[0016] It is therefore desirable to provide a method and device that addresses the above-mentioned shortcomings of known devices and methods. In particular, a method for determining the concentration of at least one analyte in a body fluid, as well as a corresponding device, should be proposed that provides a fast, efficient and still accurate measurement even under varying measurement conditions. Summary of the Invention

[0017] This problem is addressed by a method for determining the concentration of an analyte in a body fluid by using a mobile device with a camera, a mobile device with a camera and a kit comprising a mobile device and at least one test element, with the features of the independent claims. Advantageous embodiments, which can be realised alone or in any combination, are set out in the dependent claims.

[0018] When used below, the terms "have", "comprise" or "include" or any grammatical variants thereof are used inclusively. Thus, these terms may refer both to the situation where, in addition to the features introduced by these terms, no further features are present in the entity described in this context, and to the situation where one or more additional features are present. As an example, the expressions "A has B", "A comprises B" and "A includes B" may both refer to the situation where, apart from B, no other elements are present in A (i.e., A consists solely and exclusively of B), and to the situation where, apart from B, one or more further elements are present in the entity A, such as element C, elements C and D, as well as further elements.

[0019] Furthermore, it should be noted that the terms "at least one," "one or more," or similar expressions indicating that a feature or element may be present one or more times are typically used only once when introducing each feature or element. In the following, in most cases, when referring to each feature or element, the expressions "at least one" or "one or more" will not be repeated, despite the fact that each feature or element may be present one or more times.

[0020] Furthermore, when used below, the terms "preferably", "more preferably", "particularly", "more particularly", "particularly", "more specifically" or similar terms are used in conjunction with any feature without limiting the possibility of substitution. Thus, the features introduced by these terms are optional features and are not intended to limit the scope of the claims in any way. The present invention can be implemented by using alternative features, as recognized by those skilled in the art. Similarly, features introduced by "in an embodiment of the present invention" or similar expressions are intended to be optional features without limitations on alternative embodiments of the present invention, without limitations on the scope of the present invention, and without limitations on the possibility of combining the feature introduced in such a way with other optional or non-optional features of the present invention.

[0021] In a first aspect of the invention, a method for determining the concentration of at least one analyte in a body fluid by using a mobile device and a test element is proposed, where the mobile device has a camera and the test element has at least one test field. The method comprises the following steps, which can be performed in particular in a given order. Moreover, different orders can also be possible. Furthermore, two or more method steps may be performed fully or partially simultaneously. Furthermore, one or more, or even all method steps may be performed once or repeatedly. The method may comprise additional method steps not described herein. In general, a method for determining the concentration of an analyte in a body fluid by using a mobile device with a camera comprises the following steps: a) determining an angular orientation of the mobile device relative to a test element by using sensor data of at least one sensor device integrated in the mobile device; b) subjecting the angular orientation of the mobile device relative to the test element to at least one validity test; c) capturing at least one image of at least a portion of the test element by using a camera, the at least one image comprising at least a portion of the test field; d) determining the concentration of an analyte in the body fluid from the image.

[0022] wherein at least one of steps c) and d) is carried out by taking into account the result of the validity test of step b).

[0023] The term "analyte" as used herein is a broad term and should be given its ordinary and customary meaning to one of skill in the art and should not be limited to any special or customized meaning. The term can specifically refer to any chemical, biochemical or biological substance, component or compound, such as, but not limited to, a molecule, e.g., glucose, triglyceride, lactate or cholesterol.

[0024] The term "determining the concentration of an analyte", which may also be referred to as analytical measurement or determination of an analyte concentration, as used herein, is a broad term and should be given its ordinary and customary meaning to those skilled in the art and should not be limited to a special or customized meaning. The term may specifically refer to, but is not limited to, the quantitative and / or qualitative determination of at least one analyte in a sample. By way of example, the result of an analytical measurement may be the concentration of the analyte and / or the presence or absence of the analyte to be determined.

[0025] The term "body fluid" as used herein is a broad term and should be given its ordinary and customary meaning to those skilled in the art and should not be limited to any special or customized meaning. The term can specifically refer to a liquid sample that includes at least one body fluid, such as, but not limited to, blood, interstitial fluid, urine, saliva, etc.

[0026] The term "mobile device" as used herein is a broad term and should be given its ordinary and customary meaning to those skilled in the art and should not be limited to a special or customized meaning. The term can specifically refer to, but is not limited to, a mobile electronic device, more specifically a mobile communication device comprising at least one processor. The mobile device can specifically be or comprise one or more of a mobile phone or a smartphone. Additionally or alternatively, the mobile device can also refer to a tablet computer or another type of handheld computer having at least one camera. In addition to the at least one camera, the mobile device can further comprise at least one illumination source that can be used to illuminate the test element or a portion thereof, in addition to at least one optional processor, which will be outlined in more detail below. Thus, by way of example, the mobile device can comprise at least one light emitting diode.

[0027] The term "camera" as used herein is a broad term and should be given its ordinary and customary meaning to those skilled in the art and should not be limited to a special or customized meaning. The term can specifically refer to a device configured to record spatially resolved optical data, such as, but not limited to, one or more images. The camera can specifically comprise one or more imaging devices, such as camera chips or imaging chips, e.g., CCD and / or CMOS chips. The camera, particularly the imaging device, can comprise a one-dimensional or two-dimensional array of image sensors, such as pixels. By way of example, the camera can comprise at least 10 pixels in at least one dimension, such as at least 10 pixels in each dimension. However, it should be noted that other cameras can also be used. The present invention is specifically intended to be applicable to cameras typically used in mobile applications, such as notebook computers, tablets, or mobile phones, particularly smartphones. Thus, specifically, the camera can be part of a mobile device that comprises, in addition to at least one camera, one or more data processing devices, such as one or more data processors. However, other cameras can also be used. In addition to at least one camera chip or imaging chip, the camera can comprise further elements, such as one or more optical elements, e.g., one or more lenses. By way of example, the camera may be a fixed focus camera having at least one lens that is fixedly adjusted relative to the camera, however, alternatively the camera may also be equipped with one or more variable lenses that can be adjusted automatically or manually.

[0028] The term "test element" as used herein is a broad term and should be given its ordinary and customary meaning to those skilled in the art and should not be limited to a special or customized meaning. The term can specifically refer to any element or device configured to detect an analyte or determine the concentration of an analyte in a liquid sample, such as, but not limited to, a bodily fluid, specifically a sample of a bodily fluid. The test element can specifically be or include a test strip, such as an optical test strip, specifically a test strip having a polymeric substrate, such as a polyester, e.g., Melinex.

[0029] The term "test field" as used herein is a broad term and should be given its ordinary and customary meaning to those skilled in the art and should not be limited to any special or customized meaning. The term can specifically refer to a coherent amount of at least one test chemical, such as, but not limited to, a circular, polygonal or rectangular area having one or more layers of material with at least one layer of the test field having the test chemical contained therein. Other layers can be present in the test field to provide specific optical properties, such as reflective properties, provide diffusion properties to diffuse the sample, or provide separation properties, such as separation properties of particulate components of the sample, such as cellular components.

[0030] A test element, particularly a test strip, more particularly an optical test strip, may comprise at least one substrate, such as at least one carrier, to which at least one test field is applied or incorporated. By way of example, the at least one carrier may be in the form of a strip. These test strips are widely used and available in the public. A test strip may carry a single test field or multiple test fields with the same or different test agents contained therein. An optical test strip, particularly a test field containing a test chemical, may in particular undergo a detection reaction, particularly a color reaction, in the presence of at least one analyte, and the color formation may be related, for example proportional, to the concentration of the analyte. The presence, absence and / or concentration of the analyte may be detectable by the detection reaction, and therefore the detection reaction may also be referred to as an analyte detection reaction. Some basic principles regarding test elements and reagents that may also be used within the scope of the present invention are described, for example, in J. Hones et al.: Diabetes Technology and Therapeutics, Vol. 10, Supplement 1, 2008, pp. 10-26.

[0031] The term "angular orientation" as used herein and specifically in step a) is a broad term and should be given its ordinary and customary meaning to those skilled in the art and should not be limited to a special or customized meaning. The term can specifically refer to an orientation of an object in space, such as, but not limited to, an orientation determined by one, two, three or more angular coordinates in a coordinate system. By way of example, the angular orientation can include information regarding at least one angle between an axis determined by the orientation of the mobile device, such as the optical axis of a camera, and an axis of a test element, such as an axis oriented perpendicular to one or more of the test elements or test fields. Other methods of determining the angular orientation are also feasible.

[0032] The term "sensor device" as used herein is a broad term and should be given its ordinary and customary meaning to those skilled in the art and should not be limited to a special or customized meaning. The term can specifically refer to, but is not limited to, any device or combination of elements configured to determine at least one measurable variable and / or at least one measurable characteristic of an object. By way of example, the at least one sensor device of the mobile device can comprise at least one of an angle sensor, an orientation sensor, a magnetic field sensor, an acceleration sensor, or a gyro sensor. The at least one sensor device can specifically be configured to generate at least one sensor signal, more specifically at least one electronic sensor signal, which can be used directly or indirectly as sensor data, for example after electronic pre-processing. Thus, the sensor data can directly or indirectly represent at least one sensor signal indicative of at least one measurable variable and / or measurable characteristic determined by the sensor device. The sensor data may be or include one or more of digital data or analog data. This type of device is commonly implemented in many mobile devices, such as many smartphones and / or portable computers, such as tablet computers or notebooks.

[0033] The determination of the angular orientation by using the sensor data of the at least one sensor device can be performed in various ways, as will be explained in more detail below. Thus, by way of example, firstly, the orientation of the at least one test element may be determined, such as by assuming or measuring the orientation of the support on which the at least one test element rests, such as by using at least one sensor device remote from the mobile device. Secondly, before or after the aforementioned steps, the orientation of the at least one mobile device can be determined by using at least one sensor device. The orientation of the mobile device relative to the test element can be determined, such as mathematically, by comparing the orientation of the test element with the orientation of the mobile device. By way of example, the step of determining the angular orientation of the mobile device relative to the test element can be performed or supported by using at least one processor of the at least one mobile device. The determination of the angular orientation may in particular be fully or partially software-implemented in the processor.

[0034] The term "validity test" as used herein is a broad term and should be given its ordinary and customary meaning to those skilled in the art and should not be limited to a special or customized meaning. The term may specifically, but not limited to, refer to a process of determining whether one or more predetermined or determinable validity conditions are met. Thus, subjecting the angular orientation of the mobile device relative to the test element to at least one validity test may specifically include determining whether the angular orientation satisfies one or more predetermined or determinable validity conditions. By way of example, the validity test may include checking whether the angular orientation is within at least one predetermined range and / or may include comparing the angular orientation to one or more predetermined or determinable thresholds or limits. As outlined in more detail below, the validity test may specifically include comparing the angular deviation between an axis of the test element, such as an axis perpendicular to the test field of the test element, and an axis of the mobile device, such as the optical axis of the camera, to at least one tolerance threshold. By way of example, ideally the deviation may be zero, but a predetermined tolerance may be provided. Other ways of performing the validity test are also feasible. Again, the validity testing may in particular be performed fully or partially using at least one processor of the mobile device and / or may be fully or partially software implemented, such as by software implemented in the processor.

[0035] Additionally or alternatively, the validity test may be or may include checking whether the angular orientation of the mobile device relative to the test element is within a predetermined range, such as within at least one tolerance threshold specified for at least one coding function of the set of coding functions. The coding function, and in particular the set of coding functions, may be predetermined and may be stored in a database or memory, for example a memory of the mobile device.

[0036] The term "encoding function" as used herein is a broad term and should be given its ordinary and customary meaning to those skilled in the art and should not be limited to a special or customized meaning. The term may specifically, but not exclusively, refer to any conversion algorithm for converting the color or intensity of a test field from an image, specifically the color or intensity of a test field wetted by the sample being analyzed, to a corresponding concentration of an analyte in the sample. To this end, by way of example, the encoding function may include one or more of an analytical function, a matrix algorithm or operation, a curve, such as one or more one-dimensional, two-dimensional, three-dimensional or four-dimensional curves, and a table, such as a look-up table. In particular, one encoding function may be or may include information regarding the concentration of an analyte for one particular color or intensity and one angular orientation of the mobile device relative to the test element.

[0037] The set of coding functions may specifically include multiple coding functions, such as multiple coding functions of different colors or intensities and different angular directions. In particular, the set of coding functions may include multiple subsets of coding functions, where each subset of coding functions may include multiple coding functions of different colors or intensities in one particular angular direction. Thus, in the set of coding functions, the coding functions may be grouped or sorted according to their designated angular directions.

[0038] When subjecting the angular orientation of the mobile device relative to the test element to at least one validity test, the validity test may include, for example, checking whether there is a coding function in the set of coding functions for which this angular orientation is within a predefined threshold limit of a specified angular orientation of the coding function.

[0039] The term "image" as used herein is a broad term and should be given its ordinary and customary meaning to those skilled in the art and should not be limited to a special or customized meaning. The term can specifically refer to, but is not limited to, a set of spatially resolved optical data. The set of spatially resolved optical data can specifically include optical information about an area of ​​an object. An image can also be a sub-image of a larger image, for example, a subset of spatially resolved optical data of a larger set of spatially resolved optical data. Thus, an image of an object can be subdivided into a plurality of two or more sub-images, each of which can be considered an image by itself.

[0040] The at least one image captured in step c) may be an image of the entire test element or a part thereof. The image includes at least an image of the entire test field or a part thereof. As a result, at least a part of the test field is visible in the at least one image. Furthermore, other parts of the test element, such as the substrate of the test element, in particular at least a part of the test strip, such as at least one white part of the test strip, may be visible in the at least one image. At least one additional part of the test element visible in the at least one image may also be used for evaluation purposes.

[0041] As outlined above, in step d) the concentration of the analyte in the body fluid is determined from the image. By way of example, the step may comprise deriving at least one item of information from the image, such as at least one item of color information, e.g. at least one item of color information indicative of a detection reaction taking place in the test field. By way of example, at least one item of color information indicative of the reflectance of the test field which varies with the concentration of the analyte in the body fluid may be derived. These methods for determining the concentration of the analyte in the body fluid from the at least one item of color information derived from the image are generally known to those skilled in the art.

[0042] As outlined above, at least one of steps c) and d) is performed by taking into account the results of the validity test performed in step b). Thus, several possibilities exist, as outlined in more detail below. Firstly, the capture of at least one image in step c) can therefore be performed depending on the results of the validity test. An image can be captured only if the validity test returns a certain result, such as, for example, an angular orientation of the mobile device relative to the test element that is within a predefined tolerance range. Additionally or alternatively, secondly, the determination of the concentration of the analyte in the body fluid from the image can be performed depending on the results of the validity test. Thus, the captured image can be used for the concentration determination only if the validity test returns a certain result, such as, for example, an angular orientation of the mobile device relative to the test element when capturing the image that is within a predefined tolerance range.

[0043] As outlined above, the validity test in step b) can be performed in various ways. In particular, the validity test in step b) can include comparing at least one angular orientation of the mobile device relative to the test element, such as one or more angle values ​​indicative of the angular orientation, with at least one target orientation. The target orientation can be, for example, a specific angle or a combination of angles indicative of the angular orientation of the mobile device relative to the test element. By way of example, as outlined above, the target orientation can be an orientation in which an axis perpendicular to the test element, test strip or test field is oriented parallel to the optical axis of the camera of the mobile device. The target orientation can be, for example, predetermined or predefined.

[0044] The target direction may be a direction in which an axis perpendicular to the test element, test strip or test field is oriented at a predetermined and / or predefined angle with respect to the optical axis of the camera of the mobile device. In particular, the target direction may be a direction in which an axis perpendicular to the test element, test strip or test field is oriented non-parallel to the optical axis of the camera of the mobile device. In particular, the target direction, such as the angle θ between the test strip or test field and the mobile device, e.g. the optical axis of the mobile device, may be, for example, θ≠0°. By way of example, the target direction may be 0°<θ≦50°, in particular 1°≦θ≦45°, more particularly 5°≦θ≦40°.

[0045] The validity test can return at least one test result. The test result can be or include a Boolean result such as "true" / "false" or "valid" and "invalid" as examples. In particular, the validity test can determine that the angular orientation of the mobile device relative to the test element is valid if the angular orientation deviates from the target orientation by no more than at least one predefined angular tolerance, or can determine that the angular orientation of the mobile device relative to the test element is invalid if the angular orientation deviates from the target orientation by more than at least one predefined angular tolerance.

[0046] The angular tolerance may, by way of example, indicate a maximum deviation in the angular orientation from a parallel orientation between the test field and the camera, i.e. between the optical axis of the camera and an axis perpendicular to the test field and / or test element, for example a maximum deviation of not more than 20°, in particular not more than 10°, more in particular not more than 5°. If the result of the validity test is taken into account when performing one or both of steps c) or d), by way of example a Boolean variable may be taken into account in the result of the validity, such as by enabling and / or triggering the execution of step c) only if the test result has a specified value, such as "valid", and / or by determining the concentration of step d) only for one or more images, for which the test result has a specified value, such as "valid".

[0047] As outlined above, the result of the validity test can be used for one or more of the blocking, allowing the capture of at least one image to be triggered. However, additionally or alternatively, the result of the validity test may be used when determining the concentration of an analyte in a bodily fluid, such as by evaluating only those images captured under conditions where the validity test returns a specified value, such as "valid."

[0048] Thus, in particular, the method may include monitoring an angular orientation of the mobile device relative to the test element. The monitoring may be performed, by way of example, continuously, at regular time intervals, or at designated times. The monitoring may include repeated execution of a validity test. Test results of the validity test may be recorded. The method may include blocking capture of at least one image if the validity test determines that the angular orientation of the mobile device relative to the test element is invalid, such as outside of an acceptable range. The method may further include unblocking capture of at least one image if the validity test determines that the angular orientation of the mobile device relative to the test element is valid. Additionally or alternatively, the method may include automatically initiating, such as automatically triggering capture of at least one image, if the validity test determines that the angular orientation of the mobile device relative to the test element is valid.

[0049] The term "capture" as used herein is a broad term and should be given its ordinary and customary meaning to one of ordinary skill in the art and should not be limited to any special or customized meaning. The term may specifically refer to the recording of at least one image, such as, but not limited to, the recording of image data of at least one image. The image data may specifically be stored in at least one data storage device, such as at least one data storage device of a mobile device.

[0050] differenceAdditionally, the method includes acquiring an image stream, such as a continuous image stream, by using a camera. 。 These image streams are typically obtained when viewing a live scene, for example via a display of a mobile device, such as a smartphone. The image stream can therefore typically comprise a series of images that may only be temporarily recorded, such as for the purpose of displaying a current image of the stream on a display, such as in real time. The capture of the at least one image in step c) may comprise selecting at least one image from the image stream. The capture in step c) may further comprise storing the selected image in at least one data storage device.

[0051] The selection of at least one image from the image stream may for example depend on the result of the validity test of step b), Self Thus, by way of example, as soon as a validity test returns an angular orientation of the mobile device relative to the test element that is within a predetermined tolerance, either in real time or at a later time, one or more corresponding images can be selected from the registry and used as the one or more captured images.

[0052] At least one image may be selected from the image stream, in particular if the image was acquired at a time when the validity test determines the angular orientation of the mobile device relative to the test element to be valid. Additionally or alternatively, at least some of the images of the image stream may be flagged with at least one item of information regarding whether the image was acquired at a time when the validity test determines the angular orientation of the mobile device relative to the test element to be valid. To be Thus, the result of the validity test may be used, for example, to select at least one image from the image stream, difference used to flag all or at least a portion of the images in the image stream for further processing. Will beThus, by way of example, an image stream may be at least partially stored, comprising images for which e.g. a validity test returns a result of an angular orientation that is valid or within a predefined tolerance, and in processing the image stream, one or more images of the image stream flagged as valid may be used as captured images to determine the concentration of an analyte in a body fluid. Thus, in general, step d) may be performed at least partially based on at least one image flagged with an item of information indicating that the image was taken at a time at which the validity test determines the angular orientation of the mobile device relative to the test element as valid.

[0053] This method, vinegar Step C) teeth and capturing one or more still images by using the camera when at least one image in the image stream is flagged with an item of information indicating a valid image or indicating that at least one image is valid. 。 Therefore, still images are picture Select from image stream Not , separately using the still image mode of the mobile device's camera. Captured To import still images, picture It is started automatically when an image in the image stream is flagged by an information item indicating a valid image. 。 A still image is generated when an image in the image stream is flagged as valid. Captured Furthermore, step d) is performed at least in part on at least one still image. Will be .

[0054] The resolution of the images in the image stream can generally be lower than the spatial resolution of a particular still image captured by the camera, where the spatial resolution can refer to the n×m pixel resolution of the image. Furthermore, in terms of signal dynamics, the image stream can generally only provide images with 8-bit resolution for each of the R, G, and B color channels, while the captured still images can also provide images with a higher resolution, for example, at least 10-bit resolution. Furthermore, the time interval between two captured images can be larger for the captured still images than for the images in the image stream. Generally, the optical measurement of the color-forming response of the test strip can use a selected image from the image stream to evaluate the test field at the appropriate time.

[0055] In particular, low-end and / or older mobile devices can provide images from image streams that often have a low pixel resolution, for example a VGA resolution of 640x480 pixels. The number of pixels per reference field, in particular per gray reference field, can therefore generally be low. Furthermore, the image stream can have low signal dynamics in each of the R, G, B color channels and therefore can only provide limited possibilities for mapping the measurement signals of the colors of the test fields to usable measured values. For example, the measurement range of a glucose concentration can typically be within the range of 0 to 600 mg / dl. If the captured image has an 8-bit dynamics with a lower limit of 50 counts and an upper limit of 200 counts, the resulting measurement range can be 4 mg / dl per count of the measurement signal.

[0056] Thus, as outlined above, the method comprises: vinegar In step c), capturing one or more still images and / or at least one image stream by using a camera. 。For example, the image stream can be used for user guidance and / or validity testing and / or dynamics testing of the images. Thus, when an image in the image stream is flagged as valid, one or more still images are captured separately from the image stream. 。 The at least one still image provides improved spatial resolution and / or higher dynamics compared to images from the image stream. 。 Still images can provide a higher number of pixels for each reference field due to a higher spatial resolution and therefore a higher statistical significance for the color information items of the test fields derived from the images. Furthermore, still images can provide improved measurement performance due to higher dynamics. Therefore, this approach can improve compatibility with more different mobile devices and also improve the measurement performance of the color of the test fields.

[0057] As outlined above, there are various methods for determining the angular orientation of the mobile device relative to the test element. Thus, by way of example, step a) may be performed at least in part under the assumption that the test element is oriented in a predefined direction. This assumption is often valid when the test element is placed on a table or another support having a predefined angular orientation. By way of example, the predefined direction may be horizontal, as is often the case for tables or other supports used in daily work.

[0058] Additionally or alternatively, and as mentioned above, the angular orientation of the support on which the test element rests during the capture of the image can be checked, for example before or after performing step c), by using a mobile device. Thus, by way of example, the method can further comprise determining the angular orientation of the test element by placing the mobile device on the support surface and determining the angular orientation of the support surface. This determination of the angular orientation of the support surface may also be performed by using sensor data of at least one sensor device integrated in the mobile device. Again, this step of determining the angular orientation of the support surface, for example in the coordinate system of the mobile device, can be performed at least partly automatically, for example user-initiated or automatically without user interaction, for example by assuming that the user places the mobile phone on the support surface at least once during the method, for example during the application of a sample of body fluid to the test element, in particular the test field. The step of determining the angular orientation of the support surface can again be fully or partly software-implemented. In step a), the test element can be placed on the support surface. Therefore, since the angular orientation of the support surface is known and therefore the angular orientation of the test element is known, and furthermore the orientation of the mobile device during capturing at least one image is also known or can be determined by using sensor data of at least one sensor device, the relative angular orientation of the mobile device to the test element can be determined by comparing the angular orientation of the test element with the angular orientation of the mobile device.

[0059] As outlined above, the method may further comprise applying at least one sample of bodily fluid to the test element. The application of the sample of bodily fluid to the test element may in particular be performed at least once before performing step c). Furthermore, step c) may also be performed repeatedly, step c) may be performed at least once without applying at least one sample of bodily fluid to the test element, and at least one repetition of step c) is performed after applying the sample of bodily fluid to the test element. Thereby, at least one dry image may be captured without applying a sample to the test field, and furthermore, at least one wet image may be captured in step c) with the application of a sample to the test field. In step d), at least the wet image may be used, but furthermore, the dry image may also be used, for example, for reference purposes. In both cases, as outlined above, in addition to at least a part of the test field visible in the image, optionally at least one further part of the test element, such as a white area and / or a different part, such as a color reference card, may be visible and used for evaluation purposes. Thus, by way of example, a relative value of at least one color information item with respect to a reference portion, such as a white field, can be derived for both the at least one wet image and any at least one dry image. Thus, by way of example, the concentration of an analyte can be determined by comparing the relative value of at least one color information item of a reference field, such as a white field, with the relative value of at least one color information item of a test field, of the at least one wet image and the at least one dry image. However, alternatively, only the relative value of the at least one color information item of the test field with respect to the at least one color information item of the reference field of the wet image may be used to determine the analyte concentration. Again, alternatively, only the at least one color information item of the test field of the wet image may be used to determine the analyte concentration. The at least one optional reference field may be part of a test element, for example a reference card or a reference element.A reference card or reference element having at least one optional reference field, such as at least one color reference field, may be placed within the field of view of the camera during image capture in step c) or may additionally or alternatively be part of an additional reference image captured independently.

[0060] Thus, in general, step c) may further comprise capturing at least one dry reference image, also simply called a dry image, of at least a portion of the test element before the body fluid is applied to the test element. Step c) may then further comprise capturing at least one measurement image, also simply called a wet image, of at least a portion of the test element after the body fluid is applied to the test element. In step d), both the dry image and the measurement image may be taken into account to determine the concentration of the analyte in the body fluid. Here, in general, steps a), b) and c) may be performed at least once to capture a dry image and at least once to capture a measurement image. Thus, the angular orientation of the mobile device relative to the test element, the validity test, and the capture of the image may be performed for both the dry and wet conditions.

[0061] Step c) may further comprise capturing at least one color reference image, also simply referred to as reference image, of the at least one color reference, which in step d) is taken into account for determining the concentration of the analyte in the body fluid. However, additionally or alternatively, as outlined above, in the wet state and optionally in the dry state, the at least one image captured in step c) may also comprise the color reference, for example as part of the image, for example as a white portion of the test strip visible in the image.

[0062] The method may generally include providing user guidance to guide the user towards a target orientation of the mobile device relative to the test element, for example the same target orientation as optionally used in the validity test. The user guidance may specifically include visual guidance on the display of the mobile device. This kind of user guidance may include any kind of visual guidance indicating a target state of the angular orientation and a current state of the angular orientation to allow the user to target the mobile device, such as by bringing an indicator of the current orientation as close as possible to an indicator of the target orientation. As an example, circles may be used for the target orientation and the current orientation, or other visual indicators as commonly known, for example a leveling device.

[0063] The method according to the invention can be specifically implemented so as not to imply a mathematical correction of at least one image for angular misalignment. In particular, the method can be implemented so that no information regarding the angular orientation of the mobile device relative to the test element is derived from the at least one image. Thus, the method can generally avoid the analysis of geometric image data for determining the angular orientation. By avoiding the analysis of geometric image data for determining the angular orientation of the mobile device relative to the test element, for example by using only sensor data of the mobile device, the method can be more efficient than methods based on image analysis for determining the angular orientation.

[0064] In a further aspect of the invention, a mobile device with a camera is proposed, the mobile device being configured to determine the concentration of at least one analyte in a body fluid by using a test element, the mobile device being configured to carry out the method according to the invention, for example according to any one of the embodiments disclosed above and / or according to any one of the embodiments disclosed in more detail below. Therefore, for possible embodiments or definitions of the mobile device, reference can be made to the description of the method.

[0065] As outlined above, a mobile device may specifically comprise at least one processor. The term "processor" as used herein is a broad term and should be given its ordinary and customary meaning to those skilled in the art and should not be limited to a special or customized meaning. The term may specifically refer to, but is not limited to, a data processing device or combination of data processing devices capable of executing a program or sequence of instructions. By way of example, a processor may comprise a single integrated processor circuit, such as a single processor chip. Additionally or alternatively, a processor may comprise a network of processor chips. A processor may further, additionally or alternatively comprise at least one application specific integrated circuit and / or at least one field programmable gate array. Additionally or alternatively, a processor may further, additionally or alternatively be fully or partially integrated with other hardware components, such as by using a virtual machine running on a larger processor or computing device.

[0066] With reference to the method steps of the methods described herein, all of these method steps can be fully or partially supported by software executed by at least one processor of the mobile device. Thus, sensor data of at least one sensor device may be provided to the processor to fully or partially execute step a). Furthermore, the validity test of step b) may be fully or partially software implemented, executed by the processor. Furthermore, the capture of at least one image in step c) by using a camera may be one or more of initiated, controlled, or triggered by the software executed by the processor. Furthermore, the determination of the concentration of an analyte in the body fluid from the at least one image in step d) may be fully or partially executed by the software executed by the processor.

[0067] The mobile device may further be configured to prompt the user to apply a sample of bodily fluid to the test element. This prompting may, for example, be performed at least once before performing step c). However, as outlined above, step c) may be performed repeatedly, for example step c) may be performed at least once before applying the sample of bodily fluid to the test element and at least once after applying the sample of bodily fluid to the test element. Thus, for example, the mobile device may be further configured to prompt the user to perform step c) at least once without applying a sample to the test element and may be configured to prompt the user to apply a sample to the test element thereafter. The prompting may be performed in various ways commonly known to those skilled in the art, such as by displaying a corresponding message or instruction on the display of the mobile device and / or by providing an audible instruction.

[0068] The mobile device, as generally described above, may specifically comprise at least one mobile electronic device, more specifically a mobile communications device, more specifically one or more of a mobile telephone, a smart phone, and a portable computer.

[0069] In a further aspect of the present invention, a kit is proposed comprising at least one mobile device according to the present invention, such as according to any one of the embodiments disclosed above and / or according to any one of the embodiments disclosed in more detail below, and further comprising at least one test element having at least one test field. The term "kit" as used herein is a broad term and should be given its ordinary and customary meaning to those skilled in the art and should not be limited to a special or customized meaning. The term can specifically refer, by way of example and not limitation, to a combination of at least two items that can be jointly supplied in a package that can interact to fulfill at least one common purpose. The kit can further comprise at least one reference card, the reference card having at least one reference color field.

[0070] In a further aspect of the invention, a computer program is proposed comprising instructions which, when executed by a mobile device having a camera and optionally at least one processor, cause the mobile device to carry out the steps of the method according to the invention, such as according to any one of the embodiments disclosed above and / or according to any one of the embodiments disclosed in more detail below.

[0071] In a still further aspect of the present invention, a computer program product is proposed comprising instructions, when said program is executed by a mobile device having a camera and further optionally at least one processor, causing the mobile device to perform the steps of the method according to the present invention, such as according to any one of the embodiments disclosed above and / or according to any one of the embodiments disclosed in more detail below.

[0072] As used herein, the term "computer program product" may specifically refer to a program as a tradeable product. The product is generally present in any format, such as a paper format or on a computer-readable data carrier. In particular, the computer program product may be distributed over a data network.

[0073] In yet a further aspect of the present invention, a computer-readable storage medium is proposed comprising instructions which, when executed by a mobile device having a camera and further optionally at least one processor, cause the mobile device to perform the steps of the method according to the present invention, such as according to any one of the embodiments disclosed above and / or according to any one of the embodiments disclosed in more detail below.

[0074] In particular, the computer program can be stored in a computer-readable data carrier and / or a computer-readable storage medium. As used herein, the terms "computer-readable data carrier" and "computer-readable storage medium" can specifically refer to a non-transitory data storage means such as a hardware storage medium on which computer-executable instructions are stored. The computer-readable data carrier or storage medium can specifically be or include a storage medium such as a random access memory (RAM) and / or a read-only memory (ROM).

[0075] Thus, in particular, one, more than one or all of the method steps a) to d) as described above can be performed by using a computer or a computer network, preferably by using a computer program.

[0076] The method and device according to the invention offer a number of advantages over known methods and devices of a similar type. Thus, firstly, the invention can take into account in particular the fact that when using a camera-based evaluation of optical test strips, both the illumination angle, i.e. the angle between the axis perpendicular to the test strip and the illumination direction, and the observation angle, i.e. the angle between the axis perpendicular to the test strip and the observation direction of the test field, can have a significant influence on the measurement result, in particular on the determined analyte concentration. In particular, the physical effects of the material of the test strip, the test field or the reference color field, as well as the scattering of light, which can be strongly dependent on the angle of incidence, can be taken into account for the measurement. By taking into account the angular orientation, these physical effects of uncertainty can be eliminated or at least reduced.

[0077] Thus, by applying the present invention, significant measurement uncertainties that can add up to more than 100% deviation due to angular uncertainty and light scattering uncertainty can be eliminated or at least reduced. Thus, in general, measurement errors due to different angular orientations of a mobile device, such as a smartphone, relative to the test element can be eliminated or at least reduced.

[0078] Now, several measurement configurations and methods for determining analyte concentrations can be used that implement the idea of ​​the invention. Firstly, as outlined above, a relative value of at least one color information item of the test field compared to at least one color information item of at least one reference field can be derived from at least one image. By way of example, a quotient of at least one color information item of the at least one test field and at least one color information item of the at least one reference field can be determined. The relative value can be determined for both dry and wet conditions, as outlined above. The latter can generally be referred to as a double relative measurement. This double relative measurement generally provides accurate measurement results, since the color variations of the manufacture of the test elements can be at least partially eliminated. However, when using mobile devices for the measurements, these double relative measurements are particularly prone to angular deviations, since the measurements are generally performed in both dry and wet conditions, which includes a double risk of changes in the angular orientation. Using the present invention, for example by taking into account the angular orientation for both dry and wet measurements, angular deviations can be taken into account, thereby significantly increasing measurement accuracy.

[0079] Additionally or alternatively, a simple relative measurement may be performed. Here too, the relative value of at least one color information item of the test field compared to at least one color information item of the at least one reference field can be derived from at least one image for the wet state without performing a relative measurement in the dry state. Here too, by way of example, a quotient of at least one color information item of the at least one test field and at least one color information item of the at least one reference field can be determined and used to determine the analyte concentration. Here too, by using the present invention, the influence of an angular misalignment between the mobile device and the at least one test element on the measurement result, in particular on the concentration of an analyte in a body fluid, can be eliminated or at least reduced.

[0080] The method according to the invention can in particular make use of at least one sensor device that is typically implemented in standardized mobile devices such as smartphones, tablet computers, etc. By way of example, many mobile devices such as smartphones or tablet computers are equipped with at least one of an angle sensor, an orientation sensor, a magnetic field sensor, an acceleration sensor, or a gyro sensor. Sensor data from one or more of these sensor devices can be used to determine the angular orientation. According to the invention, by way of example, information regarding the angular orientation can be used for one or more of the following: - capturing and evaluating at least one image only if the validity test determines the angular orientation to be valid; - when recording the image stream, selecting from the image stream images captured under angular conditions for which a validity test determines the angular orientation to be valid; - recording an image stream, where images for which a validity test determines the angular orientation to be valid are marked, i.e. "flagged," in a particular manner, and only one or more of these marked images are used to determine the concentration of an analyte in a bodily fluid.

[0081] Other possibilities for utilizing the information regarding the angular orientation may be provided. Furthermore, combinations of the specified options are also possible depending on the particular application.

[0082] The target direction may be a direction in which the mobile device is parallel to the test strip and / or the test elements, such as the reference color field or the reference color card. Here, a parallel direction may generally refer to the case where an axis perpendicular to the test strip, such as the test field, and / or an axis perpendicular to the reference color field, such as the reference color card, is parallel to the optical axis of the camera. Alternatively, however, the target direction may also deviate from a parallel direction. Thus, as an example, a target direction with an inclination angle, such as 5° or 10°, may be given as predetermined. Furthermore, for acquiring an image of the at least one reference color field, the target direction may be different from the target direction for acquiring an image of the at least one test field. Furthermore, the predetermined angle tolerance for the permissible deviation from the target direction may be, as an example, within the range of + / -20°, + / -10°, + / -5° or + / -2°. Other tolerance ranges may be given. Thus, in general, the method may be adapted, for example, to the lighting conditions, the measurement conditions, or the material used for the measurement.

[0083] The target direction, such as the angle θ between the optical axis of the mobile device and an axis perpendicular to the test strip and / or the reference color field and / or the reference color card, may be θ≠0°. In particular, the target direction, such as the angle θ between the optical axis of the mobile device and an axis perpendicular to the reference color card or the reference color field, may be, for example, 0°<θ≦50°, in particular 1°≦θ≦45°, more in particular 5°≦θ≦40°. In particular, as an example, the target direction between the mobile device and the reference color card, in particular between the mobile device and the reference color field, may be θ=40°.

[0084] In particular, the target direction, e.g., the angle θ, may be the same for the test strip and the reference color field and / or the reference color card. However, alternatively, the target direction, i.e., the angle θ, may be different for the reference color field and / or the reference color card and for the test strip. In particular, the target direction of the test strip, e.g., the angle θ between the optical axis of the mobile device and an axis perpendicular to the test strip, may be different from the target direction of the reference color field and / or the reference color card, i.e., the angle θ between the optical axis of the mobile device and an axis perpendicular to the reference color field and / or the reference color card. As an example, the target orientation of the test strip, specifically the angle θ between the optical axis of the mobile device and the test strip, may be θ=1° or θ=2° with a respective allowable deviation of + / -20°, + / -10°, + / -5° or + / -2°, and the target orientation of the reference color field and / or reference color card, specifically the angle θ between the optical axis of the mobile device and the reference color field and / or card, may be θ=40°, θ=50° or θ=60° with a respective allowable deviation of + / -20°, + / -10°, + / -5° or + / -2°.

[0085] The invention can be applied in different ways and adapted to the measurement situation: In particular, to determine the angular orientation of the mobile device relative to the test element, the following options, among others, can be used:

[0086] The angular orientation of the mobile device relative to the test element can be determined by assuming a particular orientation of the test element, such as a test strip. By way of example, it is generally reasonable to assume that the test element is oriented horizontally when placed on a table, i.e., the axis perpendicular to the test element or test field is oriented vertically. To verify this assumption, the method can further include providing user guidance, for example by visual and / or audible instructions, to have the user play the test element on the horizontal support.

[0087] Additionally or alternatively, the angular orientation or change in angular orientation may be determined for one or more of dry or wet conditions.

[0088] Additionally or alternatively, as outlined above, the angular orientation of the support surface may be determined, for example, before or after capturing an image of the test field. Also as outlined above, this process may also be performed automatically, for example, by assuming that the mobile device is placed and rested on the support surface at least once during the entire procedure of determining the concentration of the analyte. By way of example, the mobile device is typically placed on the support surface during, for example, preparation of the test element, preparation of the tracking device, etc. Thus, by way of example, to determine whether the mobile device is resting on the support surface, sensor data of at least one sensor of the mobile device may be monitored, and when a measurement is made, for example, within a predefined time frame before or after this resting, the orientation of the mobile device in a stationary state is assumed to correspond to the orientation of the support surface.

[0089] Additionally or alternatively, the angular orientation of the mobile device relative to a reference card having at least one reference color field may be determined in order to capture at least one image of the at least one reference color field. Again, one or more of the above-mentioned options may be applied. Specifically, by way of example, at least one marker on the reference card may be used to determine the angular orientation. By way of example, at least one ArUco marker on the reference card may be used.

[0090] By using the sensor data and / or the information about the angular orientation, user guidance can be provided. Thus, by way of example, a user can be guided in an efficient manner to establish a desired angular orientation of the mobile device relative to the test element. By way of example, visual guidance markers, such as those typically used for leveling, can also be applied for user guidance.

[0091] The method according to the invention can in particular be carried out without correcting the at least one image captured in step c) for angular misalignment. Therefore, no algorithms for angular correction of the images need to be applied, such as the correction used to determine the angular misalignment using known information on the dimensions of the test field and / or other characteristic features of the test element. The angular orientation of the mobile device relative to the test element can be taken into account only by using the sensor data of at least one sensor device integrated in the mobile device, without additional mathematical angular correction. This sensor-based procedure, in contrast to algorithmic angular correction, can significantly reduce the use of resources of the mobile device. Thus, in comparison with algorithm-based image correction methods, the invention can provide a fast and efficient method for determining the concentration of an analyte, which is particularly suitable for mobile devices with limited hardware resources.

[0092] In summary, without excluding further possible embodiments, the following embodiments can be envisaged:

[0093] Embodiment 1: A method for determining the concentration of at least one analyte in a body fluid by using a mobile device and a test element, wherein the mobile device has a camera and the test element has at least one test field, comprising: a) determining an angular orientation of the mobile device relative to a test element by using sensor data of at least one sensor device integrated in the mobile device; b) subjecting the angular orientation of the mobile device relative to the test element to at least one validity test; c) capturing at least one image of at least a portion of the test element by using a camera, the at least one image comprising at least a portion of the test field; d) determining a concentration of an analyte in the bodily fluid from the image; A method, wherein at least one of steps c) and d) is carried out by taking into account the results of the efficacy test of step b).

[0094] Embodiment 2: The method according to the preceding embodiment, wherein the validity test in step b) comprises comparing an angular orientation of the mobile device relative to the test element with at least one target orientation.

[0095] Embodiment 3: A method as described in the preceding embodiment, wherein the validity test determines that the angular orientation of the mobile device relative to the test element is valid if the angular orientation deviates from the target orientation by no more than at least one predetermined angular tolerance, or determines that the angular orientation of the mobile device relative to the test element is invalid if the angular orientation deviates from the target orientation by more than at least one predetermined angular tolerance.

[0096] Embodiment 4: A method as described in any one of the preceding embodiments, comprising monitoring an angular orientation of the mobile device relative to the test element, and blocking capture of at least one image if a validity test determines that the angular orientation of the mobile device relative to the test element is invalid.

[0097] Embodiment 5: The method of the preceding embodiment, further comprising unblocking capture of at least one image if the validity test determines the angular orientation of the mobile device relative to the test element to be valid.

[0098] Embodiment 6: A method as described in any one of the two preceding embodiments, further comprising automatically initiating capture of at least one image if the validity test determines that the angular orientation of the mobile device relative to the test element is valid.

[0099] Embodiment 7: A method as described in any one of the preceding embodiments, comprising acquiring an image stream by using a camera, and wherein the capturing in step c) comprises selecting at least one image from the image stream.

[0100] Embodiment 8: The method of the preceding embodiment, wherein the capturing in step c) further comprises storing the selected images in at least one data storage device.

[0101] Embodiment 9: A method according to any one of the two preceding embodiments, wherein at least one image is selected from the image stream if the image was acquired at a time when the validity test determines that the angular orientation of the mobile device relative to the test element is valid.

[0102] Embodiment 10: A method according to any one of the three preceding embodiments, wherein at least a portion of the images of the image stream are flagged with at least one item of information regarding whether the image was acquired at a time when a validity test determines that the angular orientation of the mobile device relative to the test element is valid.

[0103] Embodiment 11: A method as described in the preceding embodiment, wherein step d) is performed at least in part based on at least one image flagged with an item of information indicating that the image was acquired at a time when the validity test determined the angular orientation of the mobile device relative to the test element to be valid.

[0104] Embodiment 12: The method of any one of the preceding embodiments, wherein step a) is performed at least in part under the assumption that the test elements are oriented in a predetermined direction.

[0105] Embodiment 13: The method according to the preceding embodiment, wherein the predetermined direction is a horizontal direction.

[0106] Embodiment 14: A method according to any one of the preceding embodiments, further comprising determining the angular orientation of the test element by placing the mobile device on a support surface and determining the angular orientation of the support surface, wherein in step a), the test element is placed on the support surface.

[0107] Embodiment 15: The method of any one of the preceding embodiments, further comprising applying at least one sample of a bodily fluid to a test element.

[0108] Embodiment 16: A method according to any one of the preceding embodiments, wherein step c) further comprises capturing at least one dry reference image of at least a portion of the test element before applying the bodily fluid to the test element, and capturing at least one measurement image of at least a portion of the test element after applying the bodily fluid to the test element, and wherein in step d) both the dry reference image and the measurement image are taken into account to determine the concentration of the analyte in the bodily fluid.

[0109] Embodiment 17: The method according to the preceding embodiment, wherein steps a), b), and c) are performed at least once to capture a dry image and at least once to capture a measurement image.

[0110] Embodiment 18: The method of any one of the two preceding embodiments, wherein step c) further comprises capturing at least one color reference image of the at least one color reference, and in step d), the color reference image is taken into account to determine the concentration of the analyte in the body fluid.

[0111] Embodiment 19: The method of any one of the preceding embodiments, comprising providing user guidance to guide the user towards a target orientation of the mobile device relative to the test element.

[0112] Embodiment 20: The method of any preceding embodiment, wherein the user guidance includes visual guidance on a display of the mobile device.

[0113] Embodiment 21: The method according to any one of the preceding embodiments, which does not imply mathematical correction of at least one image for angular misalignment.

[0114] Embodiment 22: A mobile device having a camera, configured to determine the concentration of at least one analyte in a body fluid by using a test element, and configured to perform the method according to any one of the preceding embodiments.

[0115] Embodiment 23: A mobile device as described in the preceding embodiment, wherein the mobile device comprises at least one processor.

[0116] Embodiment 24: A mobile device according to any one of the preceding embodiments referring to a mobile device, wherein the mobile device is further configured to prompt a user to apply a sample of the bodily fluid to the test element.

[0117] Embodiment 25: A mobile device as described in any one of the preceding embodiments referring to a mobile device, wherein the mobile device comprises one or more of a mobile electronic device, more specifically a mobile communication device, more specifically a mobile phone, a smartphone, and a portable computer.

[0118] Embodiment 26: A kit comprising at least one mobile device according to any one of the preceding embodiments referring to a mobile device, further comprising at least one test element having at least one test field.

[0119] Embodiment 27: The kit of the preceding embodiment, further comprising at least one reference card having at least one reference color field.

[0120] Embodiment 28: A computer program comprising instructions which, when executed by a mobile device having a camera, cause the mobile device to perform the steps of the method according to any one of the preceding embodiments referring to the method.

[0121] Embodiment 29: A computer program product comprising instructions which, when executed by a mobile device having a camera, cause the mobile device to perform the steps of the method according to any one of the preceding embodiments referring to the method.

[0122] Embodiment 30: A computer-readable storage medium comprising instructions that, when executed by a mobile device having a camera, cause the mobile device to perform the steps of the method according to any one of the preceding embodiments referring to the method.

[0123] Further optional features and embodiments are disclosed in more detail in the following description of the embodiments, preferably in conjunction with the dependent claims. Here, each optional feature can be realized in an independent manner as well as in any possible combination, as understood by a person skilled in the art. The scope of the present invention is not limited by the preferred embodiments. The embodiments are illustrated diagrammatically in the figures, where the same reference symbols in these figures refer to the same or functionally comparable elements. The diagram is as follows: [Brief description of the drawings]

[0124] [Figure 1] 1 shows a perspective view of an embodiment of a kit and a mobile device. [Diagram 2] 1 illustrates an embodiment of an image of a portion of a test element captured by a camera on a mobile device. [Diagram 3] 1 shows a flow chart of a method for determining the concentration of at least one analyte in a body fluid by using a mobile device and a test element. [Figure 4] 1 shows a top view of an embodiment of a mobile device. [Diagram 5] 1 illustrates an embodiment of a graph of backscatter intensity over polar angle. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0125] In Fig. 1, a perspective view of an embodiment of a kit 110 and a mobile device 112 is shown. The kit 110 comprises a mobile device 112 and at least one test element 114 having at least one test field 116. The mobile device 112 comprises a camera 118 and is configured to determine the concentration of at least one analyte in a body fluid by using the test element 114. In particular, the mobile device 112 is configured to execute a method for determining the concentration of at least one analyte in a body fluid. In particular, at least one sensor device 120 can be integrated into the mobile device 112. Sensor data of at least the sensor device 120 can be used to determine an angular orientation of the mobile device 112 with respect to the test element 114. As an example, an angle θ between a normal direction 122 of the test element 114 and an image capture direction 124 of a camera of the mobile device 112 can be determined. The mobile device 112 further comprises at least one processor 126. The processor 126 can be configured to process at least one image 128 of at least a portion of the test element 114 captured, for example, by using the camera 118 of the mobile device 112 .

[0126] 2 illustrates an embodiment of an image 128 of a portion of a test element 114 captured using the camera 118 of the mobile device 112. The portion of the test element 114 illustrated in the image 128 includes at least a portion of the test field 116 of the test element 114.

[0127] 1, the test element 114 can be positioned on a support surface 130. In particular, an angular orientation 132 of the support surface can be determined, for example, by placing the mobile device 112 on the support surface 130. By way of example, the angular orientation 132 of the support surface can be used in addition to or instead of the normal orientation 122 of the test element 114 to determine the angle θ.

[0128] FIG. 3 shows a flow chart of a method for determining the concentration of at least one analyte in a body fluid by using a mobile device 112 and a test element 114. The method specifically includes the following steps, which can be performed in a given order. Moreover, different orders can be possible. Two or more method steps may be performed fully or partially simultaneously. Moreover, one, more than one or all method steps may be performed once or repeatedly. The method may include additional method steps not described herein. The method steps of the method for determining the concentration of at least one analyte in a body fluid are as follows: Step a) determining an angular orientation of the mobile device 112 relative to the test element 114 by using sensor data of at least one sensor device 120 integrated in the mobile device 112 (indicated by reference numeral 134); Step b) subjecting the angular orientation of the mobile device 112 relative to the test element 114 (indicated by reference numeral 136) to at least one validity test; Step c) capturing at least one image 128 of at least a portion of the test element 114 by using a camera 118 (indicated by reference numeral 138), where the at least one image 128 of the at least a portion of the test element 114 includes at least a portion of the field 116; and Step d) determining the concentration of the analyte in the body fluid from the image 128 (indicated by reference numeral 140).

[0129] At least one of steps c) and d) is performed by taking into account the result of the validity test of step b). In particular, the validity test in step b) may include comparing the angular orientation of the mobile device 112 with respect to the test element 114 with at least one target orientation. Thus, for example as shown in FIG. 1, the angular orientation of the mobile device 112 with respect to the test element 114 may be subjected to at least one validity test. In particular, the validity test may determine whether the angular orientation of the mobile device 112 with respect to the test element 114 is valid or invalid. In particular, in the validity test, the angular orientation of the mobile device 112 with respect to the test element 114 may be compared with a target orientation. In particular, the angular orientation of the mobile device 112 with respect to the test element 114 may be valid if the angular orientation deviates from the target orientation by at least one predetermined angular tolerance or less. Alternatively, the angular orientation of the mobile device 112 with respect to the test element 114 may be invalid if the angular orientation deviates from the target orientation by more than at least one predetermined angular tolerance. By way of example, in a validity test, the angle θ may be compared with the angle of a target direction with a predefined angular tolerance. By way of example, the target direction may be parallel to the angular orientation of the mobile device 112. Thus, the angle of the target direction may specifically be equal to 0°. For example, the angular orientation of the mobile device 112 may be targeted to be a plane parallel to the angular orientation of the test element 114. Alternatively, the target direction may be selected to be non-parallel to the angular orientation of the mobile device 112. It may be particularly useful for a target direction, for example, equal to 10°. Specifically, the predefined angular tolerance may be + / - 10°. More specifically, the predefined angular tolerance may be + / - 5°. In particular, the predefined angular tolerance may be + / - 2°.

[0130] In Fig. 4, a plan view of an embodiment of a mobile device 112 is shown. The mobile device 112 may specifically be in the process of performing a method for determining a concentration of at least one analyte in a bodily fluid, as shown in Fig. 3. The method may include monitoring an angular orientation of the mobile device 112 relative to the test element 114. Specifically, if the validity test determines the angular orientation of the mobile device 112 relative to the test element 114 to be invalid, the method may further include blocking the capture of at least one image 128. However, if the validity test determines the angular orientation of the mobile device 112 relative to the test element 114 to be valid, the method may include unblocking the capture of at least one image 128. Additionally or alternatively, the method may include automatically initiating the capture of at least one image 128 if the validity test determines the angular orientation of the mobile device 112 relative to the test element 114 to be valid. 。 Additionally or alternatively, the method may include continuously acquiring an image stream by using the camera 118, and the capturing in step c) of the method may include selecting at least one image 128 from the image stream. In particular, an image 128 may be selected from the image stream if the image 128 was acquired at a time when a validity test determines the angular orientation of the mobile device 112 relative to the test element 114 to be valid.

[0131] Further, the method can include providing user guidance to guide the user towards a target orientation of the mobile device 112 relative to the test element 114. Specifically, the user guidance can include visual guidance on the display 142 of the mobile device 112. As shown in FIG. 4, the visual guidance on the display 142 of the mobile device 112 can be, for example, a virtual outline 144 of the test strip 114. Additionally or alternatively, the visual guidance on the display 142 of the mobile device 112 can guide the user towards a target orientation of the mobile device 112 relative to the test element 114, for example, by visually indicating a direction to move or tilt the mobile device 112. In particular, the user guidance can utilize a spirit level function sensor. As an example, the visual guidance can include a ball 146 visually shown within a circle 148 shown on the display 142, and the user can be requested to guide the ball 146 towards the center of the circle 148. Specifically, the user can be requested to guide the ball 146 towards the center of the circle 148 by moving and / or tilting the mobile device 112.

[0132] 5 shows an embodiment of a graph of backscattering intensity over polar angle. The x-axis 150 shows polar angle, specifically angle θ, and the y-axis 152 shows backscattering intensity I. In the graph, the dashed line shows Lambertian reflectance 154, such as the reflectance of a surface that follows Lambert's law, where the intensity observed from an ideal diffusely reflecting surface is directly proportional to the cosine of the angle θ between the direction of the incident light and the surface normal. In particular, when exhibiting Lambertian reflectance 154, a surface can have the same radiance when viewed from any angle θ. Thus, for example, a surface can have the same brightness or luminance at θ=20° and θ=−20°. In particular, the test field 116 of the test element 114 can exhibit, for example, Lambertian reflectance 154.

[0133] Further, in the graph, a solid line shows the measured reflectance 156, specifically the measured reflectance of, for example, the test element 114, such as the reflectance of the surface of the test element 114 excluding the test field 116. As shown, the measured reflectance 156 shows a peak reflectance at -20°. In particular, the peak reflectance at -20° could be of unusually high width. A similar peak can be observed in the measured reflectance 156 at +20°, although without the excessively large width. As an example, the measured reflectance peak may prevent the determination of analytes in bodily fluids from images acquired at -20° or +20°. Therefore, it may be beneficial to avoid using such images to determine analytes in bodily fluids. [Explanation of symbols]

[0134] 110 Kit 112 Mobile Devices 114 Test Elements 116 Test Field 118 Camera 120 Sensor device 122 Normal direction of test element 124 Image capture direction 126 processors 128 images 130 Support surface 132 Angular orientation of support surface 134 Step a) 136 Step b) 138 Step c) 140 Step d) 142 Display 144 Test Strip Contour 146 Ball 148 yen 150 x axis 152 y-axis 154 Lambertian reflectance 156 Measured reflectance

Claims

1. 1. A method for determining a concentration of at least one analyte in a body fluid by using a mobile device (112) and a test element (114), the mobile device (112) having a camera (118) and the test element (114) having at least one test field (116), comprising: a) determining an angular orientation of the mobile device (112) relative to the test element (114) by using sensor data of at least one sensor device (120) integrated in the mobile device (112); b) subjecting the angular orientation of the mobile device (112) relative to the test element (114) to at least one validity test; c) capturing at least one image (128) of at least a portion of the test element (114) by using the camera (118), the at least a portion of the test element (114) including at least a portion of the test field (116); d) determining the concentration of the analyte in the bodily fluid from the image (128); 2. A method, wherein at least one of steps c) and d) is performed by taking into account the result of the validity test of step b), the method comprising acquiring an image stream by using the camera, step c) comprising capturing one or more still images separately from the image stream by using a still image mode of the camera of the mobile device, the at least one still image providing an improved spatial resolution and / or higher dynamics compared to images from the image stream, at least some of the images of the image stream are flagged with at least one item of information regarding whether said image had been acquired at a time when the validity test determined the angular orientation of the mobile device relative to the test element to be valid, and capture of the still images is automatically started if the image of the image stream is flagged with an item of information indicating a valid image at a time when an image of the image stream is flagged as valid, and step d) is at least partially performed for the at least one still image.

2. The validity test in step b) comprises comparing the angular orientation of the mobile device (112) relative to the test element (114) with at least one target orientation, the validity test comprising: determining that the angular orientation of the mobile device (112) relative to the test element (114) is valid if the angular orientation deviates from the target orientation by no more than at least one predetermined angular tolerance; or 2. The method of claim 1, further comprising determining that the angular orientation of the mobile device (112) relative to the test element (114) is invalid if the angular orientation deviates from the target orientation by more than the at least one predetermined angular tolerance.

3. 3. The method of claim 1, wherein the method comprises monitoring the angular orientation of the mobile device (112) relative to the test element (114) and blocking capture of the at least one image (128) if the validity test determines that the angular orientation of the mobile device (112) relative to the test element (114) is invalid, the method further comprises unblocking the capture of the at least one image (128) if the validity test determines that the angular orientation of the mobile device (112) relative to the test element (114) is valid, and the method comprises automatically initiating the capture of the at least one image (128) if the validity test determines that the angular orientation of the mobile device (112) relative to the test element (114) is valid.

4. The method according to any one of claims 1 to 3, wherein step a) is performed at least in part under the assumption that the test element (114) is oriented in a predetermined direction.

5. 5. The method according to claim 1, further comprising: determining the angular orientation of the test element (114) by placing the mobile device (112) on a support surface (130); and determining the angular orientation (132) of the support surface (130), wherein in step a) the test element (114) is placed on the support surface (130).

6. 6. The method of claim 1, further comprising applying at least one sample of the bodily fluid to the test element, step c) further comprising capturing at least one dry reference image of the at least a portion of the test element before applying the bodily fluid to the test element, and capturing at least one measurement image of the at least a portion of the test element after applying the bodily fluid to the test element, and in step d) both the dry reference image and the measurement image are taken into account to determine the concentration of the analyte in the bodily fluid, and optionally steps a), b) and c) are performed at least once to capture the dry reference image and at least once to capture the measurement image.

7. The method of claim 1 , further comprising providing user guidance for guiding a user towards a target orientation of the mobile device relative to the test element.

8. The method according to any one of claims 1 to 7, wherein the method does not imply a mathematical correction of the at least one image (128) for angular misalignment.

9. A mobile device (112) having a camera (118), at least one sensor device (120), and at least one processor (126), the mobile device (112) configured to determine a concentration of at least one analyte in a body fluid by using the test element (114), the mobile device (112) configured to perform the method of any one of claims 1, 2, 3, 5, 7 and 8.

10. A kit (118) comprising at least one mobile device (112) according to claim 9, further comprising at least one test element (114) having at least one test field (116).

11. The kit (110) of claim 10, wherein the kit (110) further comprises at least one reference card having at least one reference color field.

12. 10. A computer readable storage medium comprising instructions that, when executed by the mobile device (112) of claim 9, cause the mobile device (112) to perform the method of any one of claims 1, 2, 3, 5, 7 and 8.

Citation Information

Patent Citations

  • Electronic camera

    JP2001078137A

  • Image generating apparatus and electronic camera

    JP2011049952A

  • Test equipment

    JP2014514547A

  • Test system configuration and test method

    JP2015501929A

  • Management system

    JP2019066426A