A method for determining test outcome results using mobile devices.
The method normalizes mobile device-dependent image data variations in lateral flow immunoassays by integrating camera responses for multiple exposure times into a camera-neutral function, ensuring accurate and reliable test result determination.
Patent Information
- Application Number
- JP2025575003
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Priority Date
- 2023-06-28
- Filing Date
- 2024-06-27
- Publication Date
- 2026-07-13
AI Technical Summary
Existing mobile phone-based lateral flow immunoassays face challenges in providing consistent and accurate test outcome determination due to device-dependent image data variations, leading to unreliable results across different camera-equipped mobile phones.
A method involving a mobile device with a camera that captures image data, identifies a color reference section, registers camera responses for multiple exposure times, and integrates these responses into a camera-neutral function to convert image data, allowing determination of test results independent of the device type, using calibration curves to correlate intensity with sample concentration.
Ensures device-independent test result determination by normalizing image data across different mobile devices, enhancing accuracy and reliability of test outcomes.
Smart Images

Figure 2026523211000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to rapid testing, such as how lateral flow immunoassay tests can be read using a mobile phone application. More specifically, the present invention relates to a computer-implemented method for determining a test result outcome based on image data showing a test configuration using a mobile device, as well as to the test configuration and the mobile device.
Background Art
[0002] In the past few years, there has been an increasing interest in using rapid tests in combination with mobile phone applications for remote monitoring purposes. By having a rapid test, often based on the lateral flow immunoassay principle, and a mobile phone application, patients can perform tests in a reliable manner from their homes, which is convenient and cost-effective. Furthermore, by increasing accessibility, it becomes possible to perform tests more frequently, thereby providing more information about patients and achieving improved treatment. For example, by using this approach, symptoms can be detected at an early stage, which enables treatment to be started at an earlier stage compared to when a patient seeks a doctor's appointment after the symptoms have become apparent.
[0003] As an example, Calpro presents the CalproSmart (trademark) self-test for monitoring patients suffering from chronic inflammatory bowel diseases (IBD) such as ulcerative colitis and Crohn's disease. This test is based on calprotectin, an inflammatory biomarker. Since this biomarker increases 3 to 6 months before clinical symptoms can be detected, this test enables the detection and treatment of IBD at an early stage.
[0004] A mobile phone application may be used to determine the test outcome, i.e., the extent to which a biomarker has increased, and send it to a remote server. A common method for this is to capture image data showing the test section of the test cassette using the mobile phone's camera, process the image data to quantify the degree to which the biomarker has increased, and send the test outcome to a remote server so that the information can be made available for further analysis by healthcare professionals.
[0005] Several techniques are available to determine inspection outcomes based on image data indicating the inspection unit, for example, by using a mobile phone. For example, an inspection frame may be used to ensure that the inspection unit in the inspection cassette can be reliably identified. The inspection frame is provided with a cut-out that has the same contour as the inspection cassette so that the inspection cassette can be placed within the frame. The inspection frame may be provided with reference markings so that the inspection frame can be identified through the captured image data.
[0006] While various mobile applications are available today for interpreting and determining test results outcomes, there is still room for improvement. For example, accuracy needs to be improved. This would allow for a more accurate determination of changes in the laboratory, thereby enabling more reliable conclusions based on test results outcomes.
[0007] A 2018 paper by Saisin et al., "Significant Sensitivity Improvement for Camera-Based Lateral Flow Immunoassay Readers" (Non-Patent Literature 1), discloses a method for distinguishing faint lines from a white background in lateral flow inspection by manually setting the camera exposure time instead of using automatic settings.
[0008] International Publication No. 2023 / 037101 (Patent Document 1) discloses a method for obtaining inspection results from a test specimen, wherein the inspection area of the test specimen undergoes a visually perceptible change after contact with a liquid sample. By processing input data including an image or sequence of images depicting the test specimen, and by comparing a reference area with the inspection area in the image or multiple images of the input data, an estimate of the target characteristics of the liquid sample can be extracted.
[0009] U.S. Patent No. 11,192,100 (Patent Document 2) discloses a system that enables urine testing in a home environment. A urine sample is applied to a test card containing multiple tests, and image data depicting the card is captured using a telephone. An analysis system, including a telephone or cloud, is configured to compensate for variations in lighting conditions and the exposure time of the urine sample. [Prior art documents] [Patent Documents]
[0010] [Patent Document 1] International Publication No. 2023 / 037101 [Patent Document 2] U.S. Publication No. 11,192,100 [Non-patent literature]
[0011] [Non-Patent Document 1] Saisin et al., “Significant Sensitivity Improvement for Camera-Based Lateral Flow Immunoassay Readers,” 2018 [Overview of the project] [Problems that the invention aims to solve]
[0012] The object of the present invention is to overcome at least partially one or more of the limitations of the prior art identified above. In particular, the object is to provide a method for determining less device-dependent test outcome. Today, many mobile phones are built to provide image data that users find appealing, but they are not necessarily built to provide image data that consistently and accurately reflects changes. For example, changes in the luminosity of a test line in a test unit can result in different image data output by different camera-equipped mobile phones. Since changes in the test line correspond to an increase in biomarkers, using different types of mobile phones to determine test outcome may therefore result in different outcomes being provided, which negatively impacts reliability. [Means for solving the problem]
[0013] According to a first aspect, a computer implementation method is provided for determining an examination outcome by using a mobile device equipped with a camera configured to capture image data representing the examination configuration. Acquiring image data using a mobile device, Identifying the color reference section CRS in image data showing the inspection configuration, wherein the CRS is colored with at least one reference color. Camera response functions specific to mobile device types related to mobile devices, multiple different camera For each exposure time, To register a camera response for at least one reference color, wherein the camera response corresponds to a photon flux. multiple different camera Regarding exposure time, the camera response is integrated into the camera response function. The decision will be made by, This involves acquiring a set of inspection image data representing the inspection unit of the inspection configuration, wherein the inspection unit is colored differently for different inspection outcome results. By using the camera response function, the examination image data set is converted to a camera-neutral examination image data set, Based on the camera-neutral inspection image data set, the inspection unit determines the intensity of the inspection object, such as an inspection line or inspection dot. The determination of the test result outcome is made by fitting the intensity to a calibration curve, and the determination is made so that the test result outcome corresponds to the concentration of the sample held in the laboratory. It may include.
[0014] Different exposure times should be understood herein as different camera exposure times. In other words, different time slots that allow photons to pass through and travel onto the camera's image sensor.
[0015] The advantage of using this method is that the inspection result outcome determination is not affected, or at least less affected, by the type of mobile device being used.
[0016] Furthermore, by utilizing that the number of photons collected over the exposure time in the camera corresponds to the photon flux related to a specific color × exposure time, and by using a reference color with a specific photon flux in the inspection configuration and that the exposure time can be controlled in an accurate manner, a gamma fit can be formed in a reliable manner.
[0017] The inspection configuration may include an inspection cassette disposed within the inspection frame, the CRS is provided on the inspection frame, and the inspection unit is provided on the inspection cassette.
[0018] By disposing the CRS on the inspection frame, one or more reference colors are provided on a portion that can be reused several times. Thereby, the CRS can be created with high precision and still provide cost efficiency.
[0019] The inspection configuration may be provided with at least one two-dimensional code, such as an Aruco code, to facilitate the spatial alignment of the camera of the mobile device with respect to the inspection configuration.
[0020] Having a two-dimensional code allows existing software modules to be used to identify such codes. The part that identifies those codes is for determining how they are spatially aligned, which in this context can be used to provide information about how the inspection configuration is positioned relative to the mobile device, which is relevant to assessing color changes in the inspection unit. In other words, instead of using only the identification code or other information provided by the two-dimensional code, which is what is usually done, the spatial alignment information, which is determined to make it possible to determine the identification code, is used herein to receive information about the positioning of the inspection configuration relative to the mobile device.
[0021] At least one reference color can have both a light and a dark color, and the camera response for the light color is greater than the camera response for the dark color. In other words, the light color is associated with a larger photon flux than the photon flux associated with the dark color.
[0022] This method may further include activating a flash on the camera to reduce lighting variations before the step of identifying the CRS.
[0023] CRS may be matte to reduce the effect of reflection.
[0024] This method may further include detecting camera movement by using an accelerometer provided in the mobile device prior to the step of identifying the CRS, and proceeding to identify the CRS if the movement falls below a threshold.
[0025] Acquiring image data, identifying CRS, determining the camera response function, and capturing at least one set of inspection image data can be performed within a time span of less than one second, so as to reduce the impact of changes in lighting conditions.
[0026] The 2According to this embodiment, a mobile device comprising a processor device, memory, and a camera, wherein the processor device is Acquiring image data using a camera, Identifying the color reference section CRS in image data showing the inspection configuration, wherein the CRS can be colored with at least one reference color. Camera response functions specific to mobile device types related to mobile devices, multiple different camera For each exposure time, To register a camera response for at least one reference color, wherein the camera response corresponds to a photon flux. Integrating camera responses for multiple different exposure times into a camera response function and The decision will be made by, This involves acquiring a set of inspection image data representing the inspection unit of the inspection configuration, wherein the inspection unit is colored differently for different inspection outcome results. By using the camera response function, the examination image data set is converted to a camera-neutral examination image data set, Based on the camera-neutral inspection image data set, the inspection unit determines the intensity of the inspection object, such as an inspection line or inspection dot. The determination of the test result outcome is made by fitting the intensity to a calibration curve, and the determination is made so that the test result outcome corresponds to the concentration of the sample held in the laboratory. A mobile device is provided that can be built to do this.
[0027] The 1 The same features and advantages presented above apply to this embodiment as well.
[0028] A system for determining examination results and outcomes by analyzing image data representing the examination configuration, wherein the system comprises a server and a mobile device equipped with a camera, and this system is Acquiring image data using a camera, Identifying a color reference section (CRS) in image data showing the inspection configuration, wherein the CRS is colored with at least one reference color. Camera response functions specific to mobile device types related to mobile devices, For each of several different exposure times, To register a camera response for at least one reference color, wherein the camera response corresponds to a photon flux. Integrating camera responses for multiple different exposure times into a camera response function and The decision will be made by, This involves acquiring a set of inspection image data representing the inspection unit of the inspection configuration, wherein the inspection unit is colored differently for different inspection outcome results. By using the camera response function, the examination image data set is converted to a camera-neutral examination image data set, Based on the camera-neutral inspection image data set, the inspection unit determines the intensity of the inspection object, such as an inspection line or inspection dot. The determination of the test result outcome is made by fitting the intensity to a calibration curve, and the determination is made so that the test result outcome corresponds to the concentration of the sample held in the laboratory. A system built to do that.
[0029] The 1 prong is the 2 The same features and advantages presented above apply to this embodiment as well.
[0030] Further objects, features, embodiments, and advantages of the present invention will become apparent from the following embodiments for carrying out the invention and from the drawings.
[0031] Next, embodiments of the present invention will be described as practical examples with reference to the attached schematic diagrams. [Brief explanation of the drawing]
[0032] [Figure 1] This diagram generally shows a mobile device positioned above an inspection configuration comprising an inspection cassette and an inspection frame. [Figure 2] This figure shows the camera response as a function of actual color for multiple different devices. [Figure 3] This figure shows the camera response function generated by performing gamma fitting on several data points acquired at different exposure times. [Figure 4] This figure shows data points related to dark and light colors for different exposure times. [Figure 5] This figure shows the camera response function formed by combining the data points shown in Figure 4 with photon fluxes related to two different colors. [Figure 6] This flowchart illustrates one example of how mobile devices can be used to determine test outcome results in a test configuration. [Figure 7] This diagram shows three modules that further explain how mobile devices can be used to determine test outcome results. [Figure 8] This flowchart illustrates a method for determining test outcome by using a mobile device equipped with a camera configured to capture image data showing the test configuration. [Modes for carrying out the invention]
[0033] Figure 1 shows, as an example, a test configuration 106 comprising a mobile device 100 equipped with a camera 102 and a flash 104, and a test frame 108 and a test cassette 110 placed within the test frame 108 during use. The mobile device 100 may be a mobile phone, but it may also be a tablet or any other device that can be used by the user to capture image data showing the test configuration 106 and to process this image data so that test outcome results can be determined. The test configuration 106 may be a so-called lateral flow test, sometimes called a lateral flow immunochromatographic assay or rapid test. The test configuration 106 may be used to detect various diseases or health conditions. As an example, the test cassette 110 may use the biomarker calprotectin to detect inflammatory conditions.
[0034] As shown, the examination frame 108 may be provided with a notch for holding the examination cassette 110. By using this principle, the examination frame 108 may be reused for several examination cassettes, and its frame may be linked to the patient and / or a batch of examination cassettes. However, the examination cassette 110 may be a disposable device. In addition to having some parts of the examination configuration 106 that can be reused and other parts that can be made for single use, the examination frame 108 may be equipped with a first two-dimensional code 112a and a second two-dimensional code 112b, such as an ArUco code. These codes may be used to identify the examination frame 108, but may also be used to provide a spatial reference point. After those codes are identified in the image data captured by the camera 102, the position of the mobile device 100, which the camera 102 forms part of, may be spatially aligned with the examination frame 108. Although not shown, the mobile device 100 may be provided with a display and a user interface. The user interface may be configured to guide the user to position the inspection configuration 106 so that it is within the field of view of the camera 102. For example, the user interface may provide boxes through which first and second two-dimensional codes are intended to be placed, so that the user can adjust the position of the mobile device relative to the inspection configuration.
[0035] In addition to the first 2D code 112a and the second 2D code 112b, the inspection frame 108 is a color standard Part C R S1 14 may also be provided. As its name suggests, (CRS) 114 may be colored with a specific reference color, and these colors may be used as a reference to ensure that the color intensity of the test cassette 110 is interpreted device-agnostically, as will be further explained below with reference to Figures 2 to 8.
[0036] CRS114 can be located at a certain distance and / or a plurality of specific distances from the first two-dimensional code 112a and / or the second two-dimensional code 112b. By linking the location of CRS114 to one or more locations of the first two-dimensional code 112a and / or the second two-dimensional code 112b, CRS114 can be more reliably identified in image data once one or more locations of the first two-dimensional code 112a and / or the second two-dimensional code 112b are identified.
[0037] In the example shown in Figure 1, CRS114 comprises two different colors, a dark color 116 and a light color 118. While it is shown that two different colors are used in CRS114, it is possible to have only one color, or three or more colors.
[0038] In the test cassette 110, a sample section 120, sometimes called a sample pad, may be provided for receiving the sample fluid. Once the sample fluid is received by the sample section 120, it is transferred to the test section 122, where the outcome of the test may be presented in the form of a test object 124, such as a test line or a test dot. Although not shown, a so-called conjugate section may be provided between the sample section 120 and the test section 122. In the conjugate section, the sample fluid may be brought into contact with reagents and biomarkers so that a reaction occurs that can be reflected in the test object 124 and / or control object 126. The test object 124 serves to reflect the presence of a particular substance in the sample fluid, for example, so that an indication of health status can be reflected, and the control object 126 serves to reflect that the sample fluid has been properly transferred from the sample section 120 to the test section 122. As shown, the test object 124 and the control object 126 may be lines, but they may also have other geometric shapes, such as dots.
[0039] The inspection cassette 110 may also be provided with a two-dimensional code, referred to herein as the cassette two-dimensional code 128, for identification purposes. By having two-dimensional codes on both the inspection cassette 110 and the inspection frame 108, the two-dimensional codes can also function as spatial reference positions, so that the relative positions between the two can be precisely determined. Furthermore, an advantage of having two-dimensional codes on both the inspection cassette 110 and the inspection frame 108 is that they can be identified, and once identified, information related to them can be retrieved, for example, via a remote server. For example, if a color change related to an inspection object 124 changes from one batch to another in the inspection cassette 110, this can be compensated if the inspection cassette is identifiable. Similarly, by having an inspection frame 108 provided with one or more two-dimensional codes or other similar identification marks, it is possible to retrieve data related to previously performed inspection sessions. The advantage of this is that if the current examination session deviates from the previous examination session, for example, if CRS114 produces significantly different color information in the image data captured by the camera compared to the previous examination session, this can be shown to the user via the mobile device 100. For example, the user may be asked to confirm that they are using a new device to determine the examination results.
[0040] Figure 2 shows the camera response for several different mobile devices. As shown, the camera response for different colors is nonlinear and also differs for different devices. In other words, as an example, the color of the inspection object 124 is not directly proportional to the output voltage from the image sensor. One reason for this is the dark offset. In addition to this, the gamma value may differ for different mobile devices 100, i.e., they may be set to reflect color intensity in different ways. Due to the differences that can occur between different devices, as shown in Figure 2, the color change cannot be determined in an accurate manner based solely on the camera response, but to make such a link, the type of mobile device must be known. The camera response should be understood as the number of counts registered by the image sensor.
[0041] Figure 3 shows another figure. In this figure, the camera response function is created by using several data points. Different data points are different camera This relates to exposure time. Therefore, by using different exposure times, it becomes possible to determine the so-called gamma fit, which acts as a link between the camera response function, i.e., the count registered by the image sensor and the color of the object being inspected. In the example shown in Figure 3, the dark offset is 20 counts.
[0042] The reason different exposure times can be used in this way is that the image sensor is configured to register photons. Furthermore, color is represented by the photon flux. As an example, brighter colors will provide more photons per unit of time compared to darker colors. Moreover, the number of photons generated is proportional to the photon flux × exposure time. Therefore, by using the fact that the number of photons generated depends on both the photon flux and the exposure time, the relationship between the number of photons and the photon flux, i.e., color, can be determined by fixing the color and registering the number of photons for different exposure times.
[0043] Furthermore, to provide an even better camera response function, it is possible to use two or more colors. As shown in Figure 4, by having two colors, a dark color 116 and a bright color 118, and by registering the number of counts, i.e., the number of photons registered by the image sensor, for different exposure times, two curves are obtained. Since the photon flux for the dark color, indicated by the bold × in Figures 4 and 5, is lower than that for the bright color, indicated by the normal (plain) ×, the camera response for the dark color is lower than the camera response for the bright color, as shown.
[0044] When determining the camera response for different exposure times, the photon fluxes of the two colors can also be considered (weighed) by multiplying the exposure time by the photon fluxes of the two different colors. After such calculations, the x-axis is rescaled, and gamma fitting can be determined based on data points from both dark and bright colors, as shown in Figure 5.
[0045] If the lighting changes during the process of determining gamma matching, this will have adverse effects. Therefore, constant lighting is preferable. Less variation in lighting can be achieved by using the flash 104 of camera 102.
[0046] Furthermore, light reflection can also have a negative impact on the process of determining gamma fit. To reduce the presence of reflection, the inspection frame 108 may be matte to produce less reflection.
[0047] Figure 6 shows different camera This flowchart illustrates one example of Method 600, a method for determining gamma fit, i.e., the camera response function, by utilizing exposure time, thereby enabling more reliable determination of examination outcomes.
[0048] At startup, the flash 104 may be turned on 602, and the camera may begin capturing image data. Autofocus and auto exposure may be used at this stage.
[0049] An outline of how the inspection cassette 110 and inspection frame 108 should be positioned may be provided to the user via the user interface (UI) of the mobile device 100 so that spatial alignment between the inspection configuration 106 and the mobile device 100 is generally achieved.604 After approximate spatial alignment is achieved, image data may be captured and a first two-dimensional code 112a and / or a second two-dimensional code 112b of the inspection frame and / or a cassette two-dimensional code 128 may be identified, as exemplified herein by the ArUco (Augmented Reality University of Cordoba) code.606 Once the two-dimensional codes are identified,608 the position and orientation of the two-dimensional codes relative to the mobile device 100 or other known geometry may be determined.610 By determining the position and orientation of the two-dimensional code relative to the mobile device 100, the user interface of the mobile device may provide an indicator of how the mobile device 100 should be moved so as to improve the spatial alignment between the mobile device and the inspection configuration 612.
[0050] If the position and inclination of the inspection configuration 106 relative to the mobile device 100 are within specific limits 614, the focus and exposure settings are fixed 616. In other words, if the mobile device and the inspection configuration are identified as being positioned at a distance from each other corresponding to a reference distance, if one or more rotational angle differences between the mobile device and the inspection configuration are identified as being within set limits, and if the inclination angle difference between the two is within set limits, then the position of the mobile device may be considered spatially aligned with the inspection configuration. In addition to ensuring spatial alignment, it is also possible at this stage to ensure that there is no camera movement, or at least camera movement below a threshold. If the mobile device is equipped with an accelerometer, this may be used to identify whether or not the camera is moving.
[0051] After capturing image data using fixed focus and exposure settings, a software application, such as a mobile phone application, may be used to capture the image data 618. A series of images may be captured to ensure that the image data shows the inspection configuration in a consistent manner 620. If there is no motion between consecutive image frames, it may be determined that camera motion has not affected the image data. Furthermore, the exposure level may be assessed by identifying whether or not reflections have occurred in the image data. Focus deviation may be assessed by identifying whether or not lateral motion has occurred. This may be done by identifying whether or not lateral motion has occurred between consecutive image frames.
[0052] If the image data set is considered consistent 622, i.e., there is no deviation in motion, exposure deviation, and / or focus deviation between consecutive frames, the image data can be used 624 to quantify the color intensity changes occurring in the inspection unit 122. On the other hand, if the image data is not considered consistent, the process will return to step 606, which involves identifying a two-dimensional code.
[0053] In step 610, which determines the position and orientation of the 2D code, the orientation may be determined by taking into account data from an accelerometer built into the mobile device 100. In a similar manner, the built-in accelerometer may also be used in step 620 when assessing consistency. Data from the accelerometer may be taken into account when determining the orientation and / or motion.
[0054] Figure 7 shows, as an example, three modules for determining inspection outcome. In the first module 700, image data may be converted from raw format to PNG format, and then the image data may be matched using a 2D code as described above. In the second module 702, the inspection area and white balance area of the inspection configuration are identified and may be used to set the white balance. Furthermore, inspection objects and control objects in the inspection area may be identified. In addition, in this example, inspection outcomes and effectiveness scores may be determined. In this example, the inspection outcomes may include a positive outcome where non-zero inspection lines and control lines are found, a negative outcome where only control lines are found, and a defective outcome where no control lines are found. The effectiveness score may be a numerical value indicating how certain the inspection outcome is. The inspection outcomes and effectiveness scores may be combined to provide the inspection outcome.
[0055] In the third module 704, image data is deprocessed, and therefore the white balance can be corrected, and furthermore, the image data can be converted from RGB to brightness. After image deprocessing, the camera response function can be determined by using multiple exposure times and brightness counts, as described above. In the third module 704, density can be calculated. This can be achieved by evaluating the line peaks, i.e., the brightness of the test object and the control object. Furthermore, a baseline for background brightness can be established. Once the background brightness is determined, density can be calculated as the ratio between the peaks of the test object and the control object and the baseline. Even if the test is negative, i.e., there is no test object, the analysis can be performed to provide data on the intensity of the control object.
[0056] Figure 8 is a flowchart showing a method 800 for determining inspection outcome by using a camera-equipped mobile device 100. The method may include acquiring image data using the mobile device 802 and identifying CRS 114 in the image data 804. Once CRS 114 is identified, a camera response function specific to the mobile device type associated with the mobile device can be determined 806. This step may include a substep 808 for registering camera responses for different exposure times and a substep 810 for integrating the camera responses into a camera response function. The method then may include acquiring inspection image data showing the inspection unit 812, converting the inspection image data to camera-neutral image data using the camera response function 814, determining the intensity of the inspection object in the inspection unit 816, and determining the inspection outcome by fitting the intensity to a calibration curve 818.
[0057] Optionally, prior to step 802 of acquiring image data, the method may include activating a flash on the camera 820 to reduce variations in lighting.
[0058] Optionally, prior to step 804 of identifying the CRS, the method may further include detecting camera movement by using an accelerometer provided in the mobile device 822, and if the movement falls below a threshold, continuing to identify the CRS.
[0059] As has been described and shown above, various embodiments of the present invention have naturally been described, but the present invention is not limited thereto and can be embodied in other ways within the scope of the subject matter as defined in the following claims.
Claims
1. A computer implementation method (800) for determining an examination result outcome by using a mobile device (100) equipped with a camera (102) configured to capture image data showing an examination configuration (106), wherein the method is Acquiring the image data using the mobile device (100) (802), Identifying (804) the color reference section CRS (114) in the image data showing the inspection configuration (106), wherein the CRS (114) is colored with at least one reference color, A camera response function specific to the mobile device type associated with the aforementioned mobile device (100) is defined as follows: For each of several different exposure times, Registering (808) a camera response for at least one reference color, wherein the camera response corresponds to a photon flux. (810) Integrating the camera response for the plurality of different exposure times into the camera response function The decision is made by (806), Acquiring (812) an inspection image data set showing the inspection unit (122) of the inspection configuration (106), wherein the inspection unit (122) is colored differently for different inspection result outcomes, By using the aforementioned camera response function, the inspection image data set is converted into a camera-neutral inspection image data set (814), Based on the camera-neutral inspection image data set, the inspection unit (122) determines the intensity of the inspection object (124), such as an inspection line or inspection dot (816), (818) Determining the test result outcome by fitting the intensity to a calibration curve, wherein the test result outcome corresponds to the concentration of the sample held in the testing unit (122) Methods that include...
2. The method according to claim 1, wherein the inspection configuration (106) comprises an inspection cassette (110) disposed within an inspection frame (108), the CRS (114) is provided on the inspection frame (108), and the inspection unit (122) is provided on the inspection cassette (110).
3. The method according to claim 1 or 2, wherein the inspection configuration (106) is provided with at least one two-dimensional code (112a, 112b, 128), such as an AruCo code, to facilitate spatial alignment of the camera (102) of the mobile device (100) with respect to the inspection configuration (106).
4. The method according to any one of claims 1 to 3, wherein the at least one reference color comprises a light color (118) and a dark color (116), and the camera response for the light color is greater than the camera response for the dark color.
5. The method according to any one of claims 1 to 4, further comprising activating a flash (104) on the camera (102) to reduce fluctuations in illumination before identifying the CRS (114).
6. The method according to any one of claims 1 to 5, wherein the CRS (114) is matte in order to reduce the reflective effect.
7. The method according to any one of claims 1 to 6, further comprising detecting the movement of the camera (102) by using an accelerometer provided in the mobile device (100) (822) prior to the step of identifying the CRS (114), and continuing to identify the CRS if the movement is below a threshold.
8. The method according to any one of claims 1 to 7, wherein acquiring the image data (802), identifying the CRS (114) (804), determining the camera response function (806), and capturing the at least one set of inspection image data (812) are performed within a time span of less than one second so as to reduce the effects of changes in light conditions.
9. A sample receiving section (120) for receiving a liquid sample for testing, An inspection unit (122) is constructed to be colored differently for different inspection result outcomes and to display inspection objects such as inspection lines or inspection dots. At least one color reference section (CRS) (114) colored with at least one reference color, wherein a camera response function specific to the mobile device type of a camera-equipped mobile device can be determined by using a plurality of different exposure times for the camera, then, inspection image data showing the inspection section (122) can be converted into a camera-neutral inspection image data set by using the camera response function, then, the intensity of the inspection object (124) can be determined based on the camera-neutral inspection image data set, then, the inspection result outcome can be determined by fitting the intensity to a calibration curve, and the inspection result outcome corresponds to the concentration of the sample held in the inspection section (122), and An inspection configuration (106) comprising the above.
10. The inspection configuration (106) according to claim 9 further comprises an inspection cassette (110) configured to be positioned within an inspection frame (108), wherein the CRS (114) is provided on the inspection frame (108) and the inspection unit (122) is provided on the inspection cassette (110).
11. The inspection configuration (106) according to claim 9 or 10, further comprising at least one two-dimensional code (112a, 112b, 128), such as an AruCo code, in order to facilitate spatial alignment of the camera (102) of the mobile device (100) with respect to the inspection configuration (106).
12. The inspection configuration (106) according to claim 11, wherein the position of the CRS relative to the position of the at least one two-dimensional code is preset such that the position of the CRS can be determined based on the position of the at least one code.
13. The inspection configuration (106) according to any one of claims 9 to 12, wherein the at least one reference color comprises a light color (118) and a dark color (116), and the camera response for the light color is greater than the camera response for the dark color.
14. A mobile device (100) comprising a processor device, memory, and a camera (102), wherein the processor device is To acquire image data using the aforementioned camera (102), Identifying the color reference section CRS (114) in the image data showing the inspection configuration (106), wherein the CRS (114) is colored with at least one reference color, A camera response function specific to the mobile device type associated with the aforementioned mobile device (100) is defined as follows: For each of several different exposure times, The registration of a camera response for at least one reference color, wherein the camera response corresponds to a photon flux. To integrate the camera response for the aforementioned multiple different exposure times into the camera response function. The decision will be made by, The acquisition of an inspection image data set showing the inspection unit (122) of the inspection configuration (106), wherein the inspection unit (122) is colored differently for different inspection result outcomes. By using the aforementioned camera response function, the inspection image data set is converted into a camera-neutral inspection image data set, Based on the camera-neutral inspection image data set, the inspection unit (122) determines the intensity of the inspection object (124), such as an inspection line or inspection dot. The determination of the test result outcome by fitting the intensity to a calibration curve, wherein the test result outcome corresponds to the concentration of the sample held in the testing unit (122). A mobile device (100) built to perform the following actions.
15. A system for determining an examination result outcome by analyzing image data showing an examination configuration (106), wherein the system comprises a server and a mobile device (100) equipped with a camera (102), and the system The image data is acquired using the camera (102), Identifying the color reference section CRS (114) in the image data showing the inspection configuration (106), wherein the CRS (114) is colored with at least one reference color. A camera response function specific to the mobile device type associated with the aforementioned mobile device (100) is defined as follows: For each of several different exposure times, The registration of a camera response for at least one reference color, wherein the camera response corresponds to a photon flux. To integrate the camera response for the aforementioned multiple different exposure times into the camera response function. The decision will be made by, The acquisition of an inspection image data set showing the inspection unit (122) of the inspection configuration (106), wherein the inspection unit (122) is colored differently for different inspection result outcomes. By using the aforementioned camera response function, the inspection image data set is converted into a camera-neutral inspection image data set, Based on the camera-neutral inspection image data set, the inspection unit (122) determines the intensity of the inspection object (124), such as an inspection line or inspection dot. The determination of the test result outcome by fitting the intensity to a calibration curve, wherein the test result outcome corresponds to the concentration of the sample held in the testing unit (122). A system built to do that.
Citation Information
Patent Citations
US11,192,100
Method of obtaining a test result from a test strip for testing a liquid sample
WO2023037101A1
