Method for diagnosing consumer-based disease
The portable diagnostic system allows patients to perform disease tests at home using an optical property modification device and mobile image analysis, addressing the inaccessibility of traditional tests and enabling rapid, reliable point-of-care diagnosis.
Patent Information
- Application Number
- JP2024134314
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2018-10-09
- Filing Date
- 2024-08-09
- Publication Date
- 2024-11-06
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing disease diagnostic tests require trained personnel and centralized laboratories, making them inaccessible in remote areas with scarce medical resources and delaying rapid test results.
A portable diagnostic system using an optical property modification device and a mobile device that allows patients to perform disease diagnostic tests at home, with image analysis on the mobile device determining test results without the need for healthcare provider input.
Enables rapid, accessible, and reliable point-of-care disease diagnosis at home, reducing the need for centralized labs and trained personnel, especially beneficial in remote areas.
Smart Images

Figure 2024156975000001_ABST
Abstract
Description
[Technical field]
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to and the benefit of U.S. Patent Application No. 16 / 155,829, filed October 9, 2018, which is incorporated by reference in its entirety.
[0002] 1. Technical Field The present disclosure relates generally to the diagnosis of disease, and more particularly to a portable system for performing image-based disease diagnostic tests. [Background technology]
[0003] 2. Description of Related Art While many disease diagnostic tests are performed in a laboratory setting using benchtop equipment, advances in medical technologies such as microfluidics have allowed users to perform diagnostic tests using smaller, more portable equipment. For example, the hardware required to complete an immunoassay for a diagnostic test can be adapted into a handheld device. However, traditional testing processes require trained personnel, such as nurses, physicians, or laboratory technicians, to analyze the handheld device and determine the test results. Thus, for example, the patient must visit a facility, such as a medical clinic, or trained personnel must visit the patient at the patient's home. Alternatively, the patient can collect a biological sample (such as an oral or nasal swab) from the patient at the patient's home and mail the biological sample to a laboratory to perform an immunoassay using the biological sample.
[0004] In the above examples, these processes require the movement of a person(s) or the transportation of some testing materials, which does not provide rapid test results. Furthermore, performing diagnostic tests using traditional testing processes is particularly challenging in remote areas where medical resources and personnel are scarce. Advances in telecommunications have spurred the growth of telemedicine technologies that enable remote patient diagnosis. However, performing point-of-care diagnostic tests using a reliable, portable end-to-end system that patients can complete in the comfort of their own homes remains challenging. Summary of the Invention
[0005] overview The diagnostic system performs a disease diagnostic test (also referred to herein as a "diagnostic test" or a "nucleic acid disease diagnostic test") using at least an optical property-modifying device and a mobile device. The optical property-modifying device includes a plurality of reaction chambers. The reaction chambers are configured to perform a reaction between a biological sample and at least an optical property-modifying reagent. In some embodiments, the optical property-modifying device can include an interface configured to accept the biological sample. The diagnostic system can communicate instructions for the diagnostic test to a user via the mobile device.
[0006] In certain embodiments, the multiple reaction chambers may be arranged on a surface of the optical property-modifying device such that at least one of the geometric pattern formed by the layout of the multiple reaction chambers and the color of the reaction between the biological sample and at least the optical property-modifying reagent in the multiple reaction chambers is visible from a point external to the optical property-modifying device.
[0007] In some embodiments, the optical property-modifying device includes an electronic display configured to display an indication of the results of the diagnostic test. The electronic display may be a liquid crystal display, an organic light emitting diode display, an electronic paper display, and / or one or more light emitting diodes (LEDs). In some embodiments, the indication of the results of the diagnostic test presented by the electronic display of the optical property-modifying device may be the actual results of the diagnostic test. The indication may be displayed by the electronic display as human readable symbols, such as text, machine readable symbols, such as bar codes, and any other type of symbols.
[0008] A user provides a biological sample to the optical property-modifying device. In embodiments where the optical property-modifying device includes an interface, a user provides a biological sample to the interface of the optical property-modifying device. The biological sample reacts with an optical property-modifying reagent in a reaction chamber of the device. For example, the optical property-modifying device performs a nucleic acid amplification assay that changes the color of a solution containing the biological sample and the optical property-modifying reagent in the reaction chamber.
[0009] In some embodiments, a user captures one or more images of the optical property-modifying device using an optical sensor (e.g., a camera) of the mobile device. The image of the optical property-modifying device captured by the user may include different portions of the optical property-modifying device. In some cases, the optical property-modifying device or a user interface displayed on the mobile device may provide a visual marker to help the user align the mobile device with the portion of the optical property-modifying device that is being captured in the image.
[0010] The diagnostic system analyzes one or more images captured on the mobile device or a computer server in communication with the mobile device. First, in some embodiments, the diagnostic system can determine whether an optical property-modifying device is included in the image based on, for example, geometric and / or color characteristics known to be associated with the optical property-modifying device. In embodiments in which the reaction chamber is disposed on the surface of the optical property-modifying device, the geometric characteristics known to be associated with the optical property-modifying device can include, for example, a geometric pattern formed by the layout of the reaction chamber of the optical property-modifying device. As another example, in embodiments in which the reaction chamber is disposed on the surface of the optical property-modifying device, the color characteristics known to be associated with the optical property-modifying device can include, for example, a color of a reaction between a biological sample in the reaction chamber and at least an optical property-modifying reagent. The diagnostic system can also determine whether an optical property-modifying device is included in the image based on any other geometric and / or color characteristics known to be associated with the optical property-modifying device.
[0011] In further embodiments, the diagnostic system can determine whether a particular portion of the optical property-modifying device is included in the captured image. For example, the diagnostic system can determine whether an electronic display of the optical property-modifying device is included in the image. The diagnostic system can also determine a level of image quality based on factors such as skew, scale, focus, shadowing, or white balance. The diagnostic system can select one or more of the captured images for further analysis based on any of the above determinations. For example, the diagnostic system can select the captured images determined to include a particular portion of the optical property-modifying device, such as an electronic display, for further analysis.
[0012] The diagnostic system then determines a result of the diagnostic test based at least in part on the image of the optical property-modifying device captured by the mobile device. The result of the diagnostic test may include, for example, a positive result, a negative result, a quantitative result, and / or an indeterminate result.
[0013] For example, in an embodiment where the image captured by the mobile device depicts an electronic display of the optical property-modifying device displaying an indication of the result of a diagnostic test, the diagnostic system determines the result of the diagnostic test based at least in part on the indication displayed by the electronic display in the image. Specifically, in an embodiment where the image captured by the mobile device includes an electronic display of the optical property-modifying device displaying an indication of the result of a diagnostic test performed, and the diagnostic system determines the result of the diagnostic test based on the indication displayed by the electronic display in the captured image, at least one of optical pattern matching, optical template matching, and optical character recognition for the indication displayed by the electronic display in the image can be performed.
[0014] Similarly, in an embodiment in which the image captured by the mobile device depicts a plurality of reaction chambers disposed on a surface of an optical property-modifying device, the diagnostic system determines the result of the diagnostic test based at least in part on at least one of a known geometric characteristic and a known color characteristic associated with the optical property-modifying device and depicted in the image. In particular, the location of each reaction chamber in the image can be identified based on a known geometric characteristic of the optical property-modifying device, such as a geometric pattern formed by the layout of the reaction chambers. The color of the image at the identified location of each reaction chamber in the image can then be determined. The identified color of each reaction chamber can be compared to the known color characteristic of the optical property-modifying device to determine the result of the diagnostic test.
[0015] The diagnostic system can communicate the determined results of the diagnostic test to the user via the mobile device. Additionally, in some embodiments, a message including sponsored content based on the results of the diagnostic test is generated and provided to the user via the mobile device. The diagnostic system can also provide the determined results to a third party system, including a healthcare provider such as a physician or pharmacy, a government agency, such as the Centers for Disease Control and Prevention (CDC), an insurance company, a telemedicine partner, a therapeutic manufacturer, and any other third party system that assists in the prevention and / or treatment of disease. For example, the results of the diagnostic test can be provided to a pharmacy so that the pharmacy can fulfill the user's prescription. As another example, the results of the diagnostic test can be provided to a physician located within a predetermined distance of the user so that the physician can make a recommendation for treating the condition associated with the results.
[0016] In some embodiments, the geographic location of the mobile device and / or the geographic location timestamp are determined at one or more points before, after, and / or during the execution of the diagnostic test. For example, the geographic location of the mobile device and the geographic location timestamp may be determined when the results of the diagnostic test are provided to the user via the mobile device. The geographic location of the mobile device may be determined by a location sensor, such as a Global Positioning System (GPS) sensor of the mobile device. In certain embodiments, the diagnostic system may then store the geographic location and / or the geographic location timestamp along with the determined results of the diagnostic test. In some further embodiments, the results of the diagnostic test are determined based in part on at least one of the determined geographic location and timestamp. For example, in some embodiments, the sensitivity and specificity of the results of the diagnostic test may be adjusted based on geospatial and seasonal variations in disease prevalence. In further embodiments, in addition to or instead of the geographic location and timestamp data, metadata may be provided to one or more of the third party systems listed above along with the results of the diagnostic test. For example, data from the user's electronic health record, the user's vital signs, and any other relevant information may be provided to one or more third party systems.
[0017] In embodiments in which the geographic location and / or a timestamp of the geographic location of the mobile device is determined, the geographic location and / or timestamp may be provided along with the diagnostic test results to a third party system as briefly described above. For example, the diagnostic test results, geographic location, and timestamp may be provided to a third party system that stores epidemiological data based on aggregated diagnostic test results from multiple mobile devices associated with a patient population. This epidemiological data may be used, for example, to prevent disease.
[0018] The optical property-modifying device, the mobile device, and any other testing equipment such as swabs and collection tubes for biological samples are all portable. Thus, there is no need to perform disease diagnostic tests at a central laboratory, since the patient can complete the chemical reaction portion of the disease diagnostic test at home. Furthermore, the diagnostic system can provide a rapid diagnosis without requiring input from a healthcare provider, since the mobile device (or a computer server in communication with the mobile device) performs image analysis to determine the results of the diagnostic test. Furthermore, the diagnostic system is configured to standardize the images captured from the various types of mobile devices and optical sensors, so that the diagnostic system's determination of the results of the diagnostic test is independent of the mobile device hardware. Thus, the diagnostic system is a point-of-care system that allows the patient to conveniently complete diagnostic tests at home (or other patient locations) without leaving the home, mailing test materials to a laboratory, or having a healthcare provider visit the patient.
[0019] In another embodiment of the present disclosure, rather than using one or more images of the optical property-modifying device captured by the mobile device to determine the results of the diagnostic test, the optical property-modifying device transmits one or more data streams to the diagnostic system for use by the diagnostic system in determining the results of the diagnostic test. In such an embodiment, the optical property-modifying device further includes a data stream transmission module configured to transmit the data stream from the optical property-modifying device. The information transmitted in the data stream from the optical property-modifying device to the diagnostic system can include any of the information that the mobile device captures in the image in alternative embodiments, and even additional information in some embodiments. The data stream can be transmitted from the optical property-modifying device via electromagnetic radio frequency transmission (e.g., Bluetooth), ultrasonic transmission, and / or audio transmission. Advantages of transmitting the data stream via ultrasonic transmission include the ability to rapidly transmit large data structures without specialized RF hardware or software pairing.
[0020] In yet another embodiment of the present disclosure, a non-transitory computer readable storage medium stores instructions that, when executed by a processor, cause the processor to perform any embodiment of the method set forth above. [Brief description of the drawings]
[0021] [Figure 1] FIG. 1 is a diagram of a system environment for performing disease diagnostic tests, according to one embodiment. [Figure 2A] FIG. 1 is a diagram of an optical property-modifying device for use with a mobile device, according to one embodiment. [Figure 2B] FIG. 13 is a diagram of an optical property modifying device for use with a mobile device, according to another embodiment. [Diagram 3] FIG. 1 is a block diagram of a diagnostic system, according to one embodiment. [Figure 4-1] FIG. 4A shows a user interface of a mobile application for disease diagnostic testing, according to one embodiment. FIG. 4B shows another user interface of the mobile application shown in FIG. 4A, according to one embodiment, including information about disease diagnostic testing. FIG. 4C shows another user interface of the mobile application shown in FIG. 4A, according to one embodiment, including instructions for using a swab. FIG. 4D shows another user interface of the mobile application shown in FIG. 4A, according to one embodiment, including instructions for using a collection tube. FIG. 4E shows another user interface of the mobile application shown in FIG. 4A, according to one embodiment, including instructions for using a cartridge. [Figure 4-2]FIG 4F shows another user interface of the mobile application shown in FIG 4A according to one embodiment, including instructions to wait for the chemical reaction of the disease diagnostic test to complete. FIG 4G shows another user interface of the mobile application shown in FIG 4A according to one embodiment, including instructions to scan the cartridge. FIG 4H shows another user interface of the mobile application shown in FIG 4A according to one embodiment, including the results of the disease diagnostic test. [Diagram 5] 5A and 5B are data flow diagrams for performing a disease diagnostic test in a conventional system environment and a system environment including a diagnostic system, according to one embodiment. [Figure 6] 1 is a flow chart illustrating a process for determining a test result of a disease diagnostic test, according to one embodiment.
[0022] These figures depict embodiments of the present invention for purposes of example only. Those skilled in the art will readily recognize from the following discussion that alternative embodiments of the structures and methods illustrated herein may be employed without departing from the principles of the present invention as described herein. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0023] Detailed Description I. Exemplary System Overview FIG. 1 is a diagram of a system environment for performing disease diagnostic tests, according to one embodiment. The system environment includes a diagnostic server 150, a mobile device 110, an optical property-modifying device 120, and one or more healthcare providers 130. The diagnostic server 150, the mobile device 110, and the healthcare providers 130 may be connected to each other via a network 140. In other embodiments, different and / or additional entities may be included in the system environment. The functions performed by the various entities of FIG. 1 may vary in different embodiments.
[0024] The mobile device 110 is an electronic device including the diagnostic system 100 for determining test results of a disease diagnostic test performed by a user using at least the mobile device 110 (e.g., a smartphone, a tablet, a laptop computer, etc.) and the optical property modifying device 120. Because the mobile device 110 and the optical property modifying device 120 are portable, the user can perform the disease diagnostic test at the patient's home or any other suitable location outside a medical facility such as a hospital or a central laboratory for the disease diagnostic test. The diagnostic server 150 is a computer server that can perform some or all of the functions of the diagnostic system 100 in some embodiments.
[0025] A user of the mobile device 110 interacts with the diagnostic system 100 through a mobile application. The mobile application communicates information from the diagnostic system 100. For example, the mobile application can present instructions or results of a disease diagnostic test on a graphical user interface displayed on an electronic display of the mobile device 110. As another example, the mobile application provides information via audio signals or haptic feedback (e.g., vibrating the mobile device 110). The mobile application running on the mobile device 110 can present data from sensors of the mobile device 110 to the diagnostic system 100. For example, the mobile device 110 includes an optical sensor such as a camera for capturing an image of the optical property modifying device 120. The mobile device 110 can present the captured image to the diagnostic system 100 for further processing, which is further described with reference to FIG. 3. As another example, the mobile device 110 can also include a position sensor such as a global positioning system (GPS) sensor, a motion sensor such as an accelerometer, a gyroscope, or an inertial measurement unit, a proximity sensor, or a temperature sensor.
[0026] The mobile device 110 may communicate with the diagnostic server 150 and the healthcare provider 130 via a network 140, which may include any combination of local and wide area networks using wired or wireless communication links. In one embodiment, the network 140 uses standard communications technologies and Internet protocols. In some embodiments, all or a portion of the communications links of the network 140 may be encrypted to provide technological safeguards, for example, for compliance with the Health Insurance Portability and Accountability Act (HIPAA).
[0027] Throughout this disclosure, the transmission of information from the optical property-modifying device 120 to the mobile device 110, the healthcare provider 130, and / or the diagnostic server 150 is described as an image-based transmission. Specifically, throughout this disclosure, information is discussed as being transmitted from the optical property-modifying device 120 to the mobile device 110, the healthcare provider 130, and / or the diagnostic server 150 via an image of the optical property-modifying device 120 captured by the mobile device 110. However, in additional or alternative embodiments, rather than transmitting information from the optical property-modifying device 120 to other modules of the system environment via an image captured by the mobile device 110, the optical property-modifying device 120 can transmit data directly to other modules of the system environment via one or more alternative means, such as electromagnetic radio frequency transmission (Bluetooth, WiFi, etc.), ultrasonic transmission, audio transmission, or other types of non-image-based transmission. For example, in some embodiments, the optical property-modifying device 120 can include a data transmission module configured to transmit data directly from the optical property-modifying device 120. Thus, in such an embodiment, the diagnostic system may determine the results of the diagnostic test based on data received directly from the optical property modifying device 120 as opposed to images received from the mobile device 110. These alternative embodiments of data transmission are not discussed in the remainder of this disclosure, but it should be noted that in some embodiments, this alternative mode of data transmission may be implemented in place of or in addition to image-based data transmission.
[0028] Returning to Figure 1, healthcare provider 130 may be a healthcare provider, such as a pharmacy, a central laboratory (e.g., for completing chemical reactions for disease diagnostic tests), a hospital, other type of medical facility, or any other suitable provider of healthcare services. In an exemplary use case, diagnostic system 100 presents the results of a patient's disease diagnostic tests to a pharmacy. Based on the results, the pharmacy determines an appropriate prescription for the patient.
[0029] 2A is a diagram of an optical property-modifying device 120 for use with a mobile device 110, according to one embodiment. In the embodiment shown in FIG. 2A, the optical property-modifying device 120 (also referred to herein as a "cartridge") includes a collection tube interface 230, one or more reaction chambers 240, an indicator 250, and a QR code 260. In alternative embodiments, the optical property-modifying device 120 may include fewer or additional components than those shown in FIG. 2A.
[0030] To perform a disease diagnostic test, the user uses the optical property-modifying device 120 to react a patient's biological sample (e.g., containing nucleic acid) with an optical property-modifying reagent in the reaction chamber 240. In some embodiments, the optical property-modifying device 120 can accept the biological sample from a collection tube 200 via a collection tube interface 230. While performing the disease diagnostic test, the mobile device 110 can provide instructions for the test to the user via a graphical user interface of the mobile device 110, for example, as further described below with reference to FIGS. 4A-H. .
[0031] The indicators 250 may be light-emitting diodes (LEDs) that provide an indication of the status of a disease diagnostic test being performed by the optical property-modifying device 120. For example, the indicators 250 may display a red light to indicate that a test has not yet started, a yellow light to indicate that a test is in progress, and a green light to indicate that a test is complete. In other embodiments, the indicators 250 may be another type of indicator different from an LED (e.g., an audio indicator), and the optical property-modifying device 120 may include any number of indicators 250 (including zero).
[0032] As mentioned above, the embodiment of the optical property-modifying device 120 shown in FIG. 2A includes a QR code 260. The QR code 260 can be associated with information for a disease diagnostic test, such as the type of test or the expiration date of the test. The diagnostic system 100 can determine the information for a disease diagnostic test by processing an image of the QR code 260 scanned by the optical sensor of the mobile device 110. The QR code 260 can also be another type of code, such as a bar code, other identifier, or a machine-readable signature. Although the embodiment of the optical property-modifying device 120 includes a QR code 260, in some alternative embodiments, the optical property-modifying device 120 does not include a QR code.
[0033] In one use case, the optical property modifying device 120 uses the reaction chamber 240 to perform a type of disease diagnostic test involving amplification of a nucleic acid(s), e.g., nucleic acid, to determine the presence or amount of a particular genetic target in a biological sample. For example, the optical property modifying device 120 is configured to receive an optical property modifying reagent, which is a solution containing a nucleic acid enzyme and a primer that is specific to a target nucleic acid sequence specific to the organism of interest. The presence or amount of this target nucleic acid sequence in the biological sample may indicate that the patient is infected with a particular pathogen or suffers from a particular genetic disease. Furthermore, the optical property modifying reagent includes a dye that changes color or fluoresces upon target amplification, resulting in a visible change in the color properties of the solution. Thus, the diagnostic system 100 can analyze the color properties of the solution of the biological sample and the optical property modifying reagent to determine the outcome of the disease diagnostic test. In some embodiments, the optical property modifying device 120 can perform other tests, such as immunoassays or enzyme-linked immunosorbent assays (ELISAs).
[0034] In the embodiment of the optical property-modifying device 120 shown in FIG. 2A, the reaction chambers 240 are disposed on the surface of the optical property-modifying device 120, such that the reaction chambers 240 and their contents are at least partially visible from the surface of the optical property-modifying device 120. In such an embodiment, the mobile device 110 can capture an image of the reaction chambers 240 and their contents. Furthermore, in such an embodiment where the reaction chambers 240 are disposed on the surface of the optical property-modifying device 120, to determine that the image depicts the optical property-modifying device 120, it can be determined that the image depicts one or more of color characteristics and geometric characteristics that are known to be associated with the reaction chambers 240 of the optical property-modifying device 120. The geometric characteristics that are known to be associated with the reaction chambers 240 of the optical property-modifying device 120 can include a geometric pattern formed by the layout of the reaction chambers. The color characteristics that are known to be associated with the reaction chambers 240 of the optical property-modifying device 120 can include the color of the reaction between the biological sample and the optical property-modifying reagent in the reaction chamber of the device.
[0035] The diagnostic system can also use one or more of the color characteristics and geometric characteristics identified in the image of the reaction chambers 240 of the optical property-modifying device 120 to determine the result of the diagnostic test performed by the optical property-modifying device 120. More specifically, the location of each reaction chamber can be identified in the image using the known geometric characteristics of the optical property-modifying device 120. The color of the image at the identified location of each reaction chamber in the image can then be determined. These identified colors can be compared with the known colorimetric characteristics of the optical property-modifying device 120 to determine the result of the diagnostic test performed by the optical property-modifying device 120. In this manner, using the mobile device 110 to capture the image of the optical property-modifying device 120 allows the determination of the result of the diagnostic test performed by the optical property-modifying device 120.
[0036] In an alternative embodiment, as discussed in the embodiment below with respect to Figure 2B, the reaction chamber 240 is not visible from the surface of the optical property-modifying device 120, and therefore the contents of the reaction chamber 240 are also not visible. In such an embodiment, as discussed below with respect to Figure 2B, alternative means of determining the results of the diagnostic tests performed by the optical property-modifying device 120 can be used.
[0037] The optical property modifying device 120 can perform multiple disease diagnostic tests in parallel or in series. The optical property modifying device 120 shown in the example of FIG. 2A includes five reaction chambers 240, but in other embodiments, the number of reaction chambers may vary. Each reaction chamber may or may not be connectable to another reaction chamber. Furthermore, a given disease diagnostic test may be associated with one or more reaction chambers. For example, the optical property modifying device 120 shown in FIG. 2A is used to perform an influenza A test associated with two of the reaction chambers, an influenza B test associated with one of the reaction chambers, a positive internal control test associated with one of the reaction chambers, and a negative internal control test associated with one of the reaction chambers. In some embodiments, multiple tests are associated with at least one common reaction chamber, which may be advantageous to integrate the required number of reaction chambers in the optical property modifying device 120.
[0038] Although not shown in FIG. 2A, in some embodiments, the optical property-modifying device 120 can include a user control, such as a tab, button, or switch. In such embodiments, the optical property-modifying device 120 initiates a chemical reaction of a disease diagnostic test when a user interacts with the user control. For example, when a user pulls a tab, presses a button, or activates a switch, the optical property-modifying device 120 can begin mixing the optical property-modifying reagent with the biological sample and adjust the temperature of the reaction chamber to the appropriate set temperature point. In other embodiments, the optical property-modifying device can automatically initiate mixing and adjusting the temperature of the reaction chamber when a biological sample is presented.
[0039] The collection tube 200 is configured to store a biological sample and includes a cartridge interface 210 and a cap 220. A user can provide a biological sample to the collection tube 200 using, for example, a swab. The cap 220 encloses the biological sample in the collection tube 200. A user can attach the collection tube 200 to the optical property-modifying device 120 by physically contacting the cartridge interface 210 of the collection tube 200 to the collection tube interface 230 of the optical property-modifying device 120. Once attached, the collection tube 200 can provide the stored biological sample to the optical property-modifying device 120 via the interfaces 210 and 230. The collection tube 200 shown in FIG. 2A is a cylindrical tube, in other embodiments, the collection tube 200 can have a different overall shape or form factor, such as a rectangular prism. Alternatively, in some embodiments, the collection tube is not used to provide the biological sample to the optical property-modifying device 120.
[0040] 2B is a diagram of an optical property-modifying device 120 for use with a mobile device 110 according to another embodiment. Unlike the embodiment of the optical property-modifying device 120 shown in FIG. 2A, in the embodiment of the optical property-modifying device 120 shown in FIG. 2B, the reaction chamber of the device is not located on the surface of the device and is therefore not visible from a point outside the optical property-modifying device 120.
[0041] Instead, in the embodiment of the optical property-modifying device 120 shown in FIG. 2B, the optical property-modifying device 120 includes an electronic display 270 on a surface thereof. The electronic display 270 may be, for example, a liquid crystal display (LCD), an organic light-emitting diode (OLED) display, an electronic paper display, or one or more individual light-emitting diodes (LEDs), among other types of displays. The electronic display 270 is configured to present an indication of one or more results of a diagnostic test performed by the optical property-modifying device 120. More specifically, the electronic display 270 is configured to present an indication of one or more results of a diagnostic test based on a reaction between a biological sample and at least an optical property-modifying reagent in a reaction chamber of the optical property-modifying device 120. In some embodiments, the indication of the results of the diagnostic test presented by the electronic display 270 is presented as one or more of human readable symbols (e.g., alphanumeric characters or graphics) and machine readable symbols (e.g., bar codes and QR codes), The actual determined result of the diagnostic test may include, for example, in the embodiment shown in Figure 2B, the electronic display 270 presents the actual determined result of the diagnostic test "Influenza A Positive" in human readable symbols.
[0042] The indication of the result of the diagnostic test presented by the electronic display 270 can be based on one or more of the color characteristics and the geometric characteristics of the reaction chamber. A software algorithm can determine the indication displayed by the electronic display 270 based on one or more of the color characteristics and the geometric characteristics of the reaction chamber. As described above, the color characteristics can include, for example, the color of the reaction between the biological sample in the reaction chamber and at least the optical property-modifying reagent. The geometric characteristics can include, for example, the geometric pattern formed by the layout of the reaction chamber in the optical property-modifying device 120.
[0043] In such an embodiment where an indication of the result of the diagnostic test performed by the optical property-modifying device 120 is presented on the electronic display 270 of the optical property-modifying device 120, the mobile device 110 can capture an image of the electronic display 270. For example, as shown in FIG. 2B, the mobile device 110 can be placed over the optical property-modifying device 120 and scan or take a photo or video of the electronic display 270 of the optical property-modifying device 120. The diagnostic system can then use an image recognition process to determine the result of the diagnostic test based on the indication presented by the electronic display 270 captured in the image. The image recognition process can include, for example, optical pattern matching, optical template matching, or optical character recognition (OCR) algorithms known to those skilled in the art. By way of example, as shown in FIG. 2B, the diagnostic system can recognize that the image of the electronic display 270 of the optical property-modifying device 120 captured by the mobile device 110 presents a message indicating a positive diagnosis of influenza A. In response to the recognition, the mobile device 110 can provide the user with further interpretations or options for next steps.
[0044] Although the embodiment of the optical property-modifying device 120 shown in Fig. 2A includes a reaction chamber 240 disposed on the surface of the optical property-modifying device 120 and does not include an electronic display, and the embodiment of the optical property-modifying device 120 shown in Fig. 2B includes an electronic display 270 and a reaction chamber not disposed on the surface of the optical property-modifying device 120, in alternative embodiments, the features of the embodiments of the optical property-modifying device 120 shown in Figs. 2A-B may occur in any combination. For example, another embodiment of the optical property-modifying device 120 may include both an electronic display 270 and a reaction chamber 240 disposed on the surface of the optical property-modifying device 120.
[0045] II. Exemplary System Configuration 3 is a block diagram of diagnostic system 100, according to one embodiment. Diagnostic system 100 includes a user data store 310, an image processing engine 320, an image analysis engine 330, a diagnostic test engine 340, and a test data store 350. In other embodiments, diagnostic system 100 can include additional, fewer, or different components for various applications.
[0046] In some embodiments, some or all of the functions of the diagnostic system 100 may be performed by or implemented on the diagnostic server 150 instead of the mobile device 110. For example, the mobile device 110 may use the image processing engine 320 to acquire images of the optical property modifying device 120 and present the images to the diagnostic server 150 for further processing by the image analysis engine 330. The mobile device 110 may then receive the test results determined by the diagnostic server 150 and communicate the test results to a user. This may be advantageous because the image analysis engine 330 may require more computational resources compared to the image processing engine 320 or other components of the diagnostic system 100 of the mobile device 110.
[0047] The user data store 310 stores information about users of the diagnostic system 100, such as patients who have completed or will complete diagnostic tests. The information may include user information such as name, demographics, family data, geographic location, timestamp data, contact information, or physiological data. This information may depict the user's medical history, such as prescriptions, health conditions, genetic data, visits to health care providers, past or current medical services or interventions administered, or previously completed diagnostic tests, along with associated details such as the date and / or time the tests were performed, and the test results.
[0048] The image processing engine 320 acquires and processes images from the mobile device 110. The image processing engine 320 can implement image processing techniques known to those skilled in the art, such as noise reduction, deskewing, resizing, rescaling, rotation, equalization, focusing / sharpening, or edge detection using different types of filters. The image processing engine 320 can also determine whether the optical property modifying device 120 or a particular part of the optical property modifying device 120 is included in the image based on known geometric and / or color characteristics associated with the optical property modifying device 120.
[0049] As mentioned above, in an embodiment where the reaction chambers of the optical property-modifying device 120 are arranged on the surface of the device, the known geometric characteristic of the optical property-modifying device 120 can include a geometric pattern formed by the layout of the reaction chambers on the surface of the optical property-modifying device 120. In an embodiment where the optical property-modifying device 120 includes an electronic display, the known geometric characteristic of the optical property-modifying device 120 can include the dimensions of the electronic display. As another example, the QR code 260 shown in FIG. 2A and FIG. 2B can be a geometric characteristic specific to the optical property-modifying device 120, a batch of the optical property-modifying device 120 (e.g., having a specific expiration date based on the date of manufacture), or a specific type of diagnostic test. Other types of geometric characteristics include, for example, the border of the optical property-modifying device 120, a two-dimensional (2D) or three-dimensional (3D) barcode, an alignment marker (e.g., the reaction chamber 240, the indicator 250, the exemplary text "Influenza A + B Test" shown in FIG. 2A), or any other type of fiducial marker that can be a reference point in the image.
[0050] The image processing engine 320 can transform (e.g., translate, tilt, scale, or rotate) the acquired image based on the geometric properties, in other words the spatial data of the image determined by the image processing engine 320. Alternatively, the image processing engine 320 can leave the image unchanged, but instead transform the coordinates used to identify regions of interest for analysis within the image. As an example, the fiducial markers of the optical property modifying device 120 have a reference orientation and / or size. For example, the QR code 260 shown in FIG. 2A is known to have a length and width (e.g., square dimensions) of one centimeter and to be oriented with the text "Influenza A + B Test" labeled on the optical property modifying device 120. If the image processing engine 320 determines that the QR code 260 appears smaller or larger than expected based on the reference size, the image processing engine 320 can scale the image up or down, respectively. If the image processing engine 320 determines that the QR code 260 shown in the image is distorted in shape (e.g., trapezoidal or diamond shaped), the image processing engine 320 can adjust the distortion of the image so that the QR code 260 is more closely rendered as the expected square shape. If the image processing engine 320 determines that the QR code 260 shown in the image is not aligned to the reference orientation (e.g., the image is rotated 45 degrees, 60 degrees, or 90 degrees), the image processing engine 320 can rotate the image to the reference orientation. Additionally, the image processing engine 320 can determine the level of focus of the image by resolving two or more features of the optical property modifying device 120, such as the QR code 260 and another fiducial marker.
[0051] As mentioned above, known color characteristics can also be associated with the optical property-modifying device 120. In particular, the image processing engine 320 has information indicating that the surface (or fiducial marker) of the optical property-modifying device 120 is known to be of a particular color(s). As mentioned above, in an embodiment in which the reaction chamber of the optical property-modifying device 120 is located on the surface of the device, the known color characteristics of the optical property-modifying device 120 can include the color of one or more contents of the reaction chamber of the optical property-modifying device 120, such as an optical property-modifying reagent or reaction solution. Additional color characteristics of the optical property-modifying device 120 can include the color of a component of the optical property-modifying device 120 itself, such as, for example, the color of the indicator 250 shown in FIG. 2A.
[0052] As another example, the surface of the optical property-modifying device 120 may be known to have a uniform color (e.g., nearly white). However, an image of the optical property-modifying device 120 may be colored with a warm color (e.g., red) or a cool color (e.g., blue) depending on the lighting conditions when the image was captured. The image processing engine 320 may use white balance (e.g., color balance) to determine the lighting conditions of the image and adjust the color of the image. Thus, the image processing engine 320 may properly match the known white color of the surface of the optical property-modifying device 120 with the image being adjusted. The image processing engine 320 may also use shadowing techniques to remove or otherwise include shadows in the image that may distort the color of certain parts of the image. For example, the image processing engine 320 may measure the uniformity of the known color of the surface of the optical property-modifying device 120 to identify shadows in the image.
[0053] In some embodiments, the image processing engine 320 continuously monitors images captured by the optical sensor of the mobile device 110. For example, the mobile device 110 displays a live stream of images captured by the optical sensor (e.g., representing the field of view of the optical sensor) to provide a real-time visual guide for the user to align the mobile device 110 with the optical characteristic modifying device 120 being imaged. During monitoring, the image processing engine 320 can determine the image quality level of each image. If the image quality level meets a threshold level, the image processing engine 320 selects the image for further processing. The image processing engine 320 can determine the quality level and the threshold level based on, for example, focus, shadowing, white balance level, or illumination level of the image.
[0054] Additionally, by adjusting the images using the techniques and parameters described above, the image processing engine 320 can standardize images captured by mobile devices 110 having different technical specifications. This can be advantageous because users are likely to have different types of mobile devices 110. For example, one mobile device may have a higher resolution camera with a stronger white flashlight than another mobile device. By standardizing the images captured from these two mobile devices, the image processing engine 320 can effectively process the images regardless of the particular specifications of the mobile devices.
[0055] The image analysis engine 330 analyzes the images captured and processed by the image processing engine 320. In particular, in an embodiment in which the optical property modifying device 120 includes a reaction chamber arranged on the surface of the optical property modifying device 120 such that the contents of the reaction chamber are at least partially visible in the image of the optical property modifying device 120, the image analysis engine 330 analyzes the reaction chamber in the image. On the other hand, in an embodiment in which the optical property modifying device 120 includes an electronic display that displays an indication of the results of the diagnostic test performed by the optical property modifying device 120, the image analysis engine 330 analyzes the indication displayed by the electronic display in the captured image of the optical property modifying device 120. Both embodiments of image analysis by the image analysis engine 330 are described in turn below.
[0056] Turning first to an embodiment in which the image analysis engine 330 analyzes an image including reaction chambers disposed on the surface of the optical property-modifying device 120, the image analysis engine 330 determines one or more color characteristics of the reaction chambers of the image, such as the color, transparency, translucency, opacity, or uniformity of the reaction chambers, and / or the contents within the reaction chambers. As an example, the image analysis engine 330 determines information about the color characteristics of the reaction chambers, such as the average and variance of the color of the pixels of the image corresponding to each reaction chamber. The image analysis engine 330 can determine the average and variance of the color (or any other statistical analysis) based on the RGB (Red-Green-Blue) color model, the Hue Saturation Value (HSV) color model, or any other suitable color model. The image analysis engine 330 identifies these color characteristics based on known geometric characteristics of the optical property-modifying device 120, such as size, shape, orientation, or identifying fiducial marks. For example, the image analysis engine 330 may retrieve a color image from the test data store 350 (e.g., to use as a reference image), identify the size and orientation of a QR code® in the color image, and, with a QR code® of known size (e.g., 1x1 cm) and known relative positions of five reaction chambers to the QR code® (e.g., 2 cm to the right and top, spaced in 1 cm increments), extract the mean and variance of the color of each reaction chamber.
[0057] The image analysis engine 330 can determine a test result of a disease diagnostic test by comparing the determined color information of the reaction chamber with reference information (e.g., based on an RGB or HSV color model) that indicates one or more color ranges. The color range can correspond to a diagnosis of the disease diagnostic test associated with the reaction chamber. Thus, the image analysis engine 330 can determine a test result based on the color range that the determined color of the reaction chamber falls within. In other words, the image analysis engine 330 can match the color change of the reaction chamber to a particular test result. For example, the image analysis engine 330 can determine a negative disease diagnosis in response to matching the determined color to a first color range (e.g., yellow to green), determine a positive disease diagnosis in response to matching the determined color to a second color range (e.g., blue to purple), and determine an undetermined (e.g., "undetermined" or "unknown") diagnosis of a disease in response to matching the determined color to a third color range (or any color that is not within any specified range).
[0058] Alternatively, the image analysis engine 330 can determine the test result based on the distribution and clustering of colors of the individual pixels that make up the image of the reaction chamber, rather than on point estimates of the mean or variance of the colors. For example, the image analysis engine 330 can classify each pixel in the image of the reaction chamber as being within one of the three color ranges described above. If multiple pixels are within the first color range, the image analysis engine 330 determines a negative disease diagnosis. If multiple pixels are within the second color range, the image analysis engine 330 determines a positive disease diagnosis. If multiple pixels are within the third color range, the image analysis engine 330 determines an undetermined diagnosis of disease. In this way, the image analysis engine 330 is robust to, for example, black and white pixels that represent reflections from the edges of the chamber, which are substantially different colors than the solution in the reaction chamber and may confound a point estimate-based approach to determining the color of the solution.
[0059] In some embodiments, the image analysis engine 330 determines the level of disease severity or the confidence level of the test result based on comparing the color information to the reference information. For example, dark colors within a certain color range may indicate a more severe disease diagnosis or a higher confidence level compared to light colors. Pending test results may occur due to various factors such as imperfections in the collection tube 200 or the optical property modifying device 120, variability in the captured image, or human error by the user or patient, such as contamination of the biological sample provided to the diagnostic test, or not waiting a sufficient time (or too long) for the chemical reactions of the diagnostic test to complete.
[0060] In some embodiments, the image analysis engine 330 implements a defect detection algorithm to analyze the image of the optical property modifying device 120. For example, the image analysis engine 330 can identify other types of defects, such as air bubbles in the reaction chamber of the optical property modifying device 120, or debris or scratches inside or outside the reaction chamber. Based on the identification of the defects, the image analysis engine 330 can use image processing techniques to remove the defects from the image, for example, to remove clusters of pixels corresponding to the defects. Thus, the image analysis engine 330 can exclude anomalous color values from the determination of color information (e.g., mean and variance), which can improve the accuracy of the corresponding test results.
[0061] Turning now to an embodiment in which the image analysis engine 330 analyzes an image including a representation of the results of a diagnostic test displayed by an electronic display of the optical property modifying device 120, the image analysis engine 330 determines the results of the diagnostic test by interpreting the representation displayed by the electronic display. As noted above, the representation of the results of the diagnostic test displayed by the electronic display may include the actual results of the diagnostic test. In such an embodiment, the representation may be presented by the electronic display as human readable symbols, such as text, machine readable symbols, such as bar codes, and any other type of symbols. To interpret the representation displayed by the electronic display, the image analysis engine 330 may perform pattern matching, template matching, or another technique known to those skilled in the art.
[0062] The image analysis engine 330 may also, in some embodiments, further determine the test result based on information other than the analyzed image. For example, the image analysis engine 330 may determine the test result based in part on the geographic location and / or timestamp of the diagnostic test. In particular, certain diseases may be more prevalent in certain geographic regions (e.g., in tropical or dry climate regions) or during certain time ranges (e.g., during summer or winter seasons). In some embodiments, the validation power (e.g., sensitivity vs. specificity) may be adjusted based on known epidemiological factors such as disease prevalence, such that when prevalence is low, the sensitivity of the test may be reduced to avoid false positive test results.
[0063] The diagnostic test engine 340 provides and / or receives information from the mobile device 110 and the healthcare provider 130 for disease diagnostic testing. For example, the diagnostic test engine 340 can provide instructions for a diagnostic test to the mobile device 110. The diagnostic test engine 340 can retrieve instructions for a diagnostic test (e.g., including text, graphics, audio, or other media content) from the test data store 350.
[0064] The diagnostic test engine 340 also receives data from the mobile device 110, such as images of the optical property-modifying device 120 captured by the optical sensor of the mobile device 110 and / or metadata such as the geographic location of the mobile device 110, a timestamp of the captured image, information describing the optical sensor (pixel resolution, aperture, flash, etc.), the patient's electronic health record data, the patient's vital signs, and any other relevant information. The diagnostic test engine 340 determines diagnostic test information (e.g., type of diagnostic test or result of diagnostic test) based on the images processed and analyzed by the image processing engine 320 and / or image analysis engine 330.
[0065] Following identification of the results of the diagnostic tests, the diagnostic test engine can provide the test results to the mobile device 110 and / or a third party system, such as the healthcare provider 130. Additionally, the diagnostic test engine 340 can store the test results in the test data store 350 or the user data store 310 along with one or more of the metadata described above.
[0066] As mentioned above, in some embodiments, the diagnostic test engine 340 can provide the test results and one or more of the above metadata to a computer server of a third party system, including a healthcare provider 130, such as a doctor or pharmacy, a government agency, e.g., the Centers for Disease Control and Prevention (CDC), insurance companies, telemedicine partners, therapeutic manufacturers, and any other third party system that assists in the prevention and / or treatment of disease. The third party system can store aggregated health information of a population of people and organize the health information based on geographic location and / or based on timestamp. Thus, the third party system can render epidemiological data based on aggregated test results from multiple mobile devices 110 and a population of patients. The epidemiological data can be organized based on various parameters (e.g., demographics, geographic location, time information, type of disease, etc.) and used to determine risk factors and preventative measures for certain diseases. For example, the CDC can use the test results and health information to assess the health of a population within its government jurisdiction, such as to monitor the spread and prevalence of diseases such as influenza. As a further example, the epidemiological data can be used to develop real-time quantitative, qualitative, or semi-quantitative severity indexes of certain diseases based in part on geographic location. For example, visual heat maps can be generated to show geographic disease prevalence. As yet another example, disease prevalence can be predicted based on historical disease averages, real-time diagnosis results, user geography, weather, traffic patterns, or any other relevant statistics using predictive algorithms. Determined geographic disease trends can be provided to third party systems, such as pharmaceutical companies, retailers, government agencies, and insurance companies, to guide treatment-related supply chain and resource allocation decisions. Additionally, disease geographic trends can be provided to individual users and other third party systems, such as social media platforms, travel providers, and advertising agencies, to inform individual user behavior.
[0067] In some embodiments, the diagnostic test engine 340 can communicate sponsored content to a user via the mobile device 110 based on the test results of the diagnostic test. For example, the sponsored content is a content item that is displayed in a user interface of the mobile device 110. Examples of sponsored content include information from vendors of goods or services that may aid in the treatment of a condition tested for by the diagnostic system 100. For example, vendors offer prescription drugs, over-the-counter drugs, physical therapy and rehabilitation services, etc.
[0068] In further embodiments, the diagnostic test engine 340 can communicate alerts to the user via the mobile device 110. These alerts can depict the prevalence of disease in the area and provide recommendations for disease prevention, diagnosis, and treatment. The alerts can be based on the user's location history and potential recent exposure to the disease.
[0069] III. Exemplary Mobile Application User Interface FIG. 4A displays a user interface 400 of a mobile application for disease diagnostic testing, according to one embodiment. The user interface 400 shows an image 405 of the optical property-modifying device 120. The image 405 is a view of the camera of the mobile device 110 displaying the user interface 400. The image 405 is oriented to align with the mobile device 110, as the edges of the optical property-modifying device 120 are approximately parallel to the edges of the user interface 400, and by extension, the mobile device 110. In some embodiments, the user interface 400 includes one or more alignment markers overlaying the view to assist a user of the mobile device 110 in aligning the mobile device 110 with the optical property-modifying device 120 to capture the image 405. For example, the alignment marker is a semi-transparent graphic of the optical property-modifying device 120 that the user can use to overlap the physical optical property-modifying device 120. As another example, the alignment marker corresponds to a geometric feature of the optical property-modifying device 120 (eg, the QR code 260 ), or a line that should be aligned with an edge of the optical property-modifying device 120 .
[0070] FIG. 4B shows another user interface 410 of the mobile application shown in FIG. 4A, including information about a disease diagnostic test, according to one embodiment. The image processing engine 320 and the image analysis engine 330 process the image 405 of the optical property-modifying device 120 shown in FIG. 4A. Based on the processing, the diagnostic test engine 340 determines the disease diagnostic test of the optical property-modifying device 120 and provides information about the disease diagnostic test for display. In particular, the user interface 410 shows the type of test (e.g., influenza A and B), the expiration date (e.g., January 30, 2020), the description of the test, the duration (e.g., the 20-minute chemistry of the test), and the cartridge ID (e.g., 0x34E) of the optical property-modifying device 120.
[0071] Figure 4C illustrates another user interface 415 of the mobile application shown in Figure 4A, according to one embodiment, including instructions for using a swab 420. The user interface 415 illustrates instructions for an exemplary step of the disease diagnostic test shown in Figure 4B, in which a user is instructed to remove the swab 420 from a sterile package 425 and swab the nostril of a patient undergoing a disease diagnostic test to collect a biological sample from the patient.
[0072] FIG 4D illustrates another user interface 430 of the mobile application shown in FIG 4A, including instructions for using the collection tube 200, according to one embodiment. The user interface 430 illustrates instructions for an exemplary step of the disease diagnostic test shown in FIG 4B. In this step, the user is instructed to insert the swab 420 into the collection tube 200 and swirl the swab 420 for 10 seconds, after which the swab 420 should be discarded. The cap 220 of the collection tube 200 has been removed so that the swab 420 can be inserted therein.
[0073] FIG. 4E shows another user interface 435 of the mobile application shown in FIG. 4A, according to one embodiment, including instructions for using the cartridge. The user interface 435 shows instructions for an exemplary step of the disease diagnostic test shown in FIG. 4B. For this step, the user is instructed to place the collection tube 200 onto the cartridge (optical property modifying device 120) and close the cap 220. In particular, the cartridge interface 210 should be coupled to the collection tube interface 230, which delivers the patient's biological sample to the optical property modifying device 120. The user is also instructed to pull the tab of the optical property modifying device 120 to start the chemical reaction of the disease diagnostic test.
[0074] 4F shows another user interface 440 of the mobile application shown in FIG. 4A, including instructions to wait for the chemical reactions of the disease diagnostic test to complete, according to one embodiment. The user interface 440 displays a timer that indicates the time remaining until the chemical reactions of the disease diagnostic test shown in FIG. 4B should complete. The total time for this exemplary disease diagnostic test is 20 minutes, although in other embodiments the time may vary, for example, between 1 minute and 60 minutes.
[0075] FIG. 4G shows another user interface 445 of the mobile application shown in FIG. 4A according to one embodiment, including instructions for scanning the cartridge. The user interface 445 shows instructions for an exemplary step of the disease diagnostic test shown in FIG. 4B. For this step, the user is instructed to scan (take one or more images of) the cartridge (optical property-modifying device 120). As the chemical reaction of the disease diagnostic test is completed after waiting for the duration of the test, the color characteristics of the reaction chamber of the imaged optical property-modifying device 120 have undergone a change. Since the optical property-modifying device 120 shown in FIG. 4A-H is an embodiment of the optical property-modifying device 120 shown in FIG. 2A, the reaction chamber is disposed on the surface of the optical property-modifying device 120, and therefore the contents of the reaction chamber are at least partially visible in the image of the optical property-modifying device 120 shown in FIG. 4A-H. Thus, the image 450 of the optical property-modifying device 120 shows that two of the reaction chambers 455 and 460 have at least changed in color as a result of the patient's biological sample reacting with the optical property-modifying reagent.
[0076] In an alternative embodiment, where the optical property-modifying device 120 shown in Figures 4A-H is an embodiment of the optical property-modifying device 120 shown in Figure 2B, a reaction chamber is not disposed on the surface of the optical property-modifying device 120, and therefore the contents of the reaction chamber are not visible in the image of the optical property-modifying device 120 shown in Figures 4A-H. Rather, in an alternative embodiment, where the optical property-modifying device 120 shown in Figures 4A-H is an embodiment of the optical property-modifying device 120 shown in Figure 2B, the optical property-modifying device 120 includes an electronic display that displays an indication of the results of the diagnostic test.
[0077] FIG. 4H shows another user interface 465 of the mobile application shown in FIG. 4A, including the results of a disease diagnostic test, according to one embodiment. The image processing engine 320 and the image analysis engine 330 process and analyze the image 445 of the optical property-modifying device 120 shown in FIG. 4G. Based on the analysis, the diagnostic test engine 340 determines the test result of the disease diagnostic test and provides information related to the test result for display in the user interface 465. In particular, the user interface 465 shows that the patient has analyzed positive for influenza A and negative for influenza B. The user interface 465 also shows an option for the user or patient to call a treatment hotline. For example, the treatment hotline is a phone number of a medical provider who can provide medicines and other medical services to treat influenza.
[0078] In some embodiments, the user interface 465 presents the user with options to modify, verify / confirm, or cancel the test results, which may be performed before the diagnostic system 100 (via the diagnostic test engine 340) provides the test results to the healthcare provider 130, etc. If the test results are updated after the test results are provided to the healthcare provider 130, the diagnostic test engine 340 may also automatically provide the updated test results. In one embodiment, if the test results are positive, the diagnostic test engine 340 provides a notification for display on the mobile device 110 indicating to contact the healthcare provider 130 on the patient's behalf regarding the test results. For example, the diagnostic test engine 340 provides the test results to a physician. In response to providing the test results, the diagnostic test engine 340 may receive recommendations (e.g., taking vitamins or medication) from the healthcare provider 130 and communicate the recommendations to the user.
[0079] As another example, the diagnostic test engine 340 may provide test results to pharmacies so that the pharmacies can fulfill the patient's prescription for treating the disease associated with the test results. The diagnostic test engine 340 may determine pharmacies located near the patient (e.g., within a predetermined distance, such as a threshold radius of 10 km) based on geographic information, e.g., the location where the diagnostic test was performed or the patient's address.
[0080] IV. Exemplary Data Flow Diagram FIG. 5A is a data flow diagram for performing a disease diagnostic test in a conventional system environment, according to one embodiment. As an exemplary process, in step 1, a patient 500 who wishes to complete a disease diagnostic test visits a doctor 510 at a hospital or clinic. The doctor 510 collects a biological sample from the patient 500. In step 2, the doctor 510 provides the biological sample to a central laboratory 530 with laboratory equipment and staff who use the biological sample to perform the chemical reaction portion of the disease diagnostic test. In step 3, the central laboratory 530 provides the test results of the disease diagnostic test to the doctor 510. In step 4, the doctor 510 provides the test results to the patient 500. If the patient tests positive for the disease, the test results may indicate a prescription for medication or another type of treatment. In step 5, the doctor 510 presents the prescription to the pharmacy 520. In some cases, the pharmacy 520 consults with the doctor 510 to verify or clarify the prescription. In step 6, the patient 500 visits the pharmacy 520 to ask for medication for the prescription. In step 7, the pharmacy 520 fulfills the prescription by delivering the medication to the patient 500.
[0081] FIG. 5B is a data flow diagram for performing a disease diagnostic test in a system environment including the diagnostic system 100 according to one embodiment. For the exemplary process, in step 1, a patient 500 desiring to complete a disease diagnostic test uses the diagnostic system 100 by completing the steps of the disease diagnostic test, for example, as shown in FIGS. 4A-H. Once the diagnostic system 100 determines the test result of the disease diagnostic test, the diagnostic system 100 can provide the test result to the patient 500 and the pharmacy 520 simultaneously in steps 2A and 2B. For example, as shown in FIG. 4H, the diagnostic system 100 provides the test result to display in a user interface of a mobile application. Furthermore, in some embodiments, the diagnostic system 100 can automatically provide the test result to the pharmacy 520 without requiring further input from the patient 500 (and / or the physician 510) or in response to receiving a confirmation of the test result from the patient 500. In step 3, the pharmacy 520 fills the patient's 500 prescription based on the test results, for example, the pharmacy 520 delivers the medication to the patient's 500 home or prepares the medication for the patient 500 to pick up at a nearby location.
[0082] If a doctor consultation is required, the diagnostic server 150 can consult with the doctor 510 in an automated manner without the patient needing to specify a doctor or manually facilitate such consultation. In some embodiments, one or more doctors 510 reside in the diagnostic server 150. In some embodiments, the diagnostic system 100 can also provide test results to the doctor 510, for example, in response to a request by the patient. Thus, when the patient 500 visits the doctor 510 to seek treatment for a disease, the doctor 510 can determine the appropriate treatment based on the test results.
[0083] In contrast to the conventional system environment shown in FIG. 5A, the system environment including the diagnostic system 100 shown in FIG. 5B encourages the process to require fewer steps for the patient 500 to complete a disease diagnostic test and receive appropriate medication to treat the disease if the patient 500 is analyzed as positive. By reducing the number of steps, the diagnostic system 100 allows the patient to receive treatment for the disease more quickly. Also, the system environment shown in FIG. 5B does not require a central laboratory 530 because the diagnostic system 100 allows the patient 500 to complete the chemical reaction portion of the disease diagnostic test at home using the optical property modifying device 120. This may be particularly advantageous for patients who reside far away from the nearest central laboratory 530, for example, in rural areas or developing countries.
[0084] V. Example Process Flows Figure 6 is a flow chart illustrating a process 600 for determining a test result of a disease diagnostic test, according to one embodiment. In some embodiments, process 600 is used by diagnostic system 100, such as a module of diagnostic system 100 described with reference to Figure 3, within the system environment of Figure 1. Process 600, in some embodiments, may include different or additional steps than those described in connection with Figure 6, or steps may be performed in a different order than the order described in connection with Figure 6.
[0085] In one embodiment, the image processing engine 320 receives 610 a set of images of the optical property-modifying device 120 for a nucleic acid disease diagnostic test captured by an optical sensor of the mobile device 110. In an embodiment in which the optical property-modifying device 120 includes an electronic display, the image processing engine 320 determines 620 for each image in the set whether the electronic display of the optical property-modifying device 120 is shown in the image. The image processing engine 320 selects 630 one or more images of the set determined to show the electronic display of the optical property-modifying device 120. The image analysis engine 330 determines 640 a test result for the nucleic acid disease diagnostic test based on the one or more images. The diagnostic test engine 340 provides 650 the test result for display on the mobile device 110.
[0086] In embodiments where the reaction chamber of the optical property-modifying device 120 is located on a surface of the optical property-modifying device 120, step 620 may also or alternatively include determining, for each image in the set, whether the reaction chamber of the optical property-modifying device 120 is shown in the image. Further, step 630 may also or alternatively include selecting one or more images of the set that are determined to show the reaction chamber of the optical property-modifying device 120.
[0087] VI. Alternative Embodiments Upon reading this disclosure, those skilled in the art will recognize additional structural and functional design alternatives that utilize the principles disclosed herein. Thus, while specific embodiments and applications have been illustrated and described, it is to be understood that the disclosed embodiments are not limited to the precise structure and components disclosed herein. Various modifications, changes and variations apparent to those skilled in the art may be made in the arrangement, operation and details of the methods and apparatus disclosed herein without departing from the spirit and scope as defined by the appended claims.
[0088] As used herein, any reference to "one embodiment" or "an embodiment" means that a particular element, feature, structure, or characteristic described in connection with that embodiment is included in at least one embodiment. The appearances of the phrase "in one embodiment" in various places in the specification do not necessarily all refer to the same embodiment.
[0089] Some embodiments may be described using the terms "coupled" and "connected" and their derivatives. For example, some embodiments may be described using the term "coupled" to indicate that two or more elements are in direct physical or electrical contact with each other. However, the term "coupled" may also mean that two or more elements are not in direct contact with each other, but still cooperate or interact with each other. The embodiments are not limited in this context unless expressly stated otherwise.
[0090] As used herein, "comprises," "comprising," "includes," "including," "has," "having," or any other variation thereof, is intended to cover a non-exclusive inclusion. For example, a process, method, article, or apparatus that includes a list of elements is not necessarily limited to only those elements, but may include other elements not expressly listed or inherent in such process, method, article, or apparatus. Furthermore, unless expressly stated to the contrary, "or" refers to an inclusive or, not an exclusive or. For example, a condition A or B is satisfied by any one of A being true (or present) and B being false (or absent), A being false (or absent) and B being true (or present), and both A and B being true (or present).
[0091] Additionally, the use of "a" or "an" is employed to describe elements and components of the embodiments described herein. This is done merely for convenience and to give a general gist of the invention. The specification should be read to include one or at least one, and the singular includes the plural unless it is clear that otherwise is meant.
[0092] Portions of this specification describe embodiments of the invention in terms of algorithms and symbolic representations of operations on information. These algorithmic descriptions and representations are commonly used by those skilled in the data processing arts to effectively convey the substance of their work to others skilled in the art. While these operations are described functionally, computationally, or logically, they are understood to be implemented by computer programs or equivalent electrical circuits, microcode, or the like. Further, without loss of generality, it may prove convenient to refer to configurations of these operations as modules. The described operations and their associated modules may be embodied in software, firmware, hardware, or any combination thereof.
[0093] Any of the steps, operations, or processes described herein may be performed or implemented using one or more hardware or software modules, alone or in combination with other devices. In one embodiment, a software module is implemented in a computer program product that includes a computer-readable non-transitory medium containing computer program code, which may be executed by a computer processor to perform any or all of the steps, operations, or processes described.
[0094] Embodiments of the invention may also relate to products produced by the computing processes described herein. Such products may include information resulting from the computing processes where the information is stored on a non-transitory, tangible, computer-readable storage medium, and may include any of the embodiments of the computer program products or other data combinations described herein.
Claims
1. 1. An optical property-modifying device configured to perform a nucleic acid-based diagnostic test, comprising: an interface configured to receive a biological sample; a plurality of reaction chambers configured to carry out a reaction between the biological sample and at least an optical property-modifying reagent; and The optical property-modifying device comprising an electronic display configured to present a result of the nucleic acid-based diagnostic test based on the reaction between the biological sample and at least the optical property-modifying reagent.
2. 2. The optical property modifying device of claim 1, wherein the electronic display is a liquid crystal display.
3. 10. The device of claim 1, wherein the electronic display is an organic light emitting diode display.
4. 10. The optical property modifying device of claim 1, wherein the electronic display is an electronic paper display.
5. 10. The optical property-modifying device of claim 1, wherein the electronic display comprises one or more light emitting diodes.
6. 1. A method for determining the result of a diagnostic test, comprising the steps of: receiving one or more images of an optical property-modifying device configured to perform a diagnostic test; the one or more images are captured by an optical sensor of a mobile device; said optical property modifying device comprising: a plurality of reaction chambers configured to carry out a reaction between the biological sample and at least an optical property-modifying reagent; and providing an electronic display configured to present an indication of a result of the diagnostic test based on the reaction between the biological sample and at least the optical property-modifying reagent; determining that an image of the one or more images depicts the electronic display of the optical property-modifying device, the electronic display displaying the indication of the results of the diagnostic test; determining the result of the diagnostic test based at least in part on the representation of the image displayed by the electronic display; and Providing the determined results of the diagnostic test to the mobile device for presentation by the mobile device.
7. The method of claim 6 , wherein the display of the results of the diagnostic test comprises the results of the diagnostic test presented as one or more of human readable symbols and machine readable symbols.
8. determining the result of the diagnostic test based at least in part on the representation of the image displayed by the electronic display; 8. The method of claim 6, further comprising performing at least one of optical pattern matching, optical template matching, and optical character recognition on the representation of the image displayed by the electronic display to determine the result of the diagnostic test.
9. receiving a geographic location of the mobile device from a location sensor of the mobile device; and The method of any one of claims 6 to 8, further comprising storing the geographic location and a timestamp of the geographic location together with the determined result of the diagnostic test.
10. 10. The method of claim 9, wherein determining the result of the diagnostic test is further based on at least one of the geographic location and the timestamp.
11. 11. The method of any one of claims 9 to 10, further comprising providing the results of the diagnostic test, the geographic location, and the timestamp to a third party system that contains epidemiological data based on aggregated diagnostic test results from multiple mobile devices associated with a population of patients.
12. 1. An optical property-modifying device configured to perform a nucleic acid-based diagnostic test, comprising: below: an interface configured to receive a biological sample; and The optical property-modifying device comprises a plurality of reaction chambers configured to carry out a reaction between the biological sample and at least the optical property-modifying reagent, the plurality of reaction chambers being arranged on a surface of the optical property-modifying device such that at least one of a geometric pattern formed by the layout of the plurality of reaction chambers and a color of the reaction between the biological sample and at least the optical property-modifying reagent in the plurality of reaction chambers is visible from a point outside the optical property-modifying device.
13. 1. A method for determining the result of a diagnostic test, comprising the steps of: receiving one or more images of an optical property-modifying device configured to perform a diagnostic test; the one or more images are captured by an optical sensor of a mobile device; said optical property modifying device comprising: the receiving step comprising a plurality of reaction chambers arranged on a surface of the optical property-modifying device, the reaction chambers being configured to carry out a reaction between the biological sample and at least an optical property-modifying reagent; determining that an image of the one or more images depicts at least one of a known geometric characteristic and a known color characteristic associated with the optical property-modifying device; determining the result of the diagnostic test based at least in part on the at least one of the known geometric characteristics and the known color characteristics of the image; and Providing the determined results of the diagnostic test to the mobile device for presentation by the mobile device.
14. the known geometric characteristic comprises a geometric pattern formed by a layout of the plurality of reaction chambers in the optical characteristic-modifying device; The method of claim 13 , wherein the known color characteristics include a color of the reaction between the biological sample and at least the optical property-modifying reagent in the plurality of reaction chambers.
15. identifying a position of each reaction chamber of the plurality of reaction chambers in the image based on the geometric pattern formed by a layout of the plurality of reaction chambers depicted in the image; determining the color of the reaction between the biological sample and at least the optical property-modifying reagent at the identified location of each reaction chamber of the plurality of reaction chambers in the image; and 15. The method of claim 14, further comprising determining the result of the diagnostic test based at least in part on the determined color of the image at the identified location of each reaction chamber in the image.
16. receiving a geographic location of the mobile device from a location sensor of the mobile device; and The method of any one of claims 13 to 15, further comprising storing the geographic location and a timestamp of the geographic location together with the determined result of the diagnostic test.
17. 17. The method of claim 16, wherein determining the result of the diagnostic test is further based on at least one of the geographic location and the timestamp.
18. 18. The method of any one of claims 16-17, further comprising providing the results of the diagnostic test, the geographic location, and the timestamp to a third party system that contains epidemiological data based on aggregated diagnostic test results from multiple mobile devices associated with a population of patients.
19. 1. A computer program product comprising: When executed by a processor, the processor: receiving one or more images of an optical property-modifying device configured to perform a diagnostic test; the one or more images are captured by an optical sensor of a mobile device; said optical property modifying device comprising: a plurality of reaction chambers configured to carry out a reaction between the biological sample and at least an optical property-modifying reagent; and providing an electronic display configured to present an indication of a result of the diagnostic test based on the reaction between the biological sample and at least the optical property-modifying reagent; determining that an image of the one or more images depicts the electronic display of the optical property-modifying device, the electronic display displaying the indication of the results of the diagnostic test; determining the result of the diagnostic test based at least in part on the representation of the image displayed by the electronic display; and providing the determined results of the diagnostic test to the mobile device for presentation by the mobile device. a non-transitory computer-readable storage medium having encoded thereon instructions to cause the computer program product to
20. 20. The computer program product of claim 19, wherein the display of the results of the diagnostic test comprises the results of the diagnostic test presented as one or more of human readable symbols and machine readable symbols.
21. instructions for determining the result of the diagnostic test based at least in part on the representation of the image displayed by the electronic display; 21. The computer program product of claim 19, further comprising instructions for performing at least one of optical pattern matching, optical template matching, and optical character recognition on the representation of the image displayed by the electronic display to determine the result of the diagnostic test.
22. The non-transitory computer readable storage medium comprises: When executed by the processor, the processor: receiving a geographic location of the mobile device from a location sensor of the mobile device; and storing the geographic location and a timestamp of the geographic location along with the determined result of the diagnostic test. A computer program product according to any one of claims 19 to 21, comprising the further instructions to:
23. 23. The computer program product of claim 22, wherein the instructions for determining the result of the diagnostic test are further based on at least one of the geographic location and the time stamp.
24. The non-transitory computer readable storage medium comprises: When executed by the processor, the processor: providing the results of the diagnostic test, the geographic location, and the time stamp to a third party system that includes epidemiological data based on aggregated diagnostic test results from a plurality of mobile devices associated with a patient population. A computer program product according to any one of claims 22 to 23, comprising further instructions to:
25. 1. A computer program product comprising: When executed by a processor, the processor: receiving one or more images of an optical property-modifying device configured to perform a diagnostic test; the one or more images are captured by an optical sensor of a mobile device; said optical property modifying device comprising: a plurality of reaction chambers arranged on a surface of the optical property-modifying device, the plurality of reaction chambers being configured to carry out a reaction between a biological sample and at least an optical property-modifying reagent; said receiving comprising: determining that an image of the one or more images depicts at least one of a known geometric characteristic and a known color characteristic associated with the optical property-modifying device; determining the result of the diagnostic test based at least in part on the at least one of the known geometric characteristics and the known color characteristics of the image; and providing the determined results of the diagnostic test to the mobile device for presentation by the mobile device. An encoded instruction that causes The computer program product comprising a non-transitory computer-readable storage medium having:
26. the known geometric characteristic comprises a geometric pattern formed by a layout of the plurality of reaction chambers in the optical characteristic-modifying device; 26. The computer program product of claim 25, wherein the known color characteristics comprise a color of the reaction between the biological sample and at least the optical property-modifying reagent in the plurality of reaction chambers.
27. The non-transitory computer readable storage medium comprises: When executed by the processor, the processor: identifying a position of each reaction chamber of the plurality of reaction chambers in the image based on the geometric pattern formed by a layout of the plurality of reaction chambers depicted in the image; determining the color of the reaction between the biological sample and at least the optical property-modifying reagent at the identified location of each reaction chamber of the plurality of reaction chambers in the image; and determining the result of the diagnostic test based at least in part on the determined color of the image at the identified location of each reaction chamber in the image.
27. The computer program product of claim 26, further comprising instructions to:
28. The non-transitory computer readable storage medium comprises: When executed by the processor, the processor: receiving a geographic location of the mobile device from a location sensor of the mobile device; and storing the geographic location and a timestamp of the geographic location along with the determined result of the diagnostic test. A computer program product according to any one of claims 25 to 27, comprising the further instructions to:
29. 30. The computer program product of claim 28, wherein the instructions for determining the result of the diagnostic test are further based on at least one of the geographic location and the time stamp.
30. The non-transitory computer readable storage medium comprises: When executed by the processor, the processor: providing the results of the diagnostic test, the geographic location, and the time stamp to a third party system that includes epidemiological data based on aggregated diagnostic test results from a plurality of mobile devices associated with a patient population. A computer program product according to any one of claims 28 to 29, comprising the further instructions to:
Citation Information
Patent Citations
Polymerase chain reaction DNA amplification and detection method
JP2007089591A
Portable rapid diagnostic test reader
JP2015510118A
Methods and systems for microfluidic imaging and analysis
JP2016500002A
Coloration reaction detection system, coloration reaction detection method and program
JP2017125840A
