Information processing method and information processing system

Abstract

In an information processing method according to the present invention, an information processing system comprises a test piece, a first device, and a second device communicably connected to the first device, and processes information pertaining to an inspection using the test piece. The test piece is colored with a color according to whether an inspection target is included. The first device captures a digital image including a colored region and individual identification information assigned to the test piece and transmits the digital image to the second device. The second device determines whether the presence of the object to be inspected is shown and stores the digital image in association with the individual identification information.

Description

Technical Field

[0001] The present invention relates to an information processing method and an information processing system. This application claims priority to Japanese Patent Application No. 2021-100752 filed in Japan on June 17, 2021, Japanese Patent Application No. 2021-125242 filed in Japan on July 30, 2021, and Japanese Patent Application No. 2021-193353 filed in Japan on November 29, 2021, and incorporates the contents thereof herein.

Background Art

[0002] Due to remarkable progress in medicine, excellent therapeutic drugs and advanced medical technologies have been developed. However, due to various factors such as diet and living environment, humans are always in close proximity to a variety of diseases such as cancer, autoimmune diseases, infectious diseases, or cardiovascular diseases. In particular, regarding infectious diseases, the active movement of people and goods has caused epidemics not only within a country but also on a global scale, having a great impact on social and economic activities. Therefore, it is required to quickly contain infectious diseases.

[0003] The memory of the novel coronavirus is still fresh. When a new infectious disease that has never been experienced before spreads, it is difficult to take comprehensive and integrated measures for prevention, treatment, and prevention of spread, and it becomes extremely difficult to suppress the increase in the number of infected people. As a preventive measure against infection, vaccination is effective, but for new infectious diseases, it is necessary to start with vaccine development, which takes time. Also, regarding therapeutic drugs for infectious diseases, it is assumed that it takes time for development and confirmation of effectiveness.

[0004] Therefore, measures to prevent the spread at the initial stage of infection are extremely important. For example, regarding the novel coronavirus, as the number of infected people increases, the response at medical institutions becomes strained and the burden on medical staff increases. As a result, it may become difficult to treat patients with infectious diseases and other diseases. Therefore, it is required to take reliable measures to prevent the spread, suppress the increase in the number of patients, and reduce the time that medical staff are restricted to treating infectious disease patients.

[0005] In order for healthcare facilities to treat patients, an examination and diagnosis are necessary first. However, in the case of patients suspected of having a new infectious disease, preparation time tends to increase, as healthcare workers need to wear personal protective equipment (PPE) to prevent infection themselves. This increased preparation time tends to increase the burden on healthcare facilities during face-to-face examinations and diagnoses. In light of this situation, deregulation of telemedicine is progressing, and efforts are being made to further reduce the burden on healthcare workers.

[0006] However, telemedicine still has its problems. For example, while clinical diagnostic reagents can be used to determine whether or not someone is infected, in the case of telemedicine, it is difficult for healthcare workers to directly perform tests using clinical diagnostic reagents on patients. One possible solution is to mail patient samples to specialized medical institutions for accurate clinical testing. However, because of the time required for logistics, it takes time for test results to be obtained, making rapid diagnosis impossible.

[0007] Prior art has been disclosed in which, for example, a patient uses a dedicated testing device to test whether they carry a pathogen (see, for example, Patent Document 1). In addition, a method that allows for relatively simple testing is known, which involves test strips (test pieces) and an immunochromatography apparatus (see, for example, Patent Document 2).

[0008] Furthermore, from the perspective of preventing the spread of infectious diseases while maintaining social activities, there is a movement to require the presentation of information proving that the person is not infected with an infectious disease at the entrance of event venues and other locations. For example, Patent Document 3 discloses a technology that stores the results of multiple test items in a database in association with user identification information, and outputs information about the test results read from the database.

[0009] Furthermore, there are systems that perform tests using images captured by the user (for example, Patent Document 4). In such systems, the user supplies a sample (e.g., saliva) to a test strip to perform the test. The test strip changes color depending on whether or not the supplied sample contains the target substance, such as a virus. The user then transmits an image of the tested test strip to a remote server using a smartphone or similar device. The server determines whether or not the sample contains the target substance by processing the received image. [Prior art documents] [Patent Documents]

[0010] [Patent Document 1] Japanese Patent Application Publication No. 2020-080083 [Patent Document 2] Japanese Patent Publication No. 2009-133813 [Patent Document 3] Japanese Patent Publication No. 2021-7000 [Patent Document 4] Japan Special Publication No. 2019-520548 [Overview of the project] [Problems that the invention aims to solve]

[0011] The technologies disclosed in the above-mentioned Patent Documents 1 to 4 are intended to curb the increase in the number of patients and reduce the time healthcare workers are required to deal with infectious disease patients. However, the above systems have room for improvement in the following respects, as they may cause inconvenience to users. In other words, the systems described in Patent Documents 1 and 2 require the preparation of dedicated testing equipment, making their application to telemedicine impractical. This is because it is unlikely that the general public would possess such dedicated testing equipment. Even if they did, properly managing and operating complex testing equipment not intended for general use requires specialized knowledge and effort. Therefore, there are obstacles to making testing using dedicated testing equipment widely available to the general public. Furthermore, in clinical testing, the determination of whether or not an infection is present based on the test results must be made using reliable methods, not based on the patient's own self-assessment. Therefore, it is desirable that the results of tests, such as whether or not an infection is present, be shared with doctors and other medical professionals more quickly and easily. In other words, it is necessary to determine the presence or absence of infection using more reliable methods, to secure hospital beds and medical systems, and to ensure that freedom of social and economic activities is not restricted. On the other hand, the results of determining whether or not an infection is present are highly confidential information. Therefore, how to conceal such highly confidential information is a crucial consideration.

[0012] Furthermore, in Patent Document 3, user identification information and test results are associated and stored in a database. Therefore, there is a problem in that information such as who tested positive could be leaked from this database, and it cannot necessarily be said to be highly secure. In other words, if personal information is leaked, it could cause problems for users.

[0013] Furthermore, Patent Document 4 states that the environment in which users take images (imaging environment) varies. For example, imaging is performed in environments where the color resolution of each user's imaging device, the illumination device that illuminates the subject (test strip), and the relative positional relationship between the subject, the illumination device, and the imaging device differ for each user. Verification conducted by the inventors revealed that even if images of the same subject are captured, different imaging environments may result in different judgment results. It is desirable that the same judgment result be obtained even if the images of the same subject are captured in different imaging environments. In other words, if images of the same subject do not yield the same judgment result, the accuracy of the judgment result will be low, which may cause inconvenience to the user. From this, the inventors identified a challenge: when performing inspections using images captured by users, it is necessary to establish a method for accurately determining the same subject even if the images are captured in different imaging environments, as long as the images depict the same subject.

[0014] This invention has been made in view of the above circumstances, and aims to provide an information processing method and an information processing system that can perform inspections using highly reliable methods in a manner that makes it difficult for highly confidential information to be leaked. Furthermore, the objective is to provide an information processing system and information processing method that can enhance data security when using data related to inspections. Furthermore, the objective is to provide an information processing method and information processing system that can accurately determine images captured under various imaging conditions when making judgments using images captured by the user. [Means for solving the problem]

[0015] The present invention relates to an information processing method, comprising a test piece, a first device, and a second device communicatively connected to the first device, wherein the information processing system performs information relating to an inspection using the test piece, wherein the test piece is assigned individual identification information for identifying the individual test piece, and the test piece exhibits a color depending on whether or not the biological sample contains an object to be inspected when a biological sample taken from an inspected person is supplied to the test piece, and the first device processes the colored region of the test piece in the state in which the color has been exhibited, at least The system includes: an imaging step of capturing a digital image; a first communication step of the first device transmitting the digital image and the individual identification information to a second device that is communicably connected to the first device; a determination step of the second device determining, based on the digital image received from the first device and determination criterion information for determining the presence or absence of the object to be inspected, whether or not the color information indicating the color in the digital image indicates the presence of the object to be inspected; and a storage control step of the second device storing the digital image received from the first device in association with the individual identification information.

[0016] The present invention provides an information processing system comprising a test piece, a first device, and a second device communicateable with the first device, for processing information relating to an inspection using the test piece, wherein the test piece has a color-producing unit that produces a color corresponding to whether or not an object to be inspected is included in the biological sample when a biological sample taken from a person to be inspected is supplied to the test piece, and the test piece is assigned individual identification information for identifying the individual test piece, the first device has an imaging unit that captures a digital image including at least the color-producing region of the test piece in the color-producing state, and a first communication unit that transmits the digital image and the individual identification information to an information processing server, the second device has a determination unit that determines whether or not the color information showing the color in the digital image indicates the presence of the object to be inspected, based on the digital image received from the first device and determination criterion information for determining the presence or absence of the object to be inspected, and a storage control unit that stores the digital image received from the first device in association with the individual identification information.

[0017] The present invention provides an information processing system comprising an inspection terminal, a user terminal, and an information processing server, which processes information relating to an inspection using a test piece to determine whether or not a biological sample contains an object to be inspected. The inspection terminal includes a first acquisition unit that acquires individual identification information for identifying an individual test piece used in the inspection of a person to be inspected, and inspection information indicating the inspection results of the person to be inspected, and a registration unit that transmits the individual identification information and the inspection information acquired by the first acquisition unit to the information processing server. The user terminal includes a second acquisition unit that acquires individual identification information for the test piece used in the inspection of the person to be inspected, and user information relating to the person to be inspected, and a user registration unit that transmits the individual identification information and the user information acquired by the second acquisition unit to the information processing server. The information processing server includes a registration control unit that stores information relating the inspection information to the individual identification information in an inspection result database based on information received from the inspection terminal, and stores information relating the user information to the individual identification information in a user database based on information received from the user terminal.

[0018] The present invention relates to an information processing system comprising an inspection terminal, a user terminal, and an information processing server, which processes information relating to an inspection using a test piece to determine whether or not a biological sample contains an object to be inspected. The inspection terminal acquires individual identification information that identifies the individual test piece used in the inspection of the person to be inspected, and inspection information that indicates the inspection result of the person to be inspected, and transmits the acquired individual identification information and the inspection information to the information processing server. The user terminal acquires individual identification information of the test piece used in the inspection of the person to be inspected, and user information relating to the person to be inspected, and transmits the acquired individual identification information and the user information to the information processing server. The information processing server stores information that associates the inspection information with the individual identification information in an inspection result database based on the information received from the inspection terminal, and stores information that associates the user information with the individual identification information in a user database based on the information received from the user terminal.

[0019] The information processing method of the present invention is an information processing method performed by an information processing system that processes information related to an inspection using a test piece that exhibits a color according to whether or not a test object is included in a specimen. An imaging unit images the test piece, which is a subject, so as to include a color development region in which the color in the test piece is developed. A determination unit determines, using a determination model, whether or not a positive indicating that the color development region has the test object is shown in the image captured by the imaging unit. The determination model performs machine learning using a learning data set in which a learning image captured so as to include the color development region in an unspecified test piece is labeled with a symbol indicating whether or not the positive is shown in the color development region in the learning image, thereby learning the correspondence between the image and the positive, estimates the degree to which the positive is shown in the input image based on the correspondence, and is a learned model that outputs the estimated result. The learning image includes a plurality of images of the same subject captured in different imaging environments.

[0020] The information processing system of the present invention is an information processing system that processes information related to an inspection using a test piece that exhibits a color according to whether or not a test object is included in a specimen. The information processing system includes an imaging unit that images the test piece, which is a subject, so as to include a color development region in which the color in the test piece is developed, and a determination unit that determines, using a determination model, whether or not a positive indicating that the color development region has the test object is shown in the image captured by the imaging unit. The determination model performs machine learning using a learning data set in which a learning image captured so as to include the color development region in an unspecified test piece is labeled with a symbol indicating whether or not the positive is shown in the color development region in the learning image, thereby learning the correspondence between the image and the positive, estimates the degree to which the positive is shown in the input image based on the correspondence, and is a learned model that outputs the estimated result. The learning image includes a plurality of images of the same subject captured in different imaging environments.

Advantages of the Invention

[0021] According to the present invention, an inspection using a highly reliable method can be performed in a manner that makes it difficult for highly confidential information to leak.

[0022] Furthermore, according to the present invention, the security of data when using inspection results can be enhanced. In particular, the inspected person who has undergone the inspection and the inspection results thereof are stored in separate databases. Thereby, it is possible to prevent the inspection results from being easily associated with an individual, and it is possible to protect the privacy of the inspected person.

[0023] Furthermore, according to the present invention, when making a determination using an image captured by a user, images captured in various imaging environments can be accurately determined.

Brief Description of the Drawings

[0024] [Figure 1] It is a block diagram showing a configuration example of an information processing system according to an embodiment. [Figure 2] It is a diagram showing an example of a test strip according to an embodiment. [Figure 3] It is a block diagram showing a configuration example of a user terminal according to an embodiment. [Figure 4] It is a block diagram showing a configuration example of an information processing server according to an embodiment. [Figure 5] It is a block diagram showing a configuration example of an institution server according to an embodiment. [Figure 6] It is a diagram showing an example of individual information according to an embodiment. [Figure 7] It is a diagram showing an example of inspected person information according to an embodiment. [Figure 8] It is a diagram showing an example of inspection result information according to an embodiment. [Figure 9] It is a sequence diagram showing the flow of processing performed by the information processing system according to an embodiment. [Figure 10] It is a sequence diagram showing the flow of processing performed by the information processing system according to Modification 1 of the embodiment. [Figure 11]This is a sequence diagram showing the processing flow performed by the information processing system according to the modified embodiment 2. [Figure 12] This is a block diagram showing an example configuration of an information processing system according to an embodiment. [Figure 13] This is a sequence diagram showing the processing flow performed by the information processing system according to the embodiment. [Figure 14] This is a sequence diagram showing the processing flow performed by the information processing system according to the embodiment. [Figure 15] This figure shows an example of a test strip according to the embodiment. [Figure 16] This is a block diagram showing an example configuration of an inspection terminal according to an embodiment. [Figure 17] This block diagram shows an example configuration of an information processing server according to an embodiment. [Figure 18] This block diagram shows an example configuration of a user terminal according to the embodiment. [Figure 19] This is a block diagram showing an example configuration of an event venue terminal according to an embodiment. [Figure 20] This figure shows an example of an inspection according to the embodiment. [Figure 21] This figure shows an example of the test results according to the embodiment. [Figure 22] This figure shows an example of a user according to the embodiment. [Figure 23] This figure shows an example of an input condition information unit according to an embodiment. [Figure 24] This diagram illustrates the processing performed by the inspection terminal according to the embodiment. [Figure 25] This diagram illustrates the processing performed by the inspection terminal according to the embodiment. [Figure 26] This diagram illustrates the processing performed by the inspection terminal according to the embodiment. [Figure 27] This diagram illustrates the processing performed by the inspection terminal according to the embodiment. [Figure 28] This diagram illustrates the processing performed by the inspection terminal according to the embodiment. [Figure 29] This diagram illustrates the processing performed by the inspection terminal according to the embodiment. [Figure 30] This diagram illustrates the processing performed by the inspection terminal according to the embodiment. [Figure 31] This diagram illustrates the processing performed by the user terminal according to the embodiment. [Figure 32] This diagram illustrates the processing performed by the user terminal according to the embodiment. [Figure 33] This diagram illustrates the processing performed by the user terminal according to the embodiment. [Figure 34] This diagram illustrates the processing performed by the user terminal according to the embodiment. [Figure 35] This diagram illustrates the processing performed by the user terminal according to the embodiment. [Figure 36] This is a block diagram showing an example configuration of an information processing system according to an embodiment. [Figure 37] This figure shows an example of a test strip according to the embodiment. [Figure 38] This block diagram shows an example configuration of a user terminal according to the embodiment. [Figure 39] This block diagram shows an example configuration of an information processing server according to an embodiment. [Figure 40] This is a sequence diagram showing the processing flow performed by the information processing system according to the embodiment. [Figure 41] This is a sequence diagram showing the processing flow performed by the information processing system according to the modified embodiment 1. [Figure 42] This is a sequence diagram showing the processing flow performed by the information processing system according to the modified embodiment 2. [Figure 43] This is a sequence diagram showing the processing flow performed by the information processing system according to the modified embodiment 3. [Figure 44] This is a sequence diagram showing the processing flow performed by the information processing system according to the modified embodiment 4. [Modes for carrying out the invention]

[0025] Embodiments of the present invention will be described below with reference to the drawings.

[0026] (Regarding Information Processing System 1) Figure 1 is a block diagram showing an example configuration of an information processing system 1 according to an embodiment. The information processing system 1 includes, for example, a test strip 100, a user terminal 10, an information processing server 20, and an institutional server 30. The user terminal 10 and the information processing server 20 are connected via a communication network NW. The information processing server 20 and the institutional server 30 are connected via a dedicated line or a general-purpose line.

[0027] Communication networks (NW), dedicated lines, or general-purpose lines may utilize LANs (Local Area Networks), WANs (Wide Area Networks), telephone networks (mobile phone networks, fixed-line telephone networks, etc.), regional IP (Internet Protocol) networks, the Internet, etc., for the exchange of information.

[0028] In the information processing system 1 of this embodiment, an examination is performed by the person being examined using a test strip 100. For example, the examination is performed by dropping the person being examined's biological sample (mucus, etc.) onto the supply unit 104 (see Figure 2) of the test strip 100. The test strip 100 is configured such that, for example, if the biological sample contains a target substance (a specific virus, etc.), a line of a specific color appears on the color-developing unit 103 (see Figure 2). The person being examined takes an image of the test strip 100 after the examination. The user terminal 10 transmits the image of the test strip 100 after the examination (referred to as the examination image G) to the information processing server 20. The information processing server 20 determines whether the test strip 100 indicates that the biological sample contains a target substance by performing an image analysis of the examination image G. The information processing server 20 notifies the user terminal 10 of the determination result. The determination of whether or not the biological sample contains a target substance may be performed quantitatively.

[0029] In the information processing system 1, the judgment results from the information processing server 20 may be applied to telemedicine through systems other than this system. For example, the information processing server 20 may transmit the examination image G and the judgment results to the institutional server 30.

[0030] For example, if the institutional server 30 is a server of a medical institution, the information processing server 20 sends the examination image G and the judgment result to the institutional server 30 when the person being examined wishes to be diagnosed by a doctor, or when a doctor requests the examination image G of the person being examined. In this case, the institutional server 30 displays the received examination image G and judgment result, enabling the doctor to perform the diagnosis. The doctor views the displayed image, performs the diagnosis, and inputs the diagnosis result to the institutional server 30. In this case, for example, the institutional server 30 notifies the information processing server 20 of the diagnosis result. The information processing server 20 notifies the user terminal 10 of the judgment result along with the diagnosis result. Alternatively, the institutional server 30 may directly notify the user terminal 10 of the diagnosis result. In this case, the information processing server 20 sends the examination image G and judgment result to the institutional server 30, but does not receive the diagnosis result from the institutional server 30.

[0031] (Regarding test strip 100) Test strip 100 is a test piece that is a component of a clinical diagnostic reagent. Clinical diagnostic reagents are used to test for the presence or absence of disease, and for example, lateral flow assays (lateral flow method) and ELISPOT method are used to test for the presence or absence of a substance for diagnosing the presence or absence of disease. Lateral flow assays to which immunoassays are applied are sometimes specifically called immunochromatography.

[0032] Figure 2 shows an example of a test strip 100 according to an embodiment. Figure 2 shows an example of a test strip used in a lateral flow assay. The test strip 100 comprises, for example, a name tag 101, a two-dimensional code 102, a color-developing section 103, and a supply section 104.

[0033] The name tag 101 is a field where the name of the person being tested is written. When mass testing is conducted in a hospital or other facility, the name tag 101 is either written with a pen by a medical professional such as a nurse or laboratory technician, or a sticker with the name of the person being tested printed on it is attached. This clarifies which person's body the test strip 100 was used to test, reducing the risk of mix-ups in mass testing.

[0034] The two-dimensional code 102 is a two-dimensional code image into which the individual identification information IDA of the test strip 100 is embedded. The two-dimensional code is, for example, a QR code (registered trademark) or a barcode. The individual identification information IDA is information that uniquely identifies the test strip 100, and for example, it is information that indicates the serial number of the test strip 100.

[0035] In this embodiment, the subject of the test performs the test using the test strip 100, and an image of the test strip 100 after the test (hereinafter referred to as the test image G) is transmitted to the information processing server 20. In this embodiment, from the viewpoint of protecting the subject of the test's personal information, the test image G is an image in which the subject's name, etc., is not written on the name tag 101. Instead, individual identification information IDA embedded in the two-dimensional code 102 is used to manage the test strip 100 so that it does not get mixed up. The method of managing the test strip 100 using individual identification information IDA will be explained in detail later.

[0036] The color-developing section 103 is the area where the result of the color reaction in the test strip 100 is displayed. The color reaction is a chemical reaction that changes color or develops color when the biological sample contains the substance to be tested. The color-developing section 103 includes, for example, a control line 1030 and a test line 1031. The control line 1030 is the area where a line appears when the biological sample supplied to the supply unit 104 (described later) moves normally to the color-developing section 103. The test line 1031 is the area where a line appears when the biological sample contains the target virus, antibody, etc. (substance to be tested).

[0037] The supply unit 104 is the area to which the biological sample is supplied. The supply unit 104 includes, for example, a biological sample supply window 1040. For example, the biological sample of the person being tested is added to the biological sample supply window 1040, thereby supplying the biological sample to the supply unit 104.

[0038] Furthermore, the clinical diagnostic reagent may include a specimen collection jig, extraction solution, detection reagent, correction index, etc., for collecting specimens.

[0039] (Regarding biological samples) In this embodiment, the biological sample is a specimen collected from the person being tested, such as mucus collected by swabbing the throat with a cotton swab. The biological sample is preferably a liquid and may include, for example, peripheral blood, serum, plasma, ascites, urine, cerebrospinal fluid, sputum, saliva, bone marrow, synovial fluid, aqueous humor, amniotic fluid, earwax, breast milk, bronchoalveolar lavage fluid, semen, prostatic fluid, Cowper's fluid or preejaculatory fluid, sweat, feces, hair, tears, cystic fluid, pleural fluid or ascites, pericardial fluid, lymph fluid, erosion, chyle, bile, interstitial fluid, menstrual secretions, pus, sebum, vomit, vaginal secretions, mucosal secretions, watery stool, pancreatic juice, nasal secretions, pharyngeal secretions, nasal swab fluid, pharyngeal swab fluid, nasal lavage fluid, bronchopulmonary aspirate, blastocyst fluid, umbilical cord blood, etc., and may contain substances that serve as indicators for diagnosing diseases.

[0040] (Regarding the objects to be inspected) In this embodiment, the object to be tested is a substance that is tested for with a clinical diagnostic reagent. For example, the object to be tested may be a single substance (object) or a complex of such substances (objects), such as cells, bacteria, viruses, exosomes, nucleic acids, polypeptides (including antigens and antibodies), polynucleotides, lipids, phospholipids, carbohydrates, polysaccharides, glycoproteins, low molecular weight compounds, metabolites from cells or bacteria, and fragments of bacteria or viruses, exosomes, etc.

[0041] (Regarding individual identification information (IDA)) In this embodiment, the individual identification information IDA is information that can uniquely identify at least the test strip 100. For example, the individual identification information IDA is information that indicates the manufacturing number (serial number), etc. In addition to the individual identification information IDA, the two-dimensional code 102 may also include information that describes the test strip 100 ("test piece description information"). Information that describes the test strip 100 is, for example, information that indicates the manufacturer, the object to be tested, the disease corresponding to the object to be tested, and the items of that disease.

[0042] (Regarding the disease) This refers to diseases, and typical classifications include cancer, hypertension, diabetes, heart disease, cerebrovascular disease, neuropsychiatric disorders, immune and allergic diseases, and infectious diseases.

[0043] (Regarding the disease section) The disease categories further subdivide the above-mentioned diseases, including their causes, metabolites, and phenomena. For example, the disease categories include coronavirus, influenza, adenovirus, RSV, rotavirus, hepatitis B virus, hepatitis C virus, HIV, herpesvirus, norovirus, human metapneumovirus, group A beta-hemolytic streptococcus, Helicobacter pylori, Treponema pallidum, Mycoplasma, Clostridium difficile, Mycobacterium, E. coli O157, E. coli verotoxin, Streptococcus pneumoniae, Legionella, procalcitonin, Chlamydia, Neisseria gonorrhoeae, allergic conjunctivitis, luteinizing hormone (LH), human chorionic gonadotropin (HCG), BNP, NT-proBNP, CK-MB, myoglobin, troponin, D-dimer, H-FABP, granulocyte elastase, carcinoembryonic antigen (CEA), fecal occult blood, insulin-like growth factor binding protein, fFN, allergy tests, CRP, anti-CCP antibody, etc.

[0044] (Regarding user terminal 10) The user terminal 10 is a computer device belonging to the person being examined (user) and is operated by the user. The user may be a patient in telemedicine. The user terminal 10 can be implemented as, for example, a smartphone, tablet, mobile phone, or PC (Personal Computer). The user terminal 10 has, for example, a telemedicine application program (hereinafter referred to as the telemedicine app) installed on it. The telemedicine app is a program that enables telemedicine by the information processing system 1.

[0045] It goes without saying that functionality equivalent to a telemedicine application can also be implemented using a web browser. In this case, the user terminal 10 accesses a site identified by a predetermined URL (Uniform Resource Locator) or the like via a web browser. Then, operations related to telemedicine are performed according to the instructions on the screen provided by the accessed site.

[0046] Figure 3 is a block diagram showing an example configuration of a user terminal 10 according to an embodiment. The user terminal 10 includes, for example, a communication unit 11, a storage unit 12, a control unit 13, a display unit 14, an input unit 15, and an imaging unit 16. The communication unit 11 communicates with the information processing server 20.

[0047] The storage unit 12 is composed of storage media such as an HDD (Hard Disk Drive), flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), RAM (Random Access read / write Memory), ROM (Read Only Memory), or a combination thereof. The storage unit 12 stores programs for executing various processes of the user terminal 10 (for example, programs related to telemedicine applications), and temporary data used when performing various processes.

[0048] The display unit 14 includes, for example, a display device such as a liquid crystal display, and displays an image in accordance with the control of the control unit 13. The input unit 15 includes, for example, an input device such as a mouse or keyboard, and outputs information operated by a user such as a person being examined to the control unit 13. The imaging unit 16 includes, for example, an imaging device such as a digital camera, and performs imaging in accordance with the control of the control unit 13.

[0049] The control unit 13 is implemented by causing the CPU (Central Processing Unit) provided as hardware in the user terminal 10 to execute a program. The control unit 13 comprehensively controls the user terminal 10. For example, the control unit 13 controls the display unit 14 and the imaging unit 16 according to the program related to the telemedicine application.

[0050] The control unit 13 executes processing according to the program of the telemedicine application. For example, in response to user input operations such as those of the person being examined, the control unit 13 launches the telemedicine application when the icon of the telemedicine application is tapped. As a result, for example, the operation screen of the telemedicine application is displayed on the display unit 14. The operation screen displays several operation buttons, such as "Capture examination image G" and "Enter account information". If the user taps "Capture examination image G", the control unit 13 launches the imaging unit 16 and displays the imaging screen for capturing examination image G.

[0051] The control unit 13 includes, for example, an imaging control unit 130. The imaging control unit 130 controls the imaging process when acquiring an inspection image G. Specifically, the imaging control unit 130 displays an image to support the imaging process when the inspection image G is being acquired. For example, the imaging control unit 130 displays a guide on the display unit 14 that shows the outline of the test strip 100. This ensures that the orientation and size of the test strip 100 in the inspection image G are consistent, enabling the information processing server 20 to perform image analysis with high accuracy.

[0052] Furthermore, the imaging control unit 130 may determine whether or not there is an obstacle in the field of view when attempting to image the test strip 100. An obstacle is an object between the user terminal 10 and the test strip 100 that obstructs the test strip 100 during imaging. When an obstruction is present, the imaging control unit 130 may, for example, display a warning on the display unit 14. The imaging control unit 130 may also determine whether or not there is an obstacle in the image after imaging the test strip 100. When an obstacle is present, the imaging control unit 130 may, for example, display a message on the display unit 14 prompting re-imaging. Similarly, if, after imaging the test strip 100, the captured image has color information that is so biased that it cannot be corrected by the methods described later (at least one of color correction and angle correction), the imaging control unit 130 may also, for example, display a message on the display unit 14 prompting re-imaging.

[0053] When an inspection image G is captured, the control unit 13 displays operation buttons labeled "Send Image" or "Take Another Image." If the user taps "Send Image," the control unit 13 sends the inspection image G to the information processing server 20 via the communication unit 11. If the user taps "Take Another Image," the control unit 13 returns to the imaging screen of the imaging unit 16 and takes another image.

[0054] When the control unit 13 transmits the inspection image G, it transmits the individual identification information IDA to the information processing server 20 along with the inspection image G. The individual identification information IDA is embedded in the two-dimensional code 102. The control unit 13 uses the imaging control unit 130 to capture the inspection image G, for example, so that it includes the color development unit 103 and the two-dimensional code 102. The control unit 13 transmits the individual identification information IDA to the information processing server 20 by transmitting the inspection image G, which includes the color development unit 103 and the two-dimensional code 102, to the information processing server 20.

[0055] When the control unit 13 transmits the inspection image G, it transmits the individual identification information IDA to the information processing server 20 along with the inspection image G. The individual identification information IDA is embedded in the two-dimensional code 102. The control unit 13 uses the imaging control unit 130 to capture the inspection image G, for example, so that it includes the color development unit 103 and the two-dimensional code 102. The control unit 13 transmits the individual identification information IDA to the information processing server 20 by transmitting the inspection image G, which includes the color development unit 103 and the two-dimensional code 102, to the information processing server 20.

[0056] Furthermore, the control unit 13 transmits the personal identification information IDB to the information processing server 20. The personal identification information IDB is information that uniquely identifies the person being examined, such as their name. For example, the control unit 13 displays an input screen in the telemedicine application that prompts the user to enter the personal identification information IDB, and transmits the information entered by the user according to the on-screen instructions to the information processing server 20 as the personal identification information IDB. The control unit 13 may also use information previously registered by the user when creating an account in the telemedicine application as the personal identification information IDB. The control unit 13 transmits the personal identification information IDB to the information processing server 20 along with the examination image G which includes the color development unit 103 and the two-dimensional code 102.

[0057] (Regarding Personal Identification Information (IDB)) Personal Identification Information (IDB) only needs to contain information that can identify an individual. Personal Identification Information (IDB) may be a code used to identify an individual (e.g., My Number, driver's license number, insurance card number, etc.). My Numbers, etc., are recorded in a database linked to names, addresses, etc. By using codes linked to names, addresses, etc., such as My Numbers, users do not need to enter their specific names or addresses into the telemedicine app. This makes it possible to enhance anonymity by making it impossible to identify individuals from their appearance. Personal Identification Information (IDB) may be downloaded and entered from other systems.

[0058] Personal Identification Information (IDB) may include attribute information, location information, and device information. Attribute information is information indicating the attributes of the person being tested, and is particularly necessary when receiving a diagnosis from a doctor. Attribute information is, for example, information indicating answers to items asked in a medical interview. Attribute information may include, for example, age, gender, occupation, personal and family medical history, current health status, presence or absence of allergies, and travel history. Location information indicates the location where the test was conducted. Location information may be information entered by the user, or it may be information automatically acquired by a GPS (Global Positioning System) function built into the user terminal 10. Location information is used, for example, when creating statistical information such as how many people were tested in an area where an infection was prevalent. Device information is information for identifying the individual user terminal 10 used by the person being tested. Device information may include, for example, the smartphone's serial number, terminal number, and MAC address.

[0059] (Regarding the information processing server 20) The information processing server 20 is the computer device of the person being tested. The information processing server 20 can be implemented as, for example, a cloud device, a server device, or a PC. The information processing server 20 is, for example, a server device that operates a site related to a telemedicine application.

[0060] Figure 4 is a block diagram showing an example configuration of an information processing server 20 according to an embodiment. The information processing server 20 includes, for example, a communication unit 21, a storage unit 22, and a control unit 23. The communication unit 21 communicates with the user terminal 10 and the institutional server 30.

[0061] The storage unit 22 is composed of a storage medium such as an HDD, flash memory, EEPROM, RAM, or ROM, or a combination thereof. The storage unit 22 stores programs for executing various processes of the information processing server 20, and temporary data used when performing various processes. The storage unit 22 stores individual information 220, subject information 221, test result information 222, and judgment criterion information 223.

[0062] Figure 6 shows an example of individual information 220 according to an embodiment. Individual information 220 is information that includes at least individual identification information IDA and is embedded in the two-dimensional code 102. Individual information 220 includes, for example, an individual identification number, manufacturer, model name, object to be tested, disease, disease item, etc. The individual identification number is identification information such as a manufacturing number that uniquely identifies the test strip 100. The manufacturer is information indicating the manufacturer that manufactured the test strip 100. The model name is information indicating the model name of the test strip 100. The substance being tested is the substance targeted by test strip 100. The disease information indicates a disease that may be caused by the presence of the substance being tested by test strip 100. The disease category provides further subdivisions of the disease.

[0063] Figure 7 shows an example of the subject information 221 according to the embodiment. The subject information 221 is information that includes at least the subject's personal identification information IDB and is notified from the user terminal 10. The subject information 221 includes, for example, a personal identification number, an individual identification number, a name, attribute information, and location information. The personal identification number is identification information such as a My Number that uniquely identifies an individual. The individual identification number is the individual identification number in the individual information 220. The name is the name of the subject identified by the personal identification number. The attribute information is information that indicates the attributes of the subject, and is particularly necessary when receiving a diagnosis from a doctor. The location information is information that indicates the location where the subject underwent the examination.

[0064] Figure 8 shows an example of the inspection result information 222 according to the embodiment. The inspection result information 222 is information that indicates the judgment result based on the inspection image G. The judgment result is the result of quantitatively determining whether or not the test strip 100 indicates that the biological sample contains the object to be inspected, by image analysis of the inspection image G by the judgment unit 232, which will be described later. The memory unit 22 includes items such as judgment result, individual identification number, examination image G, diagnosis result, and notification. The judgment result is information indicating the judgment result based on the examination image G, for example, whether it is positive or negative, or whether there is a suspicion of disease or not. The individual identification number is the individual identification number in the individual information 220. The examination image G is information indicating the examination image G notified from the user terminal 10. The diagnosis result is information indicating the result of the diagnosis made by the doctor based on the judgment result and examination image G, for example, whether there is a high possibility of infection. The notification indicates whether or not the judgment result and diagnosis result have been notified to the user terminal 10.

[0065] The judgment criterion information 223 is information (e.g., pixel value) that indicates the color used as the criterion for judgment when making a judgment based on the inspection image G. The judgment criterion information 223 is generated, for example, for each type of test strip 100.

[0066] Returning to the explanation of Figure 4, the control unit 23 is realized by causing the CPU, which is provided as hardware in the information processing server 20, to execute a program. The control unit 23 comprehensively controls the information processing server 20. The control unit 23 includes, for example, an acquisition unit 230, a correction unit 231, a determination unit 232, a storage control unit 233, and a device control unit 234.

[0067] The acquisition unit 230 acquires the inspection image and personal identification information IDB notified from the user terminal 10 via the communication unit 21. The acquisition unit 230 outputs the inspection image to the correction unit 231. The acquisition unit 230 outputs the inspection image and personal identification information IDB to the storage control unit 233.

[0068] The correction unit 231 corrects the inspection image. For example, the correction unit 231 corrects the color of the inspection image. In this case, for example, a color correction index (for example, a color correction patch, a color code, etc.) is attached to the test strip 100, and imaging is performed so that the color correction index is included in the inspection image G. The correction unit 231 creates a color conversion table such that the pixel values ​​of the color correction index captured in the inspection image G become the pixel values ​​of the color related to the predetermined color correction index. The correction unit 231 corrects the color of the inspection image by converting the pixel values ​​of the inspection image G using the created color conversion table. Color correction indicators can be applied directly to the test strip 100, or they can be used when acquiring the inspection image with the imaging unit, by capturing the same inspection image. For example, when imaging the test strip, a sheet of paper with color correction indicators printed on it can be prepared, and the color correction indicators on that paper can also be imaged simultaneously to perform color correction. Furthermore, color codes used as color correction indicators include, for example, cyan, magenta, yellow, black, blue, green, red, and grayscale. Not only single colors, but also combinations of multiple color codes may be used, and the intensity of control line 1030 and test line 1031 may be determined by comparing them with the intensity of control line 1030 and test line 1031 using a color gradient.

[0069] The correction unit 231 may also correct the angle of the inspection image. In this case, for example, an angle correction index is provided on the test strip 100. The angle correction index is a line parallel or perpendicular to a reference line (for example, a control line 1030 or a test line 1031) provided on the test strip 100. The image is then captured so that the angle correction index is included in the inspection image G. The correction unit 231 corrects the angle of the inspection image by rotating the angle so that the lines of the angle correction index captured in the inspection image G are aligned with the vertical or horizontal direction of the image. The correction unit 231 outputs the corrected inspection image G to the determination unit 232. The angle correction index can be applied directly to the test strip 100, or it may be used to apply the color correction index that is captured in the same inspection image when the inspection image is acquired by the imaging unit. For example, when imaging the test strip, a sheet of paper with the color correction index printed on it can be prepared, and the color correction index on that paper can also be imaged at the same time to perform color correction. In addition to the test strip 100, other items to be prepared may include a concealment jig (a jig that covers or holds the test strip 100 and hides areas other than the display area to be imaged) or a holding jig.

[0070] The above example illustrates the case where the correction unit 231 performs correction using a color correction index or an angle correction index. However, the correction unit 231 is not limited to the case where it performs correction using a color correction index or an angle correction index. The correction unit 231 may also perform correction using a two-dimensional code 102 instead of a color correction index or an angle correction index. Specifically, the correction unit 231 corrects the color of the inspection image G using the color of the two-dimensional code 102. The correction unit 231 also corrects the angle of the inspection image G according to the angle between the vertical and horizontal directions of the inspection image G and the vertical and horizontal directions of the two-dimensional code 102 captured in the inspection image G.

[0071] The determination unit 232 determines whether or not the object to be inspected is included by performing image analysis on the (corrected) inspection image G. For example, the determination unit 232 determines that the object to be inspected is included if the pixel value of the pixels in the color development unit 103 shows a color close to the color corresponding to the judgment criterion information 223. On the other hand, the determination unit 232 determines that the object to be inspected is not included if the pixel value of the pixels in the color development unit 103 shows a color different from the color corresponding to the judgment criterion information 223. This makes it possible to quantitatively determine the presence or absence of the object to be inspected compared to when the subject of inspection makes a self-determination. The determination unit 232 outputs the determination result to the memory control unit 233. Color correction indicators may be used when making quantitative judgments. Furthermore, color correction indicators captured in the same inspection image when acquiring the inspection image with the imaging unit may also be used. For example, when imaging a test strip, a sheet of paper with color correction indicators printed on it may be prepared, and the color correction indicators on that paper may also be imaged at the same time, and quantitative values ​​may be calculated using the color correction indicators.

[0072] The memory control unit 233 controls the information to be stored in the memory unit 22. The memory control unit 233 extracts the area of ​​the two-dimensional code 102 from the inspection image acquired from the acquisition unit 230. The memory control unit 233 acquires the information embedded in the two-dimensional code 102 by performing image analysis of the extracted area. The memory control unit 233 stores the acquired information as individual information 220 in the memory unit 22.

[0073] The memory control unit 233 generates information that associates the personal identification information IDB acquired from the acquisition unit 230 with the individual identification information IDA, and stores the generated information as the subject of examination information 221 in the memory unit 22.

[0074] In this embodiment, the personal identification information IDB is stored in the subject information 221 in association with individual identification information IDA, without being associated with the examination image G. Individual identification information IDA is information unrelated to the subject, such as a string of characters indicating a serial number. In other words, in this embodiment, the personal identification information IDB is associated with a string of characters unrelated to the subject, without being associated with the examination image G. Therefore, it is possible to prevent the individual from being easily linked to the examination image G, thereby enhancing anonymity.

[0075] The memory control unit 233 stores the inspection image in the "Inspection Image G" item of the inspection result information 222. The memory control unit 233 also stores the judgment result obtained from the judgment unit 232 in the "Judgment Result" item of the inspection result information 222.

[0076] Furthermore, when the information processing server 20 and the institutional server 30 communicate and receive some kind of response to the judgment result, the memory control unit 233 stores the response result in the inspection result information 222, associating it with the judgment result.

[0077] For example, if a doctor makes a diagnosis based on the test results, at the request of the person being tested, the memory control unit 233 stores the diagnosis result notified by the medical institution's institutional server 30 in the diagnosis result item of the test result information 222. The method of receiving a diagnosis from a doctor via the medical institution's institutional server 30 will be described later.

[0078] Furthermore, when the judgment result or diagnosis result is notified to the user terminal 10, the memory control unit 233 stores in the notification item of the inspection result information 222 that it has been notified.

[0079] In this embodiment, similar to the subject information 221, the judgment result in the test result information 222 is stored in association with the individual identification information IDA, without being associated with the personal identification information IDB. This makes it possible to enhance anonymity by preventing individuals from being easily linked to the judgment result.

[0080] The device control unit 234 comprehensively controls the information processing server 20. For example, the device control unit 234 outputs the inspection image G, etc., received by the communication unit 21 to the acquisition unit 230. When the device control unit 234 transmits the inspection image G to the institutional server 30, it refers to the storage unit 22 to extract the inspection result information 222 of the person being inspected. The device control unit 234 acquires the inspection image G, etc., from the extracted inspection result information 222 and transmits the acquired inspection image G, etc., to the institutional server 30.

[0081] In this case, the device control unit 234 associates the inspection image G with the individual identification information IDA and transmits it to the institutional server 30. That is, when the device control unit 234 sends the inspection image G, it does not transmit the personal information of the person being inspected to the institutional server 30. This prevents the inspection image G from being easily linked to personal information.

[0082] When the device control unit 234 receives notification from the engine server 30 of a response to the judgment result, it outputs the response to the storage control unit 233 and stores the response in association with the judgment result.

[0083] For example, consider a case where, at the request of the person being examined, a doctor makes a diagnosis based on the examination image G and the judgment result. The device control unit 234 obtains the examination image G and the judgment result from the examination result information 222. The device control unit 234 obtains individual identification information IDA from the individual information 220. The device control unit 234 transmits the examination image G and the judgment result, along with the individual identification information IDA, to the medical institution's institutional server 30. The device control unit 234 may also notify the user terminal 10 of the diagnosis result received from the institutional server 30. After notifying the diagnosis result, the device control unit 234 may store in the memory control unit 233 that the notification has been made.

[0084] (Regarding institutional server 30) The institutional server 30 is a computer device belonging to various institutions, such as medical institutions and government agencies. The institutional server 30 includes general institutional server devices, such as PCs installed by event organizers at event venues. The institutional server 30 is operated by those engaged in medical work, i.e., doctors, personnel in government agencies, or event organizers. The institutional server 30 can be implemented using, for example, cloud devices, server devices, or PCs. Below, we will explain the case where the institutional server 30 is a server device of a medical institution operated by a hospital that provides telemedicine diagnoses.

[0085] Figure 5 is a block diagram showing an example configuration of the machine server 30 according to an embodiment. The machine server 30 includes, for example, a communication unit 31, a storage unit 32, a control unit 33, a display unit 34, and an input unit 35. The communication unit 31 communicates with the information processing server 20. The storage unit 32 is composed of a storage medium such as an HDD, flash memory, EEPROM, RAM, ROM, or a combination thereof. The storage unit 32 stores programs for executing various processes of the machine server 30, and temporary data used when performing various processes.

[0086] The display unit 34 includes, for example, a display device such as a liquid crystal display, and displays an image in accordance with the control of the control unit 33. The input unit 35 includes, for example, an input device such as a mouse or keyboard, and outputs information operated by a user, such as a person being examined, to the control unit 33.

[0087] The control unit 33 is implemented by having the CPU, which is provided as hardware in the institutional server 30, execute a program. The control unit 33 comprehensively controls the institutional server 30. The control unit 33 displays the examination image G and judgment result received by the communication unit 31 from the information processing server 20 on the display unit 14. The physician makes a diagnosis by observing the displayed examination image G and considering the judgment result, and inputs the diagnosis result into the institutional server 30. The control unit 33 acquires the diagnosis result input by the physician via the input unit 35. The control unit 33 associates the diagnosis result with the individual identification information IDA and transmits it to the information processing server 20.

[0088] Figure 9 is a sequence diagram showing the processing flow of the information processing system 1 according to the embodiment. The user terminal 10 images the test strip 100 (step S10). The test strip 100 here is a test strip after examination, on which a biological sample of the person being examined has been supplied. The user terminal 10 acquires personal identification information IDB (step S11). The user terminal 10 displays a screen prompting the user to input personal identification information IDB, and the user acquires personal identification information IDB by operating and inputting according to the display.

[0089] Furthermore, the user terminal 10 acquires the desired information (step S12). The desired information is information indicating the user's wishes regarding diagnosis using the examination images G. For example, it may be information indicating whether or not the user wishes to receive a diagnosis from a doctor using the examination images G, and the name of the doctor they wish to receive the diagnosis from. The user terminal 10 displays a message such as "Do you wish to receive a diagnosis from a doctor?" along with selection buttons such as "Yes" and "No". If the user selects the "Yes" button according to the display, a message such as "Please select the doctor you wish to receive a diagnosis from" is displayed along with a list of hospitals and doctors who can provide remote diagnosis. The user searches the displayed list by scrolling or other means and selects the hospital or doctor they wish to receive a diagnosis from. As a result, the user terminal 10 acquires the desired information.

[0090] The user terminal 10 transmits the inspection image G, personal identification information IDB, and desired information to the information processing server 20 (step S13). The inspection image G transmitted here is an image that includes the two-dimensional code 102 and the color-changing area 103 captured in step S10.

[0091] Note that the order in which steps S10 to S12 described above are performed is arbitrary. In step S13, it is sufficient that the user terminal 10 has acquired the information (inspection image G, personal identification information IDB, and desired information) before sending the information to the information processing server 20. In this example, steps S11 and S12 are performed consecutively to minimize the number of input screen transitions and improve efficiency.

[0092] The information processing server 20 receives the examination image G, etc. (step S14). The information processing server 20 generates and stores individual information 220 (step S15). The information processing server 20 obtains individual identification information IDA by reading the information embedded in the two-dimensional code 102 captured in the examination image G. The information processing server 20 generates and stores the examination subject information 221 (step S16). The information processing server 20 generates the examination subject information 221 by associating the personal identification information IDB notified from the user terminal 10 with the individual identification information IDA, without associating it with the examination image G.

[0093] The information processing server 20 makes a determination from the inspection image G (step S17). The information processing server 20 determines whether or not the object to be inspected is included by performing image analysis on the color development section 103 of the inspection image G. The information processing server 20 generates and stores inspection result information 222 (step S18). The information processing server 20 generates the inspection result information 222 by associating the determination result and the inspection image G with individual identification information IDA without associating them with personal information. If the person being inspected wishes to be diagnosed by a doctor, the information processing server 20 identifies the hospital and doctor to whom the diagnosis should be requested based on the requested information, and transmits the inspection image G and the determination result to the institutional server 30 of the medical institution corresponding to the identified hospital, etc. (step S19).

[0094] The institutional server 30 receives the examination image G and the judgment result from the information processing server 20 (step S20). The institutional server 30 displays the examination image G and the judgment result, etc., to allow the physician to make a diagnosis, and the diagnosis result is entered into the institutional server 30. The institutional server 30 transmits the diagnosis result to the information processing server 20 (step S21).

[0095] The information processing server 20 receives the diagnostic results from the institutional server 30 and stores them in the inspection result information 222 (step S22). The information processing server 20 sends the judgment result, along with the diagnostic results, to the user terminal 10 (step S23).

[0096] The user terminal 10 receives the judgment result and the diagnosis result from the information processing server 20 (step S24). The user terminal 10 displays the received judgment result and diagnosis result (step S25).

[0097] The above flowchart illustrates a case where the information processing server 20 transmits inspection images G and other data to the institutional server 30 based on the requested information. However, it is not limited to this case. The information processing server 20 may also be configured to transmit inspection images G and other data to the institutional server 30 in response to a request from the institutional server 30.

[0098] For example, this system can be applied to cases where, while telemedicine is being performed on a system different from the information processing system 1, the user transmits individual identification information (IDA) to the doctor, and the doctor requests a judgment result from the information processing server 20 corresponding to that individual identification information (IDA). Alternatively, it can be applied to cases where, after an examination is performed by the information processing system 1, the user transmits individual identification information (IDA) to the doctor during an in-person diagnosis, and the doctor requests a judgment result associated with that individual identification information (IDA) from the information processing server 20.

[0099] (Modification of Embodiment 1) Figure 10 is a sequence diagram showing the processing flow of the information processing system 1 according to the modified embodiment 1. Steps S32, S33, and S37-S46 are the same as steps S11, S12, and S16-S25 shown in Figure 9, so their explanation is omitted.

[0100] The user terminal 10 reads the individual identification information IDA from the area of ​​the two-dimensional code 102 of the captured image (step S31). The user terminal 10 obtains the individual identification information IDA by reading the two-dimensional code 102 with a code reader. The code reader is installed on the user terminal 10, for example, as part of the functionality of a telemedicine application. The user terminal 10 transmits the read individual identification information IDA, along with the examination image G and personal identification information IDB, to the information processing server 20 (step S34). In this case, the user terminal 10 generates an image that includes at least the color-developing area 103 by cropping the image captured in step S30, etc., and transmits the generated image as the examination image G.

[0101] The information processing server 20 receives the inspection image G, individual identification information IDA, and personal identification information IDB from the user terminal 10 (step S35). The information processing server 20 generates and stores individual information 220 (step S36). The information processing server 20 stores the individual identification information IDA received from the user terminal 10 as individual information 220.

[0102] In the first modified embodiment, the user terminal 10 reads the individual identification information IDA from the two-dimensional code 102. The user terminal 10 then transmits the inspection image G, which includes only the color-developing section 103, and the individual identification information IDA to the information processing server 20. Here, the individual identification information IDA transmitted to the information processing server 20 is not an image (image data) of the two-dimensional code, but rather information in the form of a string (text data). The inspection image G transmitted to the information processing server 20 is an image with only the color-developing section 103 cropped, and is smaller in data size than an image that includes both the two-dimensional code 102 and the color-developing section 103. As a result, in this modified embodiment, the data size transmitted to the information processing server 20 can be reduced compared to the embodiment.

[0103] Alternatively, the inspection image G transmitted to the information processing server 20 may be an enlarged image of the color-developing unit 103. In this case, it is expected that the accuracy of the judgment by the information processing server 20 can be improved.

[0104] Alternatively, instead of reading the individual identification information (IDA) from the image, the user may manually input it. In this case, for example, the test strip 100 displays the individual identification information (IDA) as a string of characters or symbols. The user inputs the string of characters or symbols representing the individual identification information (IDA) displayed on the test strip 100 into the user terminal 10.

[0105] (Modified embodiment 2) Figure 11 is a sequence diagram showing the processing flow of the information processing system 1 according to modified embodiment 2. Steps S52, S55, S57-S60, and S63 are the same as steps S12, S17, S19-S22, and S24 shown in Figure 9, so their explanation is omitted.

[0106] The user terminal 10 images the test strip 100 so that it includes the two-dimensional code 102 and the color-developing area 103 (step S50). The user terminal 10 reads the individual identification information IDA from the two-dimensional code 102 of the inspection image G and stores it in the storage unit 12 (step S51). The user terminal 10 transmits only the inspection image G and the desired information to the information processing server 20 (step S53). Here, the user terminal 10 does not transmit the read individual identification information IDA to the information processing server 20.

[0107] The information processing server 20 receives the inspection image G from the user terminal 10 (step S54). The information processing server 20 generates inspection result information 222 and stores it in the storage unit 22 (step S56). The information processing server 20 stores the judgment result in the inspection result information 222. The information processing server 20 reads the individual identification information IDA from the two-dimensional code 102 of the inspection image G and stores the read individual identification information IDA in the inspection image of the inspection result information 222. The information processing server 20 transmits the judgment result and diagnosis result to the user terminal 10, associated with the individual identification information IDA (step S61). The information processing server 20 erases the inspection result information 222 (step S62). The user terminal 10 compares the individual identification information IDA, which is associated with the judgment result and diagnosis result received from the information processing server 20, with the individual identification information IDA stored in the storage unit 12. If both individual identification information IDAs match, the judgment result and diagnosis result are displayed (step S64).

[0108] In the modified embodiment 2, the user terminal 10 reads the individual identification information IDA from the two-dimensional code 102 and stores it in the user terminal 10's storage unit (storage unit 12). The user terminal 10 then transmits only the inspection image G to the information processing server 20. The user terminal 10 does not transmit the personal identification information IDB. Furthermore, after notifying the user terminal 10 of the judgment result, the information processing server 20 erases the inspection result information 222. This suppresses information leakage and enhances security.

[0109] In addition, as with Modification 1 described above, in Modification 2, instead of reading the individual identification information IDA from the image, the user may manually input the individual identification information IDA.

[0110] As described above, the information processing system 1 of the embodiment comprises a test strip 100, a user terminal 10, and an information processing server 20. The information processing system 1 is a system that manages information related to the examination using the test strip 100. The test strip 100 has a color-developing unit 103. The color-developing unit 103 develops a color depending on whether or not the biological sample collected from the person being examined contains the object to be examined, as the biological sample is supplied to the test strip 100. The test strip 100 is assigned individual identification information IDA. The user terminal 10 comprises an imaging unit 16 and a communication unit 11. The imaging unit 16 captures an examination image G. The examination image G is a digital image that includes at least the color-developing unit 103 on the test strip 100 after the examination. The communication unit 11 transmits the examination image G and the individual identification information IDA to the information processing server 20. The information processing server 20 comprises a determination unit 232 and a storage control unit 233. The determination unit 232 determines, based on the inspection image G and the determination criteria information 223, whether or not the color-developing unit 103 in the inspection image G indicates the presence of an object to be inspected. The memory control unit 233 stores the inspection image G in association with the individual identification information IDA.

[0111] As a result, the information processing system 1 of this embodiment can transmit the test image G to the information processing server 20. The test image G includes an image of the color-developing area 103. Therefore, the information processing server 20 can determine whether the result is positive or negative based on the color-developing area 103 in the test image G. Thus, it is possible to quantitatively determine whether the test strip 100 after testing is positive. Furthermore, since the test image G is transmitted as electronic information, it is possible to make a decision more quickly compared to mailing the sample or the test strip 100 after testing. In addition, the test image G is stored in association with individual identification information IDA, which is unrelated to personal identification information IDB. Therefore, it is possible to prevent individuals from being easily linked to the test image G, thereby enhancing anonymity.

[0112] Here, the test strip 100 is an example of a "test piece". The user terminal 10 is an example of a "first device". The communication unit 11 is an example of a "first communication unit". The information processing server 20 is an example of a "second device".

[0113] Furthermore, in the information processing system 1 of this embodiment, the user terminal 10 is equipped with an input unit 15. The function of the input unit 15 is an example of the "acquisition process". Personal identification information IDB is input to the input unit 15. Personal identification information IDB is information about the person being tested and includes at least one of the following: information that uniquely identifies the individual, attribute information, or location information. The communication unit 11 transmits the personal identification information IDB to the information processing server 20. The storage control unit 233 stores the personal identification information IDB in association with the individual identification information IDA. As a result, in the information processing system 1 of this embodiment, the personal identification information IDB can be managed separately from the inspection image G and the judgment result. Therefore, it is possible to prevent individuals from being easily linked to the inspection image G and the judgment result, thereby enhancing anonymity.

[0114] Furthermore, in the information processing system 1 of this embodiment, the communication unit 21 of the information processing server 20 notifies the user terminal 10 of the judgment result. The user terminal 10 displays the judgment result. As a result, the information processing system 1 of this embodiment allows the user to recognize the judgment result more quickly compared to notifying the test result by mail.

[0115] Furthermore, in the information processing system 1 of this embodiment, the communication unit 21 of the information processing server 20 notifies the institutional server 30 of the determination result. The institutional server 30 is an example of the "third device". The institutional server 30 transmits the diagnosis result (an example of the confirmation result) by a physician (an example of the verifier) ​​to the information processing server 20. As a result, the information processing system 1 of this embodiment can perform not only determination by image analysis but also diagnosis by a physician, etc.

[0116] Furthermore, in the information processing system 1 of this embodiment, the memory control unit 233 of the information processing server 20 stores the judgment result in association with individual information 220, without associating it with the subject information 221. The memory control unit 233 stores the personal identification information IDB in association with individual information 220, without associating it with the judgment result. As a result, in the information processing system 1 of this embodiment, it is possible to prevent individuals from being easily linked to the judgment result, thereby enhancing anonymity.

[0117] Furthermore, in the information processing system 1 of this embodiment, personal identification information IDB is embedded in the two-dimensional code 102. The imaging unit 16 takes an image so that it includes the two-dimensional code 102 and the color-developing unit 103. The communication unit 11 transmits the inspection image G, which includes the two-dimensional code 102 and the color-developing unit 103, to the information processing server 20. Thus, in the information processing system 1 of this embodiment, personal identification information IDB can be transmitted by transmitting the inspection image G.

[0118] Furthermore, in the information processing system 1 of the embodiment, the two-dimensional code 102 contains information indicating at least one selected from the group consisting of the type of object to be inspected, the type of disease, and the manufacturer of the test piece. This makes it possible for the information processing system 1 of the embodiment to perform a judgment based on the individual identification information IDA, taking into account various information such as the object to be inspected and the disease. In addition, it is possible to obtain the type and number of diseases for which a judgment has been made based on the individual identification information IDA, making statistical processing easier.

[0119] Furthermore, in the information processing system 1 of this embodiment, the imaging unit 16 may perform imaging such that multiple pieces of individual identification information IDA that are different from each other are included in a single image. For example, if the manufacturer's name is displayed on the test strip 100, the imaging unit 16 will image the two-dimensional code 102 and the area where the manufacturer's name is displayed. As a result, in the information processing system 1 of this embodiment, even if information indicating the manufacturer is not embedded in the two-dimensional code 102, it is possible to acquire it using the inspection image G.

[0120] Furthermore, in the information processing system 1 of this embodiment, the test strip 100 is a lateral flow test strip. The test strip used in immunochromatography shown in Figure 2 is an example of a "lateral flow test strip." Lateral flow assays are widely used in clinical, food, and environmental testing fields because they can easily and quickly detect target substances (test substances) in a sample solution. As a result, the information processing system 1 of this embodiment can handle information related to tests using the test strip 100 to which a proven and reliable method has been applied.

[0121] Furthermore, in the information processing system 1 of this embodiment, the communication unit 11 transmits information regarding the manufacturer of the test strip 100 to the information processing server 20, associating it with the inspection image G. This makes it possible for the information processing system 1 of this embodiment to make a judgment that takes into account the inspection accuracy of the test strip 100 as a product, based on the information indicating the manufacturer of the test strip 100.

[0122] Furthermore, in the information processing system 1 of this embodiment, when the imaging unit 16 photographs the test strip 100, it displays a guide representing the outline of the test strip 100 on the display unit 14. As a result, in the information processing system 1 of this embodiment, the orientation and size of the test strip 100 captured in the inspection image G can be standardized, making it possible to perform image analysis by the information processing server 20 with high accuracy.

[0123] Furthermore, in the information processing system 1 of this embodiment, a color correction index is assigned to the test strip 100. The imaging unit 16 captures an inspection image G including the color correction index. The information processing server 20 further includes a correction unit 231. The correction unit 231 corrects the color of the inspection image G using the color correction index. As a result, in the information processing system 1 of this embodiment, the color of the inspection image G can be corrected, enabling the information processing server 20 to perform image analysis with high accuracy.

[0124] Furthermore, in the information processing system 1 of this embodiment, an angle correction index is provided on the test strip 100. The imaging unit 16 captures an inspection image G including the angle correction index. The correction unit 231 corrects the angle of the inspection image G using the angle correction index. As a result, the information processing system 1 of this embodiment can correct the angle of the inspection image G, enabling the information processing server 20 to perform image analysis with high accuracy.

[0125] Furthermore, in the information processing system 1 of this embodiment, the correction unit 231 corrects at least one of the color and angle of the inspection image G using the two-dimensional code 102. As a result, in the information processing system 1 of this embodiment, at least one of the color and angle of the inspection image G can be corrected even if no special indicators are assigned to the test strip 100.

[0126] Furthermore, in the information processing system 1 of this embodiment, if an obstruction is present when the imaging unit 16 is photographing the test strip 100, it is displayed on the display unit 14. This prevents all or part of the test strip 100 from being obscured in the inspection image G, thus preventing a decrease in the accuracy of image analysis by the information processing server 20.

[0127] (Variation 1 of the institutional server 30) In the embodiment described above, the case in which a diagnosis is made by a physician via the institutional server 30 was illustrated as an example. However, the system is not limited to this. In the information processing system 1, a manufacturer's server device (hereinafter referred to as the manufacturer's server) may be used instead of the institutional server 30, or together with the institutional server 30. The manufacturer here is the manufacturer of the test strip 100. For example, the information processing server 20 sends a list of individual identification information IDA to be assigned to the test strip 100 to the manufacturer's server. The manufacturer manufactures the test strip 100 with the individual identification information IDA received from the information processing server 20. The information processing server 20 matches the individual identification information IDA notified from the user terminal 10 with the individual identification information IDA notified to the manufacturer's server. The information processing server 20 makes a judgment on the examination image G if the individual identification information IDA notified from the user terminal 10 is included in the list notified to the manufacturer's server. On the other hand, if the individual identification information IDA notified by the user terminal 10 is not included in the list notified to the manufacturer server, the information processing server 20 will not perform a determination because it is highly likely that the test strip 100 in the inspection image G is not a product of the manufacturer. This makes it possible to perform a determination that takes into account whether or not the test strip 100 is a product of the manufacturer.

[0128] (Variation 2 of the institutional server 30) The institutional server 30 may also issue prescriptions. For example, the institutional server 30 retrieves the issued prescription along with the doctor's diagnosis and notifies the information processing server 20. If, in the future, the law is amended and it becomes possible to issue prescriptions based on the test results of a reliable test strip 100 from a specific manufacturer, the institutional server 30 or the information processing server 20 may issue prescriptions based on the test results.

[0129] (Variation 3 of the institutional server 30) In the information processing system 1, a company's server device (hereinafter referred to as the "company server") may be used instead of, or in conjunction with, the institutional server 30. This is envisioned in cases where a company requires its employees to undergo testing. The company server obtains the judgment results, which are associated with individual identification information (IDA), from the information processing server 20. The company server can manage the test results in a highly anonymous manner.

[0130] (Variation 4 of the institutional server 30) In the information processing system 1, a government or local government server device (hereinafter referred to as the "local government server") may be used instead of, or in conjunction with, the institutional server 30. This is intended for situations where the government or local government needs to grasp the infection situation. The local government server obtains the judgment results, which are associated with individual identification information (IDA), from the information processing server 20. The local government server can manage the test results in a highly anonymized state.

[0131] The information processing system 1 and information processing server 20 in the above-described embodiment may be implemented in whole or in part by a computer. In that case, the program for implementing this function may be recorded on a computer-readable recording medium, and the program recorded on this recording medium may be loaded into the computer system and executed. Here, "computer system" includes hardware such as the OS and peripheral devices. Furthermore, "computer-readable recording medium" refers to portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, and storage devices such as hard disks built into the computer system. Moreover, "computer-readable recording medium" may also include media that dynamically hold programs for a short period of time, such as communication lines used when transmitting programs via networks such as the Internet or communication lines such as telephone lines, and media that hold programs for a certain period of time, such as volatile memory inside the computer system that acts as a server or client in that case. Furthermore, the above-mentioned program may be a program for implementing a part of the above-mentioned function, or it may be a program that can implement the above-mentioned function in combination with a program already recorded in the computer system, or it may be a program implemented using a programmable logic device such as an FPGA.

[0132] (Second Embodiment) Embodiments of the present invention will be described below with reference to the drawings. In the following embodiments, components with the same configuration as in the first embodiment may be denoted by different reference numerals.

[0133] (Regarding Information Processing System 1) Figure 12 is a block diagram showing an example configuration of the information processing system 1 according to an embodiment. The information processing system 1A includes, for example, a test strip 100A, an inspection terminal 10A, an information processing server 20A, a user terminal 30A, and an event venue terminal 40A. The information processing system 1A is a system that presents inspection results at an event venue or the like.

[0134] In this embodiment, the event venue is a venue where presenting test results is a condition for entry. An event venue is, for example, a venue where various events such as concerts and exhibitions are held. Facilities such as schools, medical institutions, welfare facilities, public facilities, public transportation, theme parks, amusement facilities, companies, shops, retail stores, restaurants, etc., where presenting test results is required, can be included as event venues in this embodiment.

[0135] The test in this embodiment is performed using a test strip 100A. The test is performed, for example, at a medical institution, and involves supplying a biological sample taken from the person being tested to the test strip 100A to determine whether or not the biological sample contains the substance to be tested.

[0136] The testing terminal 10A is a computer, such as a smartphone, mobile phone, tablet, PC (Personal Computer), or test strip reader. The testing terminal 10A is operated by testing personnel at testing institutions such as medical institutions and public health centers. Test-related information (test information) is entered into the testing terminal 10A by the testing personnel. This test information includes, for example, the test result, the location where the test was performed, and the date and time the test was performed.

[0137] The user terminal 30A is a computer, such as a smartphone, mobile phone, tablet, or PC. The user terminal 30A is operated by the person being tested. The person being tested inputs information about themselves (user information) into the user terminal 30A. User information includes, for example, a unique identifier assigned to the person being tested, the person's name, address, contact phone number, and a photograph of the person being tested.

[0138] The information processing server 20A is a computer, such as a PC, server device, or cloud server. The information processing server 20A communicates with the inspection terminal 10A and the information processing server 20A via a communication network NW. The communication network NW is used for the exchange of information. Examples of communication networks NW include LAN (Local Area Network), WAN (Wide Area Network), telephone networks (mobile phone networks, fixed telephone networks, etc.), regional IP (Internet Protocol) networks, and the Internet.

[0139] The event venue terminal 40A is a computer, such as a smartphone, mobile phone, tablet, or PC. The event venue terminal 40A acquires the inspection results displayed on the user terminal 30A, for example, by taking an image of them. Based on the acquired inspection results, the event venue terminal 40A determines whether or not to allow entry.

[0140] The test strip 100A is a test piece used for testing. The test strip 100A has a color-developing section 103A. The color-developing section 103A displays a color corresponding to whether or not the biological sample contains the substance to be tested. Based on the color displayed on the color-developing section 103A of the test strip 100A after testing, it is possible to determine whether or not the biological sample contains the substance to be tested.

[0141] Furthermore, test strip 100A is assigned a two-dimensional code 102A. The two-dimensional code 102A contains embedded individual identification information. This individual identification information uniquely identifies test strip 100A.

[0142] In this embodiment, the individual identification information of the test strip 100A used in the test is used as the test ID. The test ID is information that uniquely identifies the test.

[0143] Specifically, in this embodiment, inspection information is associated with an inspection ID and stored in the inspection result DB221A (see Figure 17). User information is also associated with an inspection ID and stored in the user DB222A (see Figure 17). The inspection result DB221A and the user DB222A are different databases. In other words, in this embodiment, inspection information and user information are stored in separate databases. This prevents inspection results from being easily linked to individuals. Even if information is leaked from the inspection result DB221A, it will not be possible to determine whose inspection results the leaked results are. Even if information is leaked from the user DB222A, it will not be possible to determine what the inspection results of the person whose information was leaked were. In this way, by preventing the storage of data that could easily reveal the inspection results of an individual, data security can be enhanced.

[0144] (Regarding the processing flow performed by Information Processing System 1A) Here, the processing flow performed by the information processing system 1A according to the embodiment will be explained using Figures 13 and 14. Figure 13 shows the processing flow during inspection. Figure 14 shows the processing flow when entering an event venue.

[0145] The following explanation will use as an example a case in which the processing performed by the information processing system 1A is realized when the information processing server 20A provides services to the inspection terminal 10A, user terminal 30A, and event venue terminal 40A via an application program (hereinafter referred to as the inspection management app).

[0146] The test management app is an application program designed to store test results during testing and to display those results at event venues and other locations. The test management app allows for the registration of test information, such as that for tests conducted at medical institutions. It also allows for the registration of user information about the individuals being tested. The test management app can display the test results of the tests taken by the person being tested, upon request from the person being tested.

[0147] Specifically, by installing the test management app on the test terminal 10A, it becomes possible to register test information about tests conducted at medical institutions, etc., using the test management app. Furthermore, by installing the test management app on the user terminal 30A, it becomes possible to register user information about the person being tested using the app, and then display the test results of the person being tested at an event venue, etc.

[0148] It goes without saying that the functionality equivalent to that of a test management app may be implemented via a web browser instead of an app. In this case, the test terminal 10A accesses a site identified by a predetermined URL (Uniform Resource Locator) via a web browser. This site displays, for example, an image for testing institutions related to negative test certificates, and the test staff register the test results by following the instructions in the image and inputting the data.

[0149] As shown in Figure 13, during inspection, the inspection terminal 10A acquires an inspection ID (step S10A). The inspection ID is identification information that uniquely identifies the inspection and is the individual identification information of the test strip 100A used in the inspection. The inspection terminal 10A acquires an image of the two-dimensional code 102A captured by, for example, an inspector. The inspection terminal 10A acquires the individual identification information embedded in the two-dimensional code 102A by performing image analysis on the acquired image. Alternatively, the inspection terminal 10A may acquire an individual identification number directly entered by an inspector. The inspection terminal 10A uses the acquired individual identification information as the inspection ID.

[0150] The inspection terminal 10A acquires an image of the test strip 100A after inspection as inspection information (step S11A). The inspection terminal 10A acquires an image of the color-developing section 103A on the test strip 100A. The color-developing section 103A displays a color depending on whether the biological sample contains the object to be inspected. For example, if the biological sample contains the object to be inspected, a part of the area of ​​the color-developing section 103A is colored and presented with a color different from the background color. On the other hand, if the biological sample does not contain the object to be inspected, it is not colored, and the area of ​​the color-developing section 103A displays the background color of the color-developing section 103A. The color-developing section 103A may display one type of color or multiple types of colors. The inspection terminal 10A acquires an image of the color-developing section 103A taken by, for example, an inspector.

[0151] Steps S10A and S11A may be performed based on the same image. In this case, an overall image of the test strip 100A is captured only once, and steps S10A and S11A are executed by image processing of the overall image. The overall image here is an image of the region of the test strip 100A that includes the two-dimensional code 102A and the color-developing section 103A. Specifically, in step S10A, the inspection terminal 10A acquires an overall image of the test strip 100A after inspection and obtains an inspection ID based on the acquired overall image. In step S11A, the inspection terminal 10A acquires an image of the region in which the color-developing section 103A was captured from the overall image acquired in step S10A.

[0152] The testing terminal 10A determines whether the result is positive or negative based on the image acquired in step S11A (step S12A). A positive result indicates, for example, that the biological sample contains the substance to be tested. In this case, a negative result indicates that the biological sample does not contain the substance to be tested. The testing terminal 10A determines whether the color shown in the color-developing unit 103A indicates that the biological sample contains the substance to be tested by comparing, for example, information indicating the color shown in the color-developing unit 103A (e.g., pixel value) with information indicating the color that serves as the criterion for determination (e.g., pixel value). If the color shown in the color-developing unit 103A indicates that the biological sample contains the substance to be tested, the testing terminal 10A determines the result to be positive. On the other hand, if the color shown in the color-developing unit 103A indicates that the biological sample does not contain the substance to be tested, the testing terminal 10A determines the result to be negative.

[0153] The inspection terminal 10A transmits the inspection ID and inspection result to the information processing server 20A (step S13A). The inspection ID here is the inspection ID obtained in step S10A. The inspection result is the inspection result obtained in step S12A.

[0154] The information processing server 20A stores the inspection ID and inspection result received from the inspection terminal 10A in the inspection result DB 221A (step S14A). The inspection result DB 221A contains information where the inspection ID and inspection result are associated.

[0155] The user terminal 30A obtains the test ID (step S15A). For example, during the test, the person being tested receives a printed document SL (see Figure 28) such as a sticker on which the individual identification information of the test strip 100A used in their test is printed, as a record for the test-taker from the person performing the test. The user terminal 30A obtains the individual identification information when the individual identification information shown on the printed document is entered into the user terminal 30A by the person being tested. Alternatively, the user terminal 30A may obtain the individual identification information by reading a barcode or the like on which the individual identification information is embedded during the test. The user terminal 30A uses the obtained individual identification information as the test ID.

[0156] Alternatively, the user terminal 30A may acquire the individual identification information by receiving the individual identification information transmitted from the inspection terminal 10A. In this case, for example, the person being inspected may specify an email address during the inspection and request that the individual identification information of the test strip 100A used for the inspection be sent to the specified email address. In response to this request, for example, the inspection terminal 10A sends the individual identification information to the specified email address. The person being inspected acquires the individual identification information sent to the email address using the user terminal 30A. As a result, the user terminal 30A acquires the individual identification information.

[0157] Alternatively, the person being tested may obtain the individual identification information of the test strip 100A used in the test by enabling short-range communication between the test terminal 10A and the user terminal 30A via Bluetooth® or similar during the test.

[0158] The user terminal 30A acquires user information (step S16A). For example, user information is entered into the user terminal 30A through an input operation by the person being tested. As a result, the user terminal 30A acquires user information.

[0159] Before step S16A, the user terminal 30A may be configured to log in to the inspection management application. If the login to the inspection management application is successful, for example, an input form for entering user information (see Figure 32) will be displayed on the user terminal 30A. The person being inspected enters user information according to the input form. As a result, the user terminal 30A obtains the user information.

[0160] The user terminal 30A transmits the inspection ID and user information to the information processing server 20A (step S17A). The inspection ID here is the inspection ID obtained in step S15A. The user information is the user information obtained in step S16A. Here, the user terminal 30A may transmit all of the acquired user information to the information processing server 20A, or it may transmit only a part of it. For example, if the user information obtained includes the name of the person being inspected and a photograph of the person being inspected, the user terminal 30A may transmit the name of the person being inspected to the information processing server 20A, but not the photograph of the person being inspected. In this case, for example, the user terminal 30A stores the information of the photograph of the person being inspected that was not transmitted to the information processing server 20A in the storage unit 32A.

[0161] The information processing server 20A stores the inspection ID and user information received from the user terminal 30A in the user database 222A (step S18A). This allows the inspection management application to access the user information. The user database 222A contains information where inspection IDs and user information are associated.

[0162] As shown in Figure 14, when entering the event venue, the user terminal 30A obtains an inspection ID (step S20A). The inspection ID is the inspection ID of the inspection result selected by the person being inspected to be presented in order to enter the event venue. The user terminal 30A obtains the inspection ID, for example, when the person being inspected selects an inspection and the selected inspection ID is entered.

[0163] Before step S20A, the user terminal 30A may be configured to log in to the inspection management application. If the login to the inspection management application is successful, for example, an image for reading the inspection ID (see Figure 31) will be displayed on the user terminal 30A. The person being inspected enters the inspection ID according to the displayed image. As a result, the user terminal 30A obtains the inspection ID.

[0164] The user terminal 30A transmits the inspection ID obtained in step S20A, along with user information, to the information processing server 20A. For example, the user terminal 30A transmits the user information entered by the person being inspected, along with the inspection ID obtained in step S20A, to the information processing server 20A. Alternatively, the user terminal 30A may store the user information acquired in step S16A. In this case, the user terminal 30A may configure the information processing server 20A to transmit the stored user information along with the inspection ID acquired in step S20A.

[0165] The information processing server 20A determines whether or not to notify the user terminal 30A of the inspection results based on the information received from the user terminal 30A (step S22A). The information processing server 20A determines whether or not to notify the inspection results by referring to the user DB 222A based on the inspection ID. For example, if the combination of the inspection ID and user information received from the user terminal 30A is stored in the user DB 222A, the information processing server 20A determines to notify the inspection results. On the other hand, if the combination of the inspection ID and user information received from the user terminal 30A is not stored in the user DB 222A, the information processing server 20A determines not to notify the inspection results. If it determines not to notify the inspection results, the information processing server 20A sends a message to the user terminal 30A to that effect and terminates the process.

[0166] If it is determined in step S22A to notify the inspection result, the information processing server 20A obtains the inspection result (step S23A). The information processing server 20A obtains the inspection result by referring to the inspection result DB 221A based on the inspection ID. The information processing server 20A obtains the inspection information associated with the inspection ID received from the user terminal 30A in the inspection result DB 221A as the inspection result. The information processing server 20A sends the obtained inspection result to the user terminal 30A (step S24A).

[0167] In step S21A, the user terminal 30A may choose to notify the information processing server 20A of only the inspection ID. In this case, the user terminal 30A proceeds to step S23A without executing step S22A, obtains the inspection result associated with the inspection ID, and sends the obtained inspection result to the user terminal 30A. Even in such a case, since only the inspection result is notified to the user terminal 30A in step S24A, even if a third party who is not the person being inspected sends the inspection ID of the inspection performed by the person being inspected to the information processing server 20A, and the inspection result is notified to the third party, that third party cannot identify whose inspection the notified inspection result is for. Therefore, it is possible to protect the privacy of the person being inspected. It is possible to prevent the inspection result from being easily linked to an individual.

[0168] The user terminal 30A displays the inspection results received from the information processing server 20A on its screen (step S25A). The person being inspected presents the inspection results displayed on the screen of the user terminal 30A to a verifier who is checking entry at the event venue. The verifier acquires the inspection results by capturing images of the inspection results displayed on the screen of the user terminal 30A with the camera of the event venue terminal 40A (step S26A). Alternatively, the verifier may visually confirm the inspection results presented by the person being inspected without using the event venue terminal 40A.

[0169] Alternatively, in step S24A, the information processing server 20A may transmit information such as a barcode containing the inspection result to the user terminal 30A. In this case, the user terminal 30A displays the barcode received from the information processing server 20A. The person being inspected presents the barcode displayed on the display unit 34A of the user terminal 30A (see Figure 18) to the verifier. The verifier acquires the barcode displayed on the user terminal 30A by taking an image of it with the camera of the event venue terminal 40A, and obtains the inspection result by reading the information embedded in the acquired barcode (step S26A).

[0170] The event venue terminal 40A determines whether the acquired test result satisfies the entry requirements for the event venue (step S27A). Entry requirements include, for example, a negative result on an antigen test conducted within three days prior to the start of the event. In this case, the test result includes information indicating whether the result was negative or positive, the date and time the test was conducted, etc. Entry requirements may be arbitrarily set depending on the size of the venue, whether the event is indoors or outdoors, the infection situation in the area where the event is held, or the intentions of the event organizers.

[0171] If the event venue terminal 40A determines that the admission conditions are met, it permits the person to be tested to enter (step S28A). On the other hand, if the event venue terminal 40A determines that the admission conditions are not met, it refuses the person to enter (step S29A).

[0172] (Regarding test strip 100A) Here, the test strip 100A will be described using Figure 15. Figure 15 shows an example of the test strip 100A according to an embodiment. The test strip 100A is a test piece that is a component of a clinical diagnostic reagent. Clinical diagnostic reagents are used to test for the presence or absence of disease, and include, for example, lateral flow assays (lateral flow method) and ELISPOT methods, and are drugs that test for the presence or absence of a test target for diagnosing the presence or absence of disease. Lateral flow assays to which immunoassays are applied are sometimes specifically called immunochromatography. Figure 15 shows an example of a test strip used in a lateral flow assay. The test strip 100A comprises, for example, a name tag 101A, a two-dimensional code 102A, a color development section 103A, and a supply section 104A.

[0173] Name tag 101A is a field where the name of the person being tested is written. When mass testing is conducted in hospitals or other facilities, the name tag 101A is either written with a pen by the person in charge of testing, or a sticker with the name of the person being tested printed on it is attached. This clarifies which person's body each test strip 100A was used to test, reducing the risk of mix-ups in mass testing.

[0174] The two-dimensional code 102A is a two-dimensional code image into which the individual identification information of test strip 100A is embedded. The two-dimensional code is, for example, a QR code (registered trademark) or a barcode. The individual identification information is information that uniquely identifies test strip 100A, and is, for example, information indicating the serial number of test strip 100A.

[0175] The color-developing section 103A is the area where the result of the color reaction in the test strip 100A is displayed. The color reaction is a chemical reaction that changes color or develops color when the biological sample contains the substance to be tested. The color-developing section 103A includes, for example, a control line 1030A and a test line 1031A. The control line 1030A is the area where a line appears when the biological sample supplied to the supply section 104A (described later) moves normally to the color-developing section 103A. The test line 1031A is the area where a line appears when the biological sample contains the target virus, antibody, etc. (substance to be tested).

[0176] The supply unit 104A is the area to which the biological sample is supplied. The supply unit 104A includes, for example, a biological sample supply window 1040A. For example, the biological sample of the person being tested is added to the biological sample supply window 1040A, thereby supplying the biological sample to the supply unit 104A.

[0177] Furthermore, the clinical diagnostic reagent may include a specimen collection jig, extraction solution, detection reagent, correction index, etc., for collecting specimens.

[0178] (Regarding biological samples) In this embodiment, the biological sample is a specimen collected from the person being tested, such as mucus collected by swabbing the throat with a cotton swab. The biological sample is preferably a liquid and may include, for example, peripheral blood, serum, plasma, ascites, urine, cerebrospinal fluid, sputum, saliva, bone marrow, synovial fluid, aqueous humor, amniotic fluid, earwax, breast milk, bronchoalveolar lavage fluid, semen, prostatic fluid, Cowper's fluid or preejaculatory fluid, sweat, feces, hair, tears, cystic fluid, pleural fluid or ascites, pericardial fluid, lymph fluid, erosion, chyle, bile, interstitial fluid, menstrual secretions, pus, sebum, vomit, vaginal secretions, mucosal secretions, watery stool, pancreatic juice, nasal secretions, pharyngeal secretions, nasal swab fluid, pharyngeal swab fluid, nasal lavage fluid, bronchopulmonary aspirate, blastocyst fluid, umbilical cord blood, etc., and may contain substances that serve as indicators for diagnosing diseases.

[0179] (Regarding the disease) This refers to diseases, and typical classifications include cancer, hypertension, diabetes, heart disease, cerebrovascular disease, neuropsychiatric disorders, immune and allergic diseases, and infectious diseases.

[0180] (Regarding the disease section) The disease categories further subdivide the above-mentioned diseases, including their causes, metabolites, and phenomena. For example, the disease categories include coronavirus, influenza, adenovirus, RSV, rotavirus, hepatitis B virus, hepatitis C virus, HIV, herpesvirus, norovirus, human metapneumovirus, group A beta-hemolytic streptococcus, Helicobacter pylori, Treponema pallidum, Mycoplasma, Clostridium difficile, Mycobacterium, E. coli O157, E. coli verotoxin, Streptococcus pneumoniae, Legionella, procalcitonin, Chlamydia, Neisseria gonorrhoeae, allergic conjunctivitis, luteinizing hormone (LH), human chorionic gonadotropin (HCG), BNP, NT-proBNP, CK-MB, myoglobin, troponin, D-dimer, H-FABP, granulocyte elastase, carcinoembryonic antigen (CEA), fecal occult blood, insulin-like growth factor binding protein, fFN, allergy tests, CRP, anti-CCP antibody, etc.

[0181] (Regarding the objects to be inspected) In this embodiment, the object to be tested is a substance that is the target of testing with a clinical diagnostic reagent. For example, the object to be tested may be a single substance (object) or a complex of substances (objects) such as cells, bacteria, viruses, exosomes, nucleic acids, polypeptides (including antigens and antibodies), polynucleotides, lipids, phospholipids, carbohydrates, polysaccharides, glycoproteins, low molecular weight compounds, metabolites from cells or bacteria, and fragments of bacteria or viruses, exosomes, etc. In tests related to infectious diseases, when the object to be tested is bacteria, viruses, and polypeptides (antigens), lipids, phospholipids, carbohydrates, polysaccharides, or glycoproteins derived therefrom, the test is specifically called an "antigen test." An "antigen test" determines whether there is a high probability of infection with bacteria or a virus. Furthermore, when the object to be tested is bacteria, viruses, and polynucleotides derived therefrom, the test is specifically called a "nucleic acid detection test." A "nucleic acid detection test" determines whether there is a high probability of infection with bacteria or a virus. Furthermore, when the substance being tested is an antibody, the test is specifically called an "antibody test," and it determines whether there is a high possibility that the person has been infected with bacteria or a virus in the past, or whether antibodies have been produced in the body due to a vaccine received in the past, at the time of the test.

[0182] (Regarding inspection terminal 10A) Here, the inspection terminal 10A will be described using Figure 16. Figure 16 is a block diagram showing an example configuration of the inspection terminal 10A according to the embodiment. For example, an inspection management application is installed on the inspection terminal 10A.

[0183] As shown in Figure 16, the inspection terminal 10A includes, for example, a communication unit 11A, a storage unit 12A, a control unit 13A, a display unit 14A, an input unit 15A, and an imaging unit 16A. The communication unit 11A communicates with the information processing server 20A via the communication network NW.

[0184] The storage unit 12A is composed of storage media such as HDD (Hard Disk Drive), flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), RAM (Random Access read / write Memory), ROM (Read Only Memory), or a combination thereof. The storage unit 12A stores programs for executing various processes of the inspection terminal 10A (for example, programs related to the inspection management application), and temporary data used when performing various processes.

[0185] The control unit 13A is implemented by causing the CPU (Central Processing Unit) provided as hardware in the inspection terminal 10A to execute a program. The control unit 13A comprehensively controls the inspection terminal 10A. For example, the control unit 13A controls the display unit 14A and the imaging unit 16A according to the program related to the inspection management application.

[0186] The control unit 13A executes processing according to the program of the inspection management application. For example, when the icon of the inspection management application is tapped, the control unit 13A launches the inspection management application. As a result, the inspection terminal 10A logs into the inspection management application. If the login is successful, for example, the display unit 14A displays the startup image of the inspection management application for inspection agencies (see Figure 24).

[0187] The control unit 13A includes, for example, an acquisition unit 130A, an inspection and judgment unit 131A, and a registration unit 132A. The acquisition unit 130A acquires various types of information. For example, the acquisition unit 130A acquires information entered by an inspector or the like via the input unit 15A. For example, the acquisition unit 130A acquires image information of an image taken by an inspector or the like via the imaging unit 16A.

[0188] The processing performed by the acquisition unit 130A will be explained using Figures 24 to 29. Figures 24 to 29 are diagrams illustrating the processing performed by the inspection terminal 10A according to the embodiment. Figure 24 shows an example of a startup image for inspection agencies in the inspection management application.

[0189] As shown in Figure 24, the startup image for the testing facility displays buttons B11 to B13 corresponding to each registration item, such as "Register testing location," "Register testing personnel," and "Register testing." These operation buttons are operated by the testing personnel. The testing terminal 10A may also be configured to store information such as the testing location and testing personnel in the storage unit 12A during testing. This makes it possible to register information such as testing results without having to operate these operation buttons in the testing management application.

[0190] When button B11 in Figure 24 is pressed, an inspection location registration image, as shown in Figure 25, is displayed on 10. The inspection location registration image is an image for registering inspection locations. As shown in Figure 25, the inspection location registration image includes input fields for entering information corresponding to the name, address, and telephone number of the inspection location. The inspection location registration image may also include a checkbox to register whether the inspection location is a hospital, public health center, or private residence. The person in charge of inspection enters the name of the inspection location, etc., in each input field, checks the checkbox, and then presses button B14, which is labeled "Register". As a result, the acquisition unit 130A acquires the information shown in each input field as inspection location information. The acquisition unit 130A outputs the acquired inspection location information to the registration unit 132A.

[0191] When the button B12 in Figure 24 is pressed, an inspector registration image, as shown in Figure 26, is displayed on 10. The inspector registration image is used to register inspectors. As shown in Figure 26, the inspector registration image includes input fields for information corresponding to the inspector's name, affiliation, and identification number. The inspector enters the inspector's name, etc., into each input field and presses the button B18, which is labeled "Register". As a result, the acquisition unit 130A acquires the information shown in each input field as information about the inspector. The acquisition unit 130A outputs the acquired information to the registration unit 132A.

[0192] When the button B13 in Figure 24 is pressed, an inspection image as shown in Figure 27 is displayed on the inspection terminal 10A. The inspection image is an image for registering the inspection. As shown in Figure 27, the inspection image includes a message such as "Please read the individual identification information of the inspection kit before use," an input field N11 where the individual identification information is entered, and a button B15 indicating "Activate the inspection kit." The inspection kit corresponds to the test strip 100A in this embodiment. The inspector enters the individual identification information into the input field N11. Alternatively, the inspector activates the imaging unit 16A by manipulating an icon image, and the imaging unit 16A captures the two-dimensional code 102A of the test strip 100A. As a result, the individual identification information embedded in the two-dimensional code 102A is displayed in the input field N11. Then, the inspector presses the button B15. As a result, the acquisition unit 130A acquires the individual identification information shown in the input field N11. The acquisition unit 130A outputs the acquired individual identification information to the registration unit 132A.

[0193] When button B15 in Figure 27 is pressed, the individual identification information is linked to information about the testing institution registered in the testing app. Specifically, the individual identification information is linked to information such as the testing location, the person who performed the test, the date and time of the test, and the test results.

[0194] Furthermore, when inputting the individual identification information of the test strip 100A as described above, the individual identification information may be entered using a printed document as shown in Figure 28. Figure 28 shows an example of a printed inspection sticker displaying individual identification information. The printed document displays the individual identification information or a serial number linked to the individual identification information as the inspection ID in each section, such as "Test Subject Copy" or "Inspection Management." A two-dimensional code with the inspection ID embedded may also be shown together with the serial number, or in place of the serial number. For example, the inspector inputs the individual identification information into the inspection management application by scanning the inspection sticker prepared for inspection management. The inspector attaches the scanned inspection sticker to the test strip 100A. The inspector hands the test subject copy of the inspection sticker to the test subject. This links the individual identification information with information about the testing institution, assigns the individual identification information to the test strip 100A, and makes the individual identification information known to the test subject.

[0195] When a test is performed using the test strip 100A, the operator or other person performing the test will operate the test terminal 10A and display a reading image as shown in Figure 29. The reading image is an image of the color shown in the color-developing section 103A of the test strip 100A. As shown in Figure 29, the reading image includes a message such as "Please image the test kit after use," an icon image G11 to activate the imaging unit 16A, a display field N12 where the test ID is displayed, and a button B16 indicating "Determine positive / negative." The operator or other person performing the test operates the icon image to activate the imaging unit 16A and uses the imaging unit 16A to image the color-developing section 103A of the test strip 100A. The operator or other person performing the test checks whether the color-developing section 103A is correctly included in the captured image and then presses button B16. As a result, the acquisition unit 130A acquires the image information of the image in which the color-developing section 103A has been captured. The acquisition unit 130A outputs the acquired image information to the inspection and judgment unit 131A.

[0196] Alternatively, instead of the color-developing section 103A being imaged after the test, the tester or physician may determine whether the result is positive or negative by observing the color development of the color-developing section 103A on the test strip 100A. In this case, the acquisition unit 130A acquires information indicating the test result via the input unit 15A and outputs the acquired information to the registration unit 132A.

[0197] The inspection and determination unit 131A analyzes the inspection image acquired from the acquisition unit 130A to determine whether the color displayed in the color development unit 103A indicates the presence of the object to be inspected, i.e., whether the result is positive or negative. For example, the inspection and determination unit 131A compares the pixel value of a pixel in the color development unit 103A with the pixel value of the color used as the basis for the determination. If the distance in the color space between the two pixel values ​​is less than a predetermined threshold, the inspection and determination unit 131A determines that the object to be inspected is present, i.e., positive. On the other hand, if the distance in the color space between the two pixel values ​​is greater than or equal to a predetermined threshold, the inspection and determination unit 131A determines that the object to be inspected is not present, i.e., negative. The inspection and determination unit 131A outputs the inspection result, whether positive or negative, to the registration unit 132A.

[0198] In this case, the inspection and judgment unit 131A may correct the inspection image acquired from the acquisition unit 130A and make a judgment using the corrected inspection image. For example, the inspection and judgment unit 131A corrects the color of the inspection image. In this case, for example, a color correction index (e.g., a color correction patch, a color code, etc.) is attached to the test strip 100A, and imaging is performed so that the color correction index is included in the inspection image GA. The inspection and judgment unit 131A creates a color conversion table such that the pixel values ​​of the color correction index captured in the inspection image GA become the pixel values ​​of the color related to the predetermined color correction index. The inspection and judgment unit 131A corrects the color of the inspection image by converting the pixel values ​​of the inspection image GA using the created color conversion table. Color correction indicators can be applied directly to the test strip 100A, or they can be used if they appear in the same inspection image when the inspection image is acquired by the imaging unit. For example, when imaging the test strip, a sheet of paper with color correction indicators printed on it can be prepared, and the color correction indicators on that paper can also be imaged simultaneously, and color correction can be performed. Furthermore, color codes used as color correction indicators include, for example, cyan, magenta, yellow, black, blue, green, red, and grayscale. Not only single colors, but also combinations of multiple color codes may be used, and the intensity of control line 1030 and test line 1031 may be determined by comparing them with the intensity of control line 1030 and test line 1031 using a color gradient.

[0199] Alternatively, the inspection and judgment unit 131A may correct the angle of the inspection image. In this case, for example, an angle correction index is provided on the test strip 100A. The angle correction index is a line parallel or perpendicular to a reference line (for example, a control line 1030A or a test line 1031A) provided on the test strip 100A. The image is then captured so that the angle correction index is included in the inspection image GA. The inspection and judgment unit 131A corrects the angle of the inspection image by rotating the angle so that the lines of the angle correction index captured in the inspection image are aligned with the vertical or horizontal direction of the image. Note that this is not limited to cases where correction is made using a color correction index or an angle correction index. The inspection and judgment unit 131A may perform the correction using a two-dimensional code 102A instead of a color correction index or an angle correction index. Specifically, the inspection and judgment unit 131A may correct the color of the inspection image using the color of the two-dimensional code 102A. Furthermore, the inspection and determination unit 131A may correct the angle of the inspection image according to the angle between the vertical and horizontal directions of the inspection image and the vertical and horizontal directions of the two-dimensional code 102A captured in the inspection image.

[0200] The angle correction index can be applied directly to the test strip 100A, or it may be used to apply the color correction index that appears in the same inspection image when the inspection image is acquired by the imaging unit. For example, when imaging the test strip, a sheet of paper with the color correction index printed on it can be prepared, and the color correction index on that paper can also be imaged at the same time to perform color correction. In addition to the test strip 100A, other items to be prepared may include a concealment jig (a jig that covers or holds the test strip 100A and hides areas other than the display area to be imaged) or a holding jig.

[0201] Furthermore, the test determination unit 131A may use AI (artificial intelligence) to determine whether the test is negative or positive. In this case, the test determination unit 131A obtains an estimated result of whether the test is negative or positive by inputting the test image into a trained model, for example. The trained model here is, for example, a model that has learned the correspondence between test images and negative or positive results using a training dataset in which training test images and labels indicating whether the training test images are negative or positive are paired. By learning the correspondence, the trained model can output an estimated result that estimates whether the input test image is negative or positive based on the input test image with high accuracy.

[0202] The registration unit 132A transmits the test location information acquired from the acquisition unit 130A to the information processing server 20A. As a result, the test location is registered in the database (not shown) of the information processing server 20A. For example, at an event venue, the test location where a person was tested may be indicated as an admission condition. For example, admission may be permitted only if the test taken at a medical institution such as a hospital is negative, or if the test result is negative even if the test was taken at home. When such admission conditions are indicated, the registered test location information is presented as the test result.

[0203] The registration unit 132A registers the test results. The process by which the registration unit 132A registers the test results will be explained using Figure 30. Figure 30 is a diagram illustrating the process performed by the test terminal 10A according to the embodiment. Figure 30 shows an example of an image that displays the test results. As shown in Figure 30, the image that displays the test results includes information such as the test ID, the date and time of the test, the name of the test location, the product name of the test kit, result information indicating whether the test result is positive or negative, and a button B17 that says "Register Results".

[0204] The test ID is the individual identification information entered in the image shown in Figure 27. The test date and time is the date and time when button B16 in the image shown in Figure 29 was operated, for example. The name of the test location is the name of the test location entered in the image shown in Figure 25. The product name of the test kit is the product name of the test strip 100A linked to the individual identification information, for example. The result information shows the test result, indicating whether it is negative or positive, as determined by the test determination unit 131A. Alternatively, if the test is determined to be positive or negative by the test administrator or doctor, the result information shows the test result determined by the test administrator or doctor.

[0205] When an inspector or other user presses button B17, the registration unit 132A sends the inspection ID and inspection result to the information processing server 20A. The registration unit 132A then registers the inspection result.

[0206] Returning to the explanation of Figure 16, the display unit 14A includes, for example, a display device such as a liquid crystal display, and displays an image in accordance with the control of the control unit 13A. The input unit 15A includes, for example, an input device such as a mouse, keyboard, or touch panel, and outputs information operated by an inspector or the like to the control unit 13A. The imaging unit 16A includes, for example, an imaging device such as a digital camera, and performs imaging in accordance with the control of the control unit 13A. The imaging unit 16A outputs the image information of the captured image to the control unit 13A.

[0207] (Regarding information processing server 20A) Here, the information processing server 20A will be described using Figure 17. Figure 17 is a block diagram showing an example configuration of the information processing server 20A according to the embodiment. The information processing server 20A provides, for example, a service related to the inspection management application.

[0208] As shown in Figure 17, the information processing server 20A includes, for example, a communication unit 21A, a storage unit 22A, and a control unit 23A. The communication unit 21A communicates with the inspection terminal 10A and the user terminal 30A via the communication network NW.

[0209] The storage unit 22A is composed of storage media such as HDD, flash memory, EEPROM, RAM, ROM, or a combination thereof. The storage unit 22A stores programs for executing various processes of the information processing server 20A, and temporary data used when performing various processes. For example, the storage unit 22A stores the inspection DB 220A, the inspection result DB 221A, and the user DB 222A.

[0210] Here, the information stored in the memory unit 22A will be explained using Figures 20 to 22. Figure 20 is a diagram showing an example of the inspection DB 220A according to the embodiment. As shown in Figure 20, the inspection DB 220A stores a user ID associated with the inspection ID. The user ID is identification information that uniquely identifies the user who registered the user information. The user ID consists of a string of characters such as a number or numerical value linked to the user information. The inspection DB 220A stores only the user ID and the inspection ID; it does not store information such as the name of the person being inspected or information such as the inspection results.

[0211] Figure 21 shows an example of the inspection result DB221A according to an embodiment. As shown in Figure 21, the inspection result DB221A stores inspection information associated with inspection IDs. The test information includes, for example, the test result indicating whether it was negative or positive, the test image, the date and time of the test, and the location of the test. The test image stores image information of the color-developing unit 103A after the test. The date and time of the test stores information indicating the date and time the test was performed. The location of the test stores information indicating the place where the test was performed or the name of the testing institution. The test result DB221A stores only the test information and does not store information such as the name of the person being tested.

[0212] Furthermore, the test results DB221A may store multiple types of test results. For example, PCR test results, antigen test results, and vaccination status may all be stored in the test results DB221A.

[0213] Figure 22 shows an example of the user DB222A according to an embodiment. As shown in Figure 22, the user DB222A stores user information associated with the test ID. User information includes, for example, information such as the user ID, name, address, contact information, and the test ID of the test received. The user ID stores identification information that uniquely identifies the user information. The name, address, and contact information stores information indicating the name, address, and contact information of the user (person being tested), respectively. The test ID of the test received stores the test ID of the test the user received. The user DB222A stores only the test ID and does not store information such as test results.

[0214] Returning to the explanation of Figure 17, the control unit 23A is realized by causing the CPU, which is provided as hardware in the information processing server 20A, to execute a program. The control unit 23A comprehensively controls the information processing server 20A. The control unit 23A includes, for example, an acquisition unit 230A, a registration control unit 231A, a notification determination unit 232A, an inspection result extraction unit 233A, and an equipment control unit 234A.

[0215] The acquisition unit 230A acquires various types of information. For example, the acquisition unit 230A acquires the inspection result and inspection ID notified from the inspection terminal 10A via the communication unit 21A. In this case, the acquisition unit 230A outputs the acquired information to the registration control unit 231A.

[0216] Furthermore, the acquisition unit 230A acquires user information and inspection ID notified from the user terminal 30A via the communication unit 21A. For example, when a user registers, the user terminal 30A notifies the user information and inspection ID. In this case, the acquisition unit 230A outputs the acquired information to the registration control unit 231A. Alternatively, when entering an event venue, the user terminal 30A notifies the user information and inspection ID. In this case, the acquisition unit 230A outputs the acquired information to the notification determination unit 232A.

[0217] The registration control unit 231A stores the information acquired from the acquisition unit 230A in the storage unit 12A. Specifically, the registration control unit 231A stores the inspection results in the inspection result DB 221A, associating them with the inspection ID. The registration control unit 231A stores user information in the user DB 222A, associating it with the inspection ID. In this case, the registration control unit 231A assigns a user ID to the combination of user information stored in the user DB 222A and the inspection ID. The registration control unit 231A stores the user ID in the inspection DB 220A, associating it with the inspection ID.

[0218] The notification determination unit 232A determines whether or not to notify the user terminal 30A, which is the notification source, of the inspection results based on the user information and inspection ID obtained from the acquisition unit 230A. The notification determination unit 232A determines to notify the user terminal 30A of the inspection results if the combination of user information and inspection ID notified by the user terminal 30A is stored in the user DB 222A. On the other hand, the notification determination unit 232A determines not to notify the user terminal 30A of the inspection results if the combination of user information and inspection ID notified by the user terminal 30A is not stored in the user DB 222A. This ensures that the inspection results are not notified to user terminals 30A that have notified information that does not match the combination of user information and inspection ID notified at the time of registration. Therefore, data security can be enhanced by preventing the inspection results of the person being inspected from being notified to a third party who is not the person being inspected.

[0219] The user information may include a passphrase or keyword set by the person being tested. In this case, the user terminal 30A sends the passphrase or keyword set by the person being tested as user information along with the test ID to the information processing server 20A during registration. The information processing server 20A stores the notified passphrase or keyword in the user DB 222A, associating it with the test ID. Subsequently, when entering an event venue, the user terminal 30A sends the test ID along with the passphrase or keyword notified during registration to the information processing server 20A to request the test results corresponding to the test ID. The notification determination unit 232A determines that if the combination of the passphrase or keyword and the test ID notified from the user terminal 30A is stored in the user DB 222A, it should notify the user terminal 30A of the test results. The passphrase and keyword are information set by the person being tested during registration. Therefore, a third party who is not the person being tested cannot know the passphrase or keyword set by the person being tested. Thus, data security can be enhanced by preventing the test results of the person being tested from being notified to a third party who is not the person being tested.

[0220] The notification determination unit 232A determines whether or not to notify the user terminal 30A of the inspection results and outputs the determination result to the inspection result extraction unit 233A.

[0221] The inspection result extraction unit 233A extracts inspection results to be notified to the user terminal 30A. If the notification determination unit 232A determines that the inspection results should be notified to the user terminal 30A, the inspection result extraction unit 233A refers to the inspection result DB 221A based on the inspection ID obtained from the acquisition unit 230A and obtains the inspection results associated with the inspection ID. As a result, the inspection result extraction unit 233A extracts the inspection results. The inspection result extraction unit 233A outputs the extracted inspection results to the device control unit 234A.

[0222] The device control unit 234A comprehensively controls the information processing server 20A. For example, the device control unit 234A outputs information indicating the inspection ID, etc., received by the communication unit 21A to the acquisition unit 230A. The device control unit 234A transmits the inspection results to the user terminal 30A by outputting the inspection results extracted by the inspection result extraction unit 233A to the communication unit 21A.

[0223] In this case, the device control unit 234A may notify the user terminal 30A of a one-time passcode for displaying the inspection results, instead of the inspection results themselves. For example, the user terminal 30A notifies the event venue terminal 40A of the inspection ID and the one-time passcode. The event venue terminal 40A may then display the inspection results corresponding to the inspection ID when the user enters the inspection ID and the one-time passcode on a screen in the inspection application to check the inspection results.

[0224] (Regarding user terminal 30A) Here, the user terminal 30A will be described using Figure 18. Figure 18 is a block diagram showing an example configuration of the user terminal 30A according to the embodiment. For example, an inspection management application is installed on the user terminal 30A. As a result, the user terminal 30A can use the services provided by the inspection management application.

[0225] As shown in Figure 18, the user terminal 30A includes, for example, a communication unit 31A, a storage unit 32A, a control unit 33A, a display unit 34A, and an input unit 35A. The communication unit 31A communicates with the information processing server 20A via the communication network NW.

[0226] The storage unit 32A is composed of a storage medium such as an HDD, flash memory, EEPROM, RAM, or ROM, or a combination thereof. The storage unit 32A stores programs for executing various processes of the user terminal 30A (for example, programs related to the inspection management application), and temporary data used when performing various processes.

[0227] The control unit 33A is implemented by causing the CPU, which is provided as hardware in the user terminal 30A, to execute a program. The control unit 33A comprehensively controls the user terminal 30A. For example, the control unit 33A controls the display unit 34A according to the program related to the inspection management application.

[0228] The control unit 33A executes processing according to the program of the examination management application. For example, when the icon of the examination management application is tapped, the control unit 33A launches the examination management application. As a result, for example, the display unit 14A displays the startup image for the examination recipient of the examination management application (see Figure 31).

[0229] The control unit 33A includes, for example, an acquisition unit 330A, a user registration unit 331A, an inspection result request unit 332A, and an equipment control unit 333A.

[0230] The acquisition unit 330A acquires various types of information. The acquisition unit 330A acquires information entered into the input fields for various images displayed in the inspection management application, as well as information indicating that buttons on various images have been operated. The acquisition unit 330A outputs the acquired information to at least one of the user registration unit 331A and the inspection result request unit 332A.

[0231] The user registration unit 331A performs user registration. The process by which the user registration unit 331A performs user registration will be explained using Figures 31 and 32. Figures 31 and 32 are diagrams illustrating the processes performed by the user terminal 30A according to the embodiment. In Figure 31, the startup image for the examinee in the examination management application is displayed on the display unit 34A. In Figure 32, the registration image for user registration in the examination management application is displayed on the display unit 34A.

[0232] As shown in Figure 31, the startup image for the patient displays an input field N31 for entering individual identification information, a button B31 indicating "Register as a user," and a button B32 indicating "Check test results." When registering as a user, the person being tested enters individual identification information into input field N31, confirms that the entered individual identification information is correct, and then presses button B31. As a result, the user registration unit 331A acquires the individual identification information shown in input field N31 as the test ID.

[0233] Furthermore, if user information is already registered, the startup image for the patient shown in Figure 31 may not display button B31 indicating "Register as a user." Alternatively, even if user information is not registered, the system may be configured to allow users to check the test results corresponding to the entered test ID by entering the test ID.

[0234] When button B31 is pressed, a registration image as shown in Figure 32 is displayed. The person being inspected enters user information such as their name and address according to the displayed input form. After confirming that the entered name and address are correct, the person being inspected presses button B33, which is indicated as "Register". As a result, the user registration unit 331A retrieves the user information such as the name and address entered in the input fields. The user registration unit 331A may also store the retrieved user information in the storage unit 32A. This eliminates the need for the same user to re-enter user information when using the inspection management application with the user terminal 30A.

[0235] The user registration unit 331A transmits the acquired user information along with the inspection ID to the information processing server 20A. This allows the user registration unit 331A to perform user registration.

[0236] The inspection result request unit 332A requests the inspection results. The process by which the inspection result request unit 332A requests the inspection results will be explained using Figure 31. The person being inspected enters individual identification information into input field N31. When requesting inspection results, the person being inspected enters individual identification information into input field N31, confirms that the entered individual identification information is correct, and then presses button B32. As a result, the inspection result request unit 332A obtains the individual identification information shown in input field N31 as the inspection ID. If user information is stored in storage unit 32A, the inspection result request unit 332A obtains the user information by referring to storage unit 12A. If user information is not stored in the storage unit 32A, the inspection result request unit 332A displays an image (not shown) prompting the user to input user information. The inspection result request unit 332A then retrieves the user information entered by the person being inspected.

[0237] The inspection result request unit 332A transmits the acquired user information along with the inspection ID to the information processing server 20A. This allows the inspection result request unit 332A to request the inspection result for the inspection corresponding to the inspection ID.

[0238] The device control unit 333A comprehensively controls the user terminal 30A. For example, when the device control unit 333A receives input from the input unit 35A indicating that an operation such as launching the inspection management application has been performed, it notifies the inspection management application (the server that provides various images) of information indicating that the operation has been performed. Furthermore, when image information of the startup image is notified from the inspection management application, the device control unit 333A outputs that image information to the display unit 34A to display the startup image. Alternatively, when image information of a registered image is notified from the inspection management application, that information is output to the display unit 34A to display the registered image.

[0239] In addition, when the image information of the image showing the inspection result is notified from the inspection management application, the device control unit 333A outputs the information to the display unit 34A to display the inspection result. The images showing the inspection results will be described with reference to FIGS. 33 to 35. FIGS. 33 to 35 are diagrams for explaining the processes performed by the user terminal 30A according to the embodiment.

[0240] FIG. 33 shows an example of an image displayed on the user terminal 30A when the inspection result is negative. FIG. 34 shows an example of an image displayed on the user terminal 30A when the inspection result is positive. As shown in FIGS. 33 and 34, for example, as the inspection result, columns indicating information showing the inspection result, for example, an icon image indicating negative or positive, a code corresponding to the inspection ID, the inspection date and time, the inspection location, the product name of the inspection kit, etc. may be included. Further, as an image showing the inspection result, a button B33 indicating "display digital certificate" and a button B34 indicating "confirm other inspection results" may be displayed together with the information showing the inspection result. The digital certificate here is a barcode or two-dimensional code in which the inspection result is embedded.

[0241] FIG. 35 shows an example of an image showing the digital certificate displayed when the operation of pressing the button B33 is performed. As shown in FIG. 35, at least one of the code images G31 and G32 is displayed on the digital certificate together with a message such as "not available for use by others". For example, the inspection result indicating negative or positive is embedded in the code images G31 and G32. Further, columns indicating the inspection date and time, the inspection location, the product name of the inspection kit, etc. may be included in the image showing the digital certificate together with the code images G31 and G32.

[0242] Returning to the description of FIG. 18, the display unit 34A includes a display device such as a liquid crystal display, and displays an image according to the control of the control unit 33A. The input unit 35A includes an input device such as a mouse, a keyboard, a touch panel, etc., and outputs the information operationally input by an inspection staff or the like to the control unit 33A.

[0243] (Regarding the event venue terminal 40A) Here, the event venue terminal 40A will be described with reference to FIG. 19. FIG. 19 is a block diagram showing a configuration example of the event venue terminal 40A according to the embodiment. The event venue terminal 40A includes, for example, a communication unit 41A, a storage unit 42A, a control unit 43A, an input unit 45A, and an imaging unit 46A. The communication unit 41A communicates with the user terminal 30A via the communication network NW.

[0244] The storage unit 42A is composed of a storage medium such as an HDD, a flash memory, an EEPROM, a RAM, a ROM, or a combination thereof. The storage unit 42A stores programs for executing various processes of the event venue terminal 40A and temporary data used when performing various processes.

[0245] The storage unit 42A stores, for example, an input condition information unit 420A. The input condition information unit 420A is information indicating the conditions for entering the event venue. FIG. 23 shows an example of the information stored in the input condition information unit 420A according to the embodiment. As shown in FIG. 23, the input condition information unit 420A stores information corresponding to each item such as a condition number, an inspection result, an inspection time, an inspection location, etc. The condition number stores identification information such as a number for identifying the entry condition. The inspection result stores information indicating the inspection result as the entry condition, for example, information indicating that the inspection result is negative. The inspection time stores information indicating the inspection time as the entry condition, for example, information indicating that the inspection was received within 48 hours from the event start time. The inspection location stores information indicating the inspection location as the entry condition, for example, information indicating that the inspection was received at a medical institution.

[0246] Returning to the description of FIG. 19, the control unit 43A is realized by causing the CPU included in the event venue terminal 40A as hardware to execute a program. The control unit 43A comprehensively controls the event venue terminal 40A.

[0247] The control unit 43A includes, for example, an acquisition unit 430A, a condition determination unit 431A, and an equipment control unit 432A. The acquisition unit 430A acquires information indicating the test results of persons who are to be inspected and who are attempting to enter the event venue. For example, the acquisition unit 430A acquires an image of the test results displayed on the user terminal 30A as information indicating the test results of the person being inspected. Alternatively, the acquisition unit 430A reads a digital certificate displayed on the user terminal 30A and acquires information embedded in a barcode or the like corresponding to the digital certificate as information indicating the test results of the person being inspected. The control unit 43A outputs the acquired information indicating the test results of the person being inspected to the condition determination unit 431A.

[0248] The condition determination unit 431A determines whether or not to allow the person to enter the venue based on the information indicating the person's test results. The condition determination unit 431A refers to the input condition information unit 420A and extracts information corresponding to the conditions for entering the event venue. Based on the extracted information and the information indicating the test results obtained from the acquisition unit 430A, the condition determination unit 431A determines whether or not the person's test results satisfy the input conditions.

[0249] For example, the condition determination unit 431A refers to the admission conditions and the test results for each item indicated in the admission conditions and determines whether the test results satisfy the admission conditions. If the admission conditions indicate "the test result must be negative," the condition determination unit 431A determines that the test results satisfy the admission conditions for the test results item in the admission conditions if the test results are negative. If the admission conditions indicate "the test must have been taken within 48 hours of the event start time," the condition determination unit 431A determines that the test results satisfy the admission conditions for the test time item in the admission conditions if the test date and time are within 48 hours of the event start time.

[0250] For example, the condition determination unit 431A determines that if the inspection results satisfy all of the items indicated as entry conditions, the person being inspected should be permitted to enter. On the other hand, if the inspection results fail to satisfy even one of the items indicated as entry conditions, the condition determination unit 431A determines that the person being inspected should not be permitted to enter. The condition determination unit 431A outputs the determination result to the device control unit 432A.

[0251] Here, the condition determination unit 431A may store the inspection ID for which it has determined entry is permitted in the storage unit 42A.

[0252] The device control unit 432A comprehensively controls the event venue terminal 40A. For example, the device control unit 432A outputs the image information of the digital certificate captured by the imaging unit 46A to the acquisition unit 230. The device control unit 234A displays whether or not entry is permitted by outputting the result, which indicates whether or not entry is permitted for the person being inspected as determined by the condition determination unit 431A, to the display unit 44A.

[0253] The display unit 44A includes, for example, a display device such as a liquid crystal display, and displays an image in accordance with the control unit 43A. The input unit 45A includes, for example, an input device such as a mouse, keyboard, or touch panel, and outputs information entered by an inspector or the like to the control unit 43A. The imaging unit 46A includes, for example, an imaging device such as a digital camera, and performs imaging in accordance with the control unit 43A. The imaging unit 46A outputs image information of the captured image to the control unit 43A.

[0254] (Variation 1) The testing terminal 10A and the user terminal 30A may be the same device. In this case, the testing location will be a place other than a medical institution, such as the test subject's home. For example, in the registration image shown in Figure 25, a private home is checked as the testing location.

[0255] (Modification 2) The information processing server 20A may retain the inspection results for a certain period and delete them from the DB (database) after that period has elapsed. For example, the information processing server 20A may delete inspection information from the inspection results DB 221A that is more than two weeks old from the inspection date and time. In this case, the information corresponding to the inspection ID that corresponds to the information deleted from inspection result DB221A is deleted from inspection DB220A. In addition, in user DB222A, the information corresponding to the inspection ID that was deleted in this instance is deleted from the inspection IDs stored as inspections taken by the person being inspected. The period for which inspection results are retained may be arbitrarily set depending on the nature of the inspection and the period for which the inspection results are considered valid, such as the long-term validity of the inspection items.

[0256] (Variation 3) The inspection results that the user terminal 30A presents to the event venue terminal 40A may be an inspection ID or a temporary number associated with the inspection ID. The event venue terminal 40A may request the inspection results from the information processing server 20A based on the inspection ID or temporary number presented by the user terminal 30A.

[0257] (Modification 4) Multiple entry conditions may be set for a single event venue. Entry may be permitted if the test results meet any of the set entry conditions. Alternatively, entry may be permitted only if the test results meet all of the set entry conditions.

[0258] As described above, the information processing system 1A of this embodiment comprises an inspection terminal 10A, an information processing server 20A, and a user terminal 30A. The information processing system 1A is a system that processes information related to inspections using test pieces to check whether or not a biological sample contains an object to be inspected. The inspection terminal 10A has an acquisition unit 130A and a registration unit 132A. The acquisition unit 130A acquires individual identification information and inspection information. The registration unit 132A transmits the individual identification information and inspection information to the information processing server 20A. The user terminal 30A comprises an acquisition unit 330A and a user registration unit 331A. The acquisition unit 330A acquires individual identification information and user information. The user registration unit 331A transmits the individual identification information and user information to the information processing server 20A. The information processing server 20A includes a registration control unit 231A. The registration control unit 231A stores information that associates inspection information with individual identification information in the inspection result DB 221A based on the information received from the inspection terminal 10A. The registration control unit 231A stores information that associates user information with individual identification information in the user DB 222A based on the information received from the user terminal 30A.

[0259] Here, test strip 100A is an example of a "test piece". Acquisition unit 130A is an example of a "first acquisition unit". Acquisition unit 330A is an example of a "second acquisition unit". Inspection result DB221A is an example of an "inspection result database". User DB222A is an example of a "user database".

[0260] This enhances data security in the information processing system 1A of the embodiment. The inspection result DB221A and the user DB222A are different databases. In other words, in this embodiment, test information and user information are stored in separate databases. This prevents test results from being easily linked to individuals. By preventing the storage of data that could easily reveal the test results of the person being tested, data security can be enhanced.

[0261] In the above-described embodiments, "the test result being negative" is shown as an example of the admission condition, but it is not limited thereto. For example, when the test object is a foreign substance (such as bacteria or viruses) for the living body, it is determined that "good" if the test object is not contained in the biological sample (negative) by the test. In this case, if the test result is negative, entry into the event venue is permitted. On the other hand, when the test object is a substance (such as an antibody) that has a role of eliminating foreign substances for the living body, it is determined that "good" if the test object is contained in the biological sample (positive) by the test. In this case, if the test result is positive, entry into the event venue is permitted. In this case, "the test result being positive" becomes the admission condition.

[0262] Also, in the above-described embodiments, the case where the test determination unit 131A of the test terminal 10A determines whether it is positive or negative has been illustrated and described, but it is not limited thereto. A configuration may be such that all or part of the processing performed by the test determination unit 131A is performed by the information processing server 20A. In this case, for example, the test terminal 10A transmits the test image to the information processing server 20A. The information processing server 20A determines whether it is positive or negative based on the test image received from the test terminal 10A.

[0263] For example, when the test determination unit 131A uses AI (artificial intelligence) to determine whether it is negative or positive, storing the learned model in the test terminal 10A may strain the memory capacity of the test terminal 10A and impose a large load. Also, in the case where there are multiple test terminals 10A, etc., management in the case of updating the learned model, etc., may become complicated. As such a countermeasure, the learned model is stored in the information processing server 20A, and the information processing server 20A is made to determine whether it is negative or positive. With this configuration, an increase in the load of the test terminal 10A is suppressed, and management in the case of updating the learned model, etc., becomes easy.

[0264] Furthermore, in the embodiment described above, the method for logging into the inspection management app may be any method. For example, login may be performed by entering a login ID and password. In this case, when creating an account in the inspection management app, the login ID and password of the person being tested are registered. When the inspection management app is launched, a screen for entering the login ID and password is displayed, and login is performed by entering the pre-registered login ID and password as instructed. In this case, if the entered login ID and password combination matches the pre-registered login ID and password combination, the login is successful and access to the inspection management app is permitted.

[0265] Alternatively, login may be performed using biometric authentication such as fingerprint or facial recognition. In this case, when creating an account in the testing management app, an image of the person being tested (such as a fingerprint or face) is registered. When the testing management app is launched, a screen for capturing a biometric image (such as a fingerprint or face) is displayed, and login is performed by capturing the biometric image of the person being tested according to the instructions. In this case, if image analysis or other means determines that the person whose biometric image was captured matches the person whose biometric image was captured, the login is successful and access to the testing management app is permitted.

[0266] Furthermore, the information processing system 1A may be configured to allow users, such as those being tested, to log in to the testing management app based on their login information for other services. These other services include, for example, membership-based reservation services like Jalan®, membership-based information services like Tabelog®, and social networking services (SNS) like Facebook®, which are application services that are expected to be used by a relatively large number of users. For example, a user can use the testing management app by enabling a function to connect to the testing management app after logging in to another service, or by selecting a button on the testing management app login screen that uses login information from another service. For example, an API (Application Programming Interface) may be used for the integration between the testing management app and other services.

[0267] Furthermore, in Figure 31 of the above-described embodiment, if button B32 is pressed without individual identification information being entered in input field N31, a list of inspection IDs for inspections received by the person being inspected may be displayed. In this case, the user terminal 30A sends only user information to the information processing server 20A. The information processing server 20A identifies the user ID by referring to the user DB 222A based on the user information received from the user terminal 30A. The information processing server 20A obtains the inspection ID associated with the user ID by referring to the inspection DB 220A based on the identified user ID. The information processing server 20A sends the obtained inspection ID to the user terminal 30A.

[0268] Alternatively, in Figure 31, if button B32 is pressed without individual identification information being entered in input field N31, the system may be configured to display the results of the most recent test taken by the person being tested. In this case, the user terminal 30A sends only user information to the information processing server 20A. The information processing server 20A identifies the user ID by referring to the user DB 222A based on the user information received from the user terminal 30A. The information processing server 20A obtains the test ID associated with the user ID by referring to the test DB 220A based on the identified user ID. The information processing server 20A refers to the test result DB 221A based on the obtained test ID and identifies the test ID with the most recent test date and time. The information processing server 20A sends the test results and test date and time for the identified test ID to the information processing server 20A.

[0269] Furthermore, in the information processing system 1A, the inspection result DB 221A and the user DB 222A may be stored in the same database (hereinafter referred to as the integrated DB). Even in this case, it is possible to realize the services related to the inspection management application without changing the processing performed by each of the inspection terminals 10A, user terminals 30A, and event venue terminals 40A.

[0270] In this case, for example, in step S14A of Figure 13, the information processing server 20A stores the inspection ID and inspection result received from the inspection terminal 10A in the integrated DB instead of storing them in the inspection result DB 221A. Also, in step S18A of Figure 13, the information processing server 20A stores the inspection ID and user information received from the user terminal 30A in the integrated DB instead of storing them in the user DB 222A.

[0271] Furthermore, in step S22A of Figure 14, the information processing server 20A determines whether or not to notify the user terminal 30A of the inspection results by referring to the integrated DB instead of referring to the user DB 222A based on the inspection ID received from the user terminal 30A. Also, in step S23 of Figure 14, the information processing server 20A obtains the inspection results by referring to the integrated DB instead of referring to the inspection result DB 221A based on the inspection ID.

[0272] Thus, even if the inspection results DB221A and user DB222A are stored in the same database, the information processing server 20A can perform the processing as described above to realize the services related to the inspection management application.

[0273] Specifically, (1) the inspection terminal 10A reads the two-dimensional code 102A and links the individual identification information with information about the inspection agency, (2) an inspection is performed using the test strip 100A, and (3) the inspection terminal 10A can link the inspection results with the individual identification information. In addition, (4) the inspector hands the inspection sticker to the person being inspected, and (6) the user terminal 30A can input the inspection ID and receive information indicating the inspection results from the information processing server 20A. Furthermore, (7) the person being inspected presents the information indicating the inspection results displayed on the user terminal 30A to the event venue, (8) the event venue terminal 40A obtains the inspection results of the person being inspected, and (9) the event venue terminal 40A determines whether the person being inspected meets the entry requirements for the event venue based on the inspection results.

[0274] Furthermore, although the above-described embodiment illustrates the use of test results obtained using the test strip 100A, it is not limited to this. Naturally, data indicating vaccination history may be used in the information processing system 1A along with, or in place of, the test results. The same methods as those applied to the test data can be applied to the data indicating vaccination history.

[0275] For example, the testing terminal 10A sends the vaccine type (vaccine ID) and vaccination history to the information processing server 20A instead of the testing ID and test result. The information processing server 20A stores the vaccine ID and vaccination history received from the testing terminal 10A in the testing result DB 221A. The user terminal 30A requests the vaccination history of the vaccine identified by that vaccine ID by sending the vaccine ID to the information processing server 20A. The information processing server 20A retrieves the vaccination history by referring to the testing result DB 221A based on the vaccine ID and notifies the user terminal 30A of the retrieved vaccination history.

[0276] The information processing system 1A and information processing server 20 in the above-described embodiment may be implemented in whole or in part by a computer. In that case, the program for implementing this function may be recorded on a computer-readable recording medium, and the program recorded on this recording medium may be loaded into the computer system and executed. Here, "computer system" includes hardware such as the OS and peripheral devices. Furthermore, "computer-readable recording medium" refers to portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, and storage devices such as hard disks built into the computer system. Moreover, "computer-readable recording medium" may also include media that dynamically hold programs for a short period of time, such as communication lines used when transmitting programs via networks such as the Internet or communication lines such as telephone lines, and media that hold programs for a certain period of time, such as volatile memory inside the computer system that acts as a server or client in that case. Furthermore, the above-mentioned program may be a program for implementing a part of the above-mentioned function, or it may be a program that can implement the above-mentioned function in combination with a program already recorded in the computer system, or it may be a program implemented using a programmable logic device such as an FPGA.

[0277] (Third embodiment) Embodiments of the present invention will be described below with reference to the drawings. In the following embodiments, components with the same configuration as in the first embodiment may be denoted by different reference numerals.

[0278] (Regarding Information Processing System 1) Figure 36 is a block diagram showing an example configuration of an information processing system 1B according to an embodiment. The information processing system 1B includes, for example, a test strip 100B, a user terminal 10B, and an information processing server 20B. The user terminal 10B and the information processing server 20B are connected to each other via a communication network NW.

[0279] Communication networks (NW) include various configurations for exchanging information, such as LANs (Local Area Networks), WANs (Wide Area Networks), telephone networks (mobile phone networks, fixed-line telephone networks, etc.), regional IP (Internet Protocol) networks, and the Internet.

[0280] In the information processing system 1B, the user terminal 10B captures an image of the test strip 100B. The user terminal 10B transmits the captured image (inspection image GB, described later) to the information processing server 20B. The information processing server 20B analyzes the inspection image GB to determine whether the test strip 100B indicates that the sample contains the substance to be tested (i.e., is positive). The information processing server 20B notifies the user terminal 10B of the determination result. Alternatively, all processing may be performed by the user terminal without using the telemedicine application described later. Specifically, the user terminal 10B may perform image analysis using an application program different from the telemedicine application (hereinafter referred to as the analysis application). In this case, the user terminal analyzes the captured images using the analysis application without sending them to the information processing server 20B. This makes it possible to analyze images without using telemedicine, that is, without using the information processing server 20B, and makes it possible for the user to know if they may be positive before visiting a medical institution.

[0281] (Regarding test strip 100B) Figure 37 shows an example of test strip 100B according to an embodiment. Test strip 100B is a test piece that is a component of a clinical diagnostic reagent. Clinical diagnostic reagents are used to test for the presence or absence of disease, and for example, they are used to test for the presence or absence of a test substance for diagnosing the presence or absence of disease using methods such as lateral flow assay (lateral flow method) and ELISPOT method. Lateral flow assays to which immunoassays are applied are sometimes specifically called immunochromatography. In addition, clinical diagnostic reagents may include a sample collection jig for collecting samples, an extraction solution, a detection reagent, a correction index, etc.

[0282] Figure 37 shows an example of a test strip 100B according to an embodiment, which is used in a lateral flow assay. The test strip 100B comprises, for example, a name tag 101B, a two-dimensional code 102B, a color-developing section 103B, and a supply section 104B.

[0283] Name tag 101B is a field where the name and other information of the person being tested are written. When mass testing is conducted in a hospital or other facility, the name tag 101B may be filled in with the name and other information of the person being tested by a medical professional such as a nurse or laboratory technician, or a sticker with the name and other information printed on it may be attached.

[0284] The two-dimensional code 102B is a two-dimensional code image into which the individual identification information of the test strip 100B is embedded. The individual identification information is information that uniquely identifies the test strip 100B, and may include, for example, the manufacturer's name, lot number, and manufacturing number of the test strip 100B, the object to be tested, the disease corresponding to the object to be tested, and the item of that disease. It is sufficient that the individual identification information can be identified on the test strip 100B by some means; for example, if the individual identification information is printed directly on the test strip 100B, the two-dimensional code 102B may be omitted.

[0285] The color-developing section 103B is the area where the results of the color reaction are displayed. The color reaction is a chemical reaction that causes a change in color or development of color when the sample contains the substance to be tested. The color-developing section 103B includes, for example, a control line 1030B and a test line 1031B. The control line 1030B is the area where a line appears when the sample supplied to the supply section 104B (described later) moves normally to the color-developing section 103B. The test line 1031B is the area where a line appears when the sample contains the target virus, antibody, etc. (substance to be tested). If there are multiple types of substances to be tested, multiple test lines 1031B corresponding to each substance to be tested may be provided in the color-developing section 103B.

[0286] The supply unit 104B is the area to which the sample is supplied. The supply unit 104B includes, for example, a sample supply window 1040B. For example, the sample is supplied to the supply unit 104B when the sample of the person to be tested is supplied to the sample supply window 1040B.

[0287] (Regarding the specimen) In this embodiment, the specimen is a sample taken from the person being tested, such as mucus collected by swabbing the throat with a cotton swab. The specimen is preferably a liquid and may include, for example, peripheral blood, serum, plasma, ascites, urine, cerebrospinal fluid, sputum, saliva, bone marrow, synovial fluid, aqueous humor, amniotic fluid, earwax, breast milk, bronchoalveolar lavage fluid, semen, prostatic fluid, Cowper's fluid or preejaculatory fluid, sweat, feces, hair, tears, cystic fluid, pleural fluid or ascites, pericardial fluid, lymph fluid, erosion, chyle, bile, interstitial fluid, menstrual secretions, pus, sebum, vomit, vaginal secretions, mucosal secretions, watery stool, pancreatic juice, nasal secretions, pharyngeal secretions, nasal swab fluid, pharyngeal swab fluid, nasal lavage fluid, bronchopulmonary aspirate, blastocyst fluid, umbilical cord blood, etc., and may contain substances that serve as indicators for diagnosing diseases.

[0288] (Regarding the objects to be inspected) In this embodiment, the object to be tested is a substance that is tested for with a clinical diagnostic reagent. For example, the object to be tested may be a single substance (object) or a complex of such substances (objects), such as cells, bacteria, viruses, exosomes, nucleic acids, polypeptides (including antigens and antibodies), polynucleotides, lipids, phospholipids, carbohydrates, polysaccharides, glycoproteins, low molecular weight compounds, metabolites from cells or bacteria, and fragments of bacteria or viruses, exosomes, etc.

[0289] (Regarding the disease) This refers to diseases, and typical classifications include cancer, hypertension, diabetes, heart disease, cerebrovascular disease, neuropsychiatric disorders, immune and allergic diseases, and infectious diseases.

[0290] (Regarding the disease section) The disease categories further subdivide the above-mentioned diseases, including their causes, metabolites, and phenomena. For example, the disease categories include coronavirus, influenza, adenovirus, RSV, rotavirus, hepatitis B virus, hepatitis C virus, HIV, herpesvirus, norovirus, human metapneumovirus, group A beta-hemolytic streptococcus, Helicobacter pylori, Treponema pallidum, Mycoplasma, Clostridium difficile, Mycobacterium, E. coli O157, E. coli verotoxin, Streptococcus pneumoniae, Legionella, procalcitonin, Chlamydia, Neisseria gonorrhoeae, allergic conjunctivitis, luteinizing hormone (LH), human chorionic gonadotropin (HCG), BNP, NT-proBNP, CK-MB, myoglobin, troponin, D-dimer, H-FABP, granulocyte elastase, carcinoembryonic antigen (CEA), fecal occult blood, insulin-like growth factor binding protein, fFN, allergy tests, CRP, anti-CCP antibody, etc.

[0291] (Regarding user terminal 10B) Figure 3 is a block diagram showing an example configuration of the user terminal 10B according to the embodiment. The user terminal 10B is the computer of the person being examined (user) and is operated by the user. The user may be a patient using telemedicine. The user terminal 10B can be implemented as, for example, a smartphone, tablet, mobile phone, or PC (Personal Computer).

[0292] The user terminal 10B has an application (referred to as the telemedicine app) installed that the user operates when receiving telemedicine services. The telemedicine app is a program that enables telemedicine by the information processing system 1B. Of course, the functionality equivalent to the telemedicine app may also be implemented by a web browser. In this case, the user terminal 10B accesses a site identified by a predetermined URL (Uniform Resource Locator) or the like via the web browser. Then, operations related to telemedicine are performed according to the instructions on the screen provided by the accessed site.

[0293] As shown in Figure 3, the user terminal 10B includes, for example, a communication unit 11B, a storage unit 12B, a control unit 13B, a display unit 14B, an input unit 15B, and an imaging unit 16B. The communication unit 11B communicates with the information processing server 20B.

[0294] The storage unit 12B is composed of storage media such as HDD (Hard Disk Drive), flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), RAM (Random Access read / write Memory), ROM (Read Only Memory), or a combination thereof. The storage unit 12B stores programs for executing various processes of the user terminal 10B (for example, programs related to telemedicine applications), and temporary data used when performing various processes. The program stored in the memory unit 12B may include an application program different from the telemedicine application (an analysis application). Here, it is assumed that the analysis application is a native application, that is, an application program that operates by being installed on a terminal (such as the user terminal 10B), but this is not limited to that. The analysis application may be a program implemented as a web application. Here, a web application refers to an application program that runs through a web browser.

[0295] The display unit 14B includes, for example, a display device such as a liquid crystal display, and displays an image in accordance with the control unit 13B. The input unit 15B includes, for example, an input device such as a mouse or keyboard, and outputs information operated by the user to the control unit 13B. The imaging unit 16B includes, for example, an imaging device such as a digital camera, and performs imaging in accordance with the control unit 13B.

[0296] The control unit 13B is implemented by causing the CPU (Central Processing Unit) provided as hardware in the user terminal 10B to execute a program. The control unit 13B comprehensively controls the user terminal 10B. For example, the control unit 13B controls the display unit 14B and the imaging unit 16B according to the program related to the telemedicine application.

[0297] The control unit 13B executes processing according to the program of the telemedicine application. For example, in response to user input, the control unit 13B launches the telemedicine application when the telemedicine application icon is tapped. As a result, for example, the operation screen of the telemedicine application is displayed on the display unit 14B. The operation screen displays several operation buttons, such as "Capture examination image GB" and "Log out". When the user taps the operation button labeled "Capture examination image GB", the control unit 13B launches the imaging unit 16B and displays the imaging screen for capturing examination image GB.

[0298] The control unit 13B includes, for example, an imaging control unit 130B and an image processing unit 131B. The imaging control unit 130B controls the imaging of the inspection image GB. Specifically, when the inspection image GB is being captured, the imaging control unit 130B displays the imaging area on the display unit 14B. For example, the user views the imaging area displayed on the display unit 14B and adjusts the imaging direction and distance to the subject so that the imaging area includes the area (coloring area) that is colored by the coloring unit 103B. This makes it possible to capture an image containing the coloring area of ​​the test strip 100B as the inspection image GB.

[0299] Furthermore, the imaging control unit 130B may identify the colored areas included in the imaging area and process the imaging area based on the identified colored areas. For example, when the test strip 100B is photographed with a smartphone, the image file is often saved in the red-green-blue (RGB) space. The imaging control unit 130B converts such an image file saved in the RGB space to a color space different from the RGB space. A color space different from the RGB space may be, for example, the hue-saturation-value (HSL) space, the hue-saturation-value (HSV) space, or the white-black (grayscale) space. The imaging control unit 130B may convert an image file saved in the RGB space to any of the HSL space, HSV space, or grayscale space. For example, when an image file saved in the RGB space is converted to the HSL space or HSV space, noise is appropriately removed depending on the imaging environment. For example, when an image file saved in the RGB space is converted to the grayscale space, the color information in the image can be simplified to make it less susceptible to color influences.

[0300] Alternatively, the imaging control unit 130B may identify the colored area included in the imaging region and display a frame surrounding the identified colored area. This makes it easier to identify the colored area in the examination image GB and to determine whether or not the result is positive.

[0301] Alternatively, the imaging control unit 130B may display a guide on the display unit 14B that shows the outline of the coloring unit 103B. This makes it possible to standardize the orientation and size of the coloring area in the test image GB, making it easier to determine whether the result is positive or negative. Furthermore, it is possible to suppress variations in the imaging method when the user images the test strip 100B, for example, variations in the orientation and size of the coloring area in the test image GB, making it easier to determine whether the result is positive or negative.

[0302] Here, a concealing jig may be used when acquiring the inspection image GB. The concealing jig is a jig that physically covers the parts of the test strip 100B that are different from the color-developing part 103B. In other words, the concealing jig conceals everything except the color-developing part 103B. For example, the concealing jig is a piece of cardboard with a window. The user physically covers the parts different from the color-developing part 103B by placing the cardboard on top of the test strip 100B so that the color-developing part 103B is visible through the window of the cardboard. Then, with the concealing jig placed on the test strip 100B, the user operates the imaging unit 16B to acquire an image of the test strip 100B. This allows for the capture of an image GB in which the colors of areas other than the colored area are obscured. This simplifies the color information of areas other than the colored area in the inspection image GB, making the color of the colored area less susceptible to the influence of colors in other areas, and enabling accurate determination of whether the result is positive or negative. Furthermore, if the test strip 100B includes a name tag 101B or a two-dimensional code 102B, the information contained therein differs from one individual to another. In this case, various pieces of information displayed in areas other than the colored area may act as noise, potentially reducing the accuracy of the determination. To address this, in this embodiment, the concealing jig is configured to obscure this information that differs from one individual to another. This makes it possible to remove information displayed in areas other than the colored area in the inspection image GB. Therefore, it is possible to accurately determine whether the result is positive or negative by making it less susceptible to the influence of areas other than the colored area. Additionally, the concealing jig may have color correction indicators or angle correction indicators printed on it.

[0303] The image processing unit 131B performs image processing on the image captured by the imaging unit 16B. The image processing unit 131B performs image processing to approximate what the judgment model, described later, has learned. For example, if the judgment model is a model that has learned using grayscale images, but the imaging unit 16B captures a color image, the image processing unit 131B performs image processing to convert the image's color to grayscale.

[0304] For example, if the judgment model is a model trained on image files of format 1, but the imaging unit 16B captures an image of format 2, the image processing unit 131B performs image processing to convert the image file format from format 2 to format 1.

[0305] For example, if the judgment model is trained on images in which only the colored region is captured, but the imaging unit 16B captures an image that includes regions other than the colored region, the image processing unit 131B performs a trimming process to cut out the regions other than the colored region. In this case, an image that includes regions other than the colored region is, for example, an image of the entire test strip 100B or an image that includes the stand on which the test strip 100B is placed.

[0306] Furthermore, the image processing unit 131B may perform image processing to transform the shape of the image as needed. Image processing to transform the shape of the image includes, for example, processing to rotate the image and processing to enlarge the color area. Image processing to transform the shape of the image may also include processing to move (shift) the color area in the horizontal or vertical direction, horizontal flipping processing to flip the image with respect to the axis of symmetry along the vertical direction, and vertical flipping processing to flip the image with respect to the axis of symmetry along the horizontal direction. Trapezoidal correction may also be included in the image processing to transform the shape of the image, and angle correction indicators may be used. The angle correction index can be applied directly to the test strip 100B, or it may be used to apply the color correction index captured in the same inspection image when the inspection image is acquired by the imaging unit. For example, when imaging the test strip, a sheet of paper with the color correction index printed on it can be prepared, and the color correction index on that paper can also be imaged at the same time to perform color correction.

[0307] Furthermore, the image processing unit 131B may perform image processing to convert the color of the image as needed. In this case, for example, the image processing unit 131B may convert the color of the image by converting the color information of each pixel in the image using a pre-created conversion table, or it may utilize a color correction index. When using color correction indicators, for example, a color correction indicator (e.g., a color correction patch, color code, etc.) is attached to the test strip 100B, and imaging is performed so that the color correction indicator is included in the inspection image G. Examples of color codes used as color correction indicators include cyan, magenta, yellow, black, blue, green, red, and grayscale. Not only single colors, but also combinations of multiple color codes may be used, and the intensity of the control line 1030 and test line 1031 may be determined by comparing them with the intensity of the control line 1030 and test line 1031 using a color gradient. Color correction indicators can be applied directly to the test strip 100B, or they can be used when acquiring the inspection image with the imaging unit, by capturing the same inspection image. For example, when imaging the test strip, a sheet of paper with color correction indicators printed on it can be prepared, and the color correction indicators on that paper can also be imaged simultaneously, and color correction can be performed. In addition to the test strip 100B, other items to prepare may include a concealment jig (a jig that covers or holds the test strip 100B and hides areas other than the display area to be imaged) or a holding jig.

[0308] The control unit 13B transmits the image captured by the imaging unit 16B, after the necessary image processing has been performed by the image processing unit 131B, to the information processing server 20B as the inspection image GB. For example, the control unit 13B displays an operation button labeled "Send Image". When the user taps "Send Image", the control unit 13B transmits the inspection image GB to the information processing server 20B via the communication unit 11B.

[0309] (Regarding the information processing server 20B) The information processing server 20B is the computer of the person being tested. The information processing server 20B can be implemented using, for example, a cloud device, a server device, or a PC. The information processing server 20B is, for example, a server device that operates a website related to a telemedicine application.

[0310] Figure 39 is a block diagram showing an example configuration of an information processing server 20B according to an embodiment. The information processing server 20B includes, for example, a communication unit 21B, a storage unit 22B, and a control unit 23B. The communication unit 21B communicates with the user terminal 10B.

[0311] The storage unit 22B is composed of a storage medium such as an HDD, flash memory, EEPROM, RAM, or ROM, or a combination thereof. The storage unit 22B stores programs for executing various processes of the information processing server 20B, and temporary data used when performing various processes. The storage unit 22B stores judgment model information 220B and inspection result information 221B.

[0312] The decision model information 220B is information that indicates the decision model, which is a trained model. For example, if the decision model is a CNN, the decision model information 220B includes information such as the number of units in each layer (input layer, hidden layer, output layer), the number of layers in the hidden layer, and the activation function.

[0313] The judgment model is a trained model that has learned the correspondence between images and positive results by performing machine learning using a training dataset. The training dataset is information in which training images are paired (sets) with codes indicating whether or not a positive result is shown in the colored region of the training image. In this embodiment, the training images are images taken of an unspecified test strip (test piece) so as to include the colored region of that test strip. The judgment model is generated, for example, by repeatedly learning the correspondence until it can accurately estimate the degree to which a positive result is shown in the input image. When an untrained image (e.g., test image GB) is input to the judgment model, it estimates the degree to which a positive result is shown in that image and outputs the estimation result.

[0314] The training images used to train the judgment model include multiple images of the same subject taken in different imaging environments. For example, the training images include images of the same test strip 100B taken under different lighting conditions, such as fluorescent and incandescent lamps, each with different spectral emission characteristics. Furthermore, the training images include images of the same test strip 100B taken using different types of imaging devices, such as those with different color resolutions. Additionally, the training images include images of the same test strip 100B taken from different imaging directions. By using a judgment model trained with training images containing multiple images of the same subject taken in different imaging environments, it becomes possible to accurately determine the degree to which an image is positive when an inspection image GB taken in various imaging environments is input.

[0315] Furthermore, the training images used to train the judgment model include multiple images with different concentrations of the test substance supplied to the test strip (hereinafter referred to as "substance concentration"). Generally, when a sample with a high concentration of the test substance is supplied, a dark and clear line indicating a positive result appears on test line 1031B. On the other hand, when a sample with a low concentration of the test substance is supplied, a faint and blurry line indicating a positive result appears, or the line indicating a positive result is not visible to the naked eye. Furthermore, a group of images may contain only one image of a certain density, or it may contain multiple images of a certain density.

[0316] Here, when the sample is supplied to the test strip 100B, the test material in the sample binds to the color-developing particles. The color-developing particles are particles that absorb or reflect light, making the test material visible as a line when it moves onto the test line 1031B. Next, the liquid sample moves through the solid membrane. At this time, the test material in the sample moves from the supply unit 104B towards the color-developing unit 103B, reaching the position where the control line 1030B and the test line 1031B are indicated. Simultaneously, the color-developing particles that did not bind to the test material are gradually adsorbed onto the membrane and move from the supply unit 104B towards the color-developing unit 103B, reaching an area beyond the control line 1030B. This means that the color-developing particles are gradually adsorbed throughout the entire color-developing area as background. If a sample with a high concentration of the test material is supplied, a sufficient amount of the test material will reach the test line 1031B. Therefore, a dark, clear line visible to the naked eye appears on test line 1031B. On the other hand, when a sample with a low concentration of the target substance is supplied, a small amount of the test substance reaches test line 1031B. As a result, a clear, dark line does not appear on test line 1031B, making it difficult to distinguish test line 1031B from the surrounding area. This makes it difficult to determine whether the sample has moved to test line 1031B properly. This situation is considered to be one of the reasons why it is difficult to determine whether a sample is positive or negative when a sample with a low concentration of the target substance is supplied.

[0317] It is desirable to be able to make accurate judgments even when the test material supplied has a concentration so low that it is not visible to the naked eye. To address this, in this embodiment, a judgment model trained using training images that include multiple images of the test material supplied to the test strip with different concentrations is used. It is particularly desirable that the multiple images of the test material with different concentrations include images corresponding to cases where the concentration of the material is so low that a line indicating a positive result cannot be seen with the naked eye. This makes it possible for the judgment model to make accurate judgments even when it is difficult to determine whether the result is positive or negative with the naked eye.

[0318] Furthermore, the composition of training images may be determined according to the target that the judgment model is expected to judge accurately. For example, the number of low-density images in the training images may be made larger than the number of high-density images. Here, low-density images correspond to samples supplied with a concentration of the target substance that is too low to be seen with the naked eye. High-density images correspond to samples supplied with a concentration of the target substance that is high enough to be seen with the naked eye. This makes it possible to generate a judgment model that can accurately determine whether or not an image shows positivity, even if it is a low-density image.

[0319] Here, we will explain situations where it is necessary to accurately determine whether a test result is positive, even in low-density images. For example, if the substance being tested is a highly infectious virus, even a small amount of the virus present in the body of the user who provided the sample could infect others. Therefore, in situations where it is necessary to efficiently identify users who may potentially infect others, it is required to accurately determine whether a test result is positive, that is, whether the sample contains the substance being tested, even in low-density images.

[0320] Furthermore, the judgment model may estimate not only whether the image shows a positive result, but also the concentration of the substance contained in the sample. In this case, the judgment model is a trained model that has learned the correspondence between images and substance concentrations. The training dataset contains information in which training images are paired (sets) with codes representing the substance concentration in the training images. The judgment model may be a model that estimates whether the image shows a positive result and the substance concentration based on the image, or it may consist of two trained models: a first model that estimates whether it is positive or not, and a second model that estimates the substance concentration. Also, the judgment model may estimate the substance concentration in addition to whether the image shows a positive result, or it may estimate only the substance concentration.

[0321] The test result information 221B is information indicating the judgment result based on the test image GB. The judgment result is the result of determining whether or not a positive result is shown in the color-developing area 103B captured as the test image GB. The judgment result may also be information indicating the degree to which a positive result is shown in the test image GB. For example, if the judgment model is a model that estimates the degree to which the input test image GB shows a positive result, the system may be configured to store information indicating the degree to which the test image GB output by the judgment model shows a positive result as the judgment result. In addition, the test result information 221B may store the test result and the test image GB in association.

[0322] The control unit 23B is implemented by having the CPU, which is provided as hardware in the information processing server 20B, execute a program. The control unit 23B comprehensively controls the information processing server 20B. The control unit 23B includes, for example, an acquisition unit 230B, an image processing unit 231B, a determination unit 232B, and a device control unit 233B.

[0323] The acquisition unit 230B acquires the inspection image GB notified from the user terminal 10B via the communication unit 21B. The acquisition unit 230B outputs the acquired inspection image GB to the image processing unit 231B.

[0324] The image processing unit 231B performs image processing on the inspection image GB. The processing performed by the image processing unit 231B is the same as that performed by the image processing unit 131B, so its explanation is omitted. For example, the image processing unit 231B performs image processing on the inspection image GB on behalf of the image processing unit 131B of the user terminal 10B. This reduces the processing load on the user terminal 10B. The image processing unit 231B outputs the inspection image GB, which has undergone image processing as needed, to the determination unit 232B. Specifically, if image processing is not required, the image processing unit 231B outputs the inspection image GB itself, which it acquired, to the determination unit 232B. If image processing is required, the image processing unit 231B outputs the image obtained from the image processing unit 231B, which has undergone the necessary image processing, to the determination unit 232B.

[0325] The determination unit 232B uses a determination model to determine whether a colored region in the image acquired from the image processing unit 231B is positive or negative. Based on the estimation results obtained by inputting the image into the determination model, the determination unit 232B determines whether a positive result is indicated in the image. For example, if the estimation result output from the determination model indicates that the degree of positivity in the image is above a threshold, the determination unit 232B determines that a positive result is indicated in the colored region of the image. For example, if the estimation result output from the determination model indicates that the degree of positivity in the image is below a threshold, the determination unit 232B determines that a negative result is indicated in the colored region of the image. As thresholds, values ​​such as 50%, 75%, 90%, 95%, 98%, and 99% are set depending on the situation. In the above example, the determination unit 232B determines whether the image is positive or negative based on the degree to which the image shows positivity, but this is not the only example. The determination model may be configured to output either positive or negative based on the degree to which the image shows positivity. In this case, the determination unit 232B simply adopts the result of either positive or negative output by the determination model.

[0326] Furthermore, the determination unit 232B may determine whether the result is positive or negative, or whether it is neither positive nor negative and therefore undeterminable, rather than simply determining whether it is positive or negative. For example, the determination unit 232B determines that a positive result is indicated in the colored region of the image if the estimation result output from the determination model indicates that the degree to which positivity is indicated in the image is equal to or greater than a first threshold. The determination unit 232B determines that the colored region in the image is negative if the estimated result output from the determination model indicates that the degree to which the image is positive is less than the second threshold, which is less than the first threshold. If the estimated result output from the determination model indicates that the degree to which the image is positive is greater than or equal to the second threshold but less than the first threshold, the determination unit 232B determines that neither positive nor negative is indicated in the colored region in the image, i.e., it is impossible to determine. The determination model may be configured to output either positive, negative, or impossible to determine based on the degree to which the image is positive.

[0327] The determination unit 232B stores the determination result in the test result information 221B. The determination unit 232B may also store the test image GB and the degree to which the image shows positivity in the test result information 221B along with the determination result. Furthermore, if the determination model estimates the concentration of the target substance, the determination unit 232B may also store the concentration of the test subject as a test result in the test result information 221B.

[0328] The device control unit 233B comprehensively controls the information processing server 20B. For example, the device control unit 233B outputs the inspection image GB received by the communication unit 21B to the acquisition unit 230B. The device control unit 233B may also transmit the judgment result to the user terminal 10B via the communication unit 21B.

[0329] In this embodiment, the estimated result predicted by the judgment model, that is, the degree of positivity, is not stored in the test result information 222B, but rather either "positive" or "negative," or either "positive," "negative," or "undeterminable." This allows general users, who are neither medical professionals nor AI experts, to easily understand the test results.

[0330] Figure 40 is a sequence diagram showing the processing flow of the information processing system 1B according to the embodiment. First, the user performs an operation to launch the telemedicine application on the user terminal 10B (step S100). The user terminal 10B launches the telemedicine application in response to the user's launch operation and displays an imaging screen for imaging the test strip 100B (step S101). The test strip 100B here is a test strip after testing, on which the sample of the person being examined has been supplied. The user views the imaging screen displayed on the user terminal 10B, adjusts the imaging area to include the color development unit 103B, and performs the imaging operation (step S102). The user terminal 10B performs imaging with the imaging unit 16B in response to the user's imaging operation and acquires image information of the examination image GB (step S103). The user terminal 10B determines whether or not to perform image processing on the examination image GB (step S104). If the user terminal 10B determines that it is necessary to perform image processing on the inspection image GB, it performs the necessary image processing (step S105) and sends the processed inspection image GB to the information processing server 20B (step S106). On the other hand, if the user terminal 10B determines that it is not necessary to perform image processing on the inspection image GB, it sends the inspection image GB to the information processing server 20B without performing any image processing.

[0331] The information processing server 20B receives the inspection image GB, etc. (step S107). The information processing server 20B determines whether or not to perform image processing on the received inspection image GB (step S108). If the information processing server 20B determines to perform image processing on the inspection image GB, it performs the necessary image processing (step S109) and uses a determination model to determine whether the processed inspection image GB indicates positive, negative, or undeterminable (step S110). On the other hand, if the information processing server 20B determines not to perform image processing on the inspection image GB, it uses a determination model to determine whether the unprocessed inspection image GB indicates positive, negative, or undeterminable. The information processing server 20B may also determine that the inspection image GB is undeterminable if its brightness is below a threshold. In this case, in step S107, the information processing server 20B determines whether or not the brightness of the received inspection image GB is above the threshold. The brightness of the inspection image GB here refers to, for example, the average value of the pixel values ​​in the color region. The information processing server 20B determines that a determination is not possible if the brightness of the inspection image GB is below the threshold. In this case, the information processing server 20B does not execute the processes shown in steps S108 to S110.

[0332] The information processing server 20B determines whether the result is negative, positive, or something else (undeterminable) (step S111). If the result is "undeterminable", the information processing server 20B notifies the user terminal 10B accordingly. The user terminal 10B displays an imaging error in response to the notification from the information processing server 20B (step S112). The imaging error may include a message prompting the user to image the test strip 100B again, as it is not possible to determine whether the image is negative or positive from the imaged image. The user views the imaging error and, if they wish to perform imaging again, returns to step S102 to perform the imaging operation. In step S112, the information processing server 20B may also notify the user terminal 10B that the result is "undeterminable" and provide suggestions regarding the imaging environment. In this case, the user terminal 10B will either simply display a message prompting re-imaging, or a message that includes a suggestion regarding the imaging environment, such as "Please take the image in a brighter location" if the inspection image GB is not bright enough to make a judgment.

[0333] On the other hand, if the result in step S111 is negative or positive, the information processing server 20B confirms the result (step S113). The information processing server 20B sends the confirmed result to the user terminal 10B. The user terminal 10B displays the result received from the information processing server 20B (step S114).

[0334] (Modification of Embodiment 1) Figure 41 is a sequence diagram showing the processing flow of the information processing system 1B according to the modified embodiment 1. This modified embodiment differs from the embodiment described above in that it performs image processing during imaging and captures the image after image processing. The image processing performed during imaging here is a process that converts the color in a region other than the color region to a single color (for example, white).

[0335] Steps S200 to S201 shown in Figure 41 are the same as steps S100 to S101 shown in Figure 40, so their explanation is omitted. Steps S203 to S215 shown in Figure 41 are the same as steps S102 to S114 shown in Figure 40, so their explanation is omitted. In other words, step S202 will be explained here.

[0336] The user terminal 10B displays the imaging area and acquires an image representing the imaging area. Based on the acquired image, the user terminal 10B identifies the colored areas included in the imaging area and converts the colors of areas different from the identified colored areas to a single color (e.g., white). (Step S202). The user terminal 10B displays an image in which the colors of areas different from the colored areas have been converted to a single color.

[0337] In this modified example, a concealing jig may be used. When a concealing jig is used, the user images the test strip 100B with the concealing jig installed. In this case, the user terminal 10B may omit image processing during imaging. Alternatively, the user terminal 10B may determine whether or not a concealing jig is installed and display a warning if it is not installed. Furthermore, a two-dimensional code containing an individual identification number may be printed at a specific location on the concealing jig. In addition, color correction indicators may be printed on the test strip 100B, and in this case, they can be used for color correction.

[0338] (Modified embodiment 2) Figure 42 is a sequence diagram showing the processing flow of the information processing system 1B according to the modified embodiment 2. This modified embodiment differs from the embodiment described above in that multiple images (for example, a video) with different imaging positions are captured, and the image selected from the multiple images is transmitted to the information processing server 20B.

[0339] Step S300 shown in Figure 42 is the same as step S100 shown in Figure 40, so its explanation is omitted. Steps S305 to S315 shown in Figure 42 are the same as steps S104 to S114 shown in Figure 40, so their explanation is omitted. In other words, steps S301 to S302 and S303 to S304 will be explained here.

[0340] The user terminal 10B launches the telemedicine application in response to a user activation operation and displays a video imaging screen for capturing images of the test strip 100B (Step S301). At this point, the user terminal 10B may also display a message such as "Please capture a video while changing the imaging position." The user views the imaging screen displayed on the user terminal 10B and performs an operation to capture multiple images, for example, by moving the user terminal 10B diagonally from above the test strip 100B (Step S302). The user terminal 10B captures images using the imaging unit 16B in response to the user's video imaging operation and acquires image information for multiple images (Step S303). The user terminal 10B selects one image from the acquired multiple images as the examination image GB (Step S304). The user terminal 10B selects an image that can be accurately judged, for example, according to the state of the colored areas captured in each image. The user terminal 10B selects an image as the inspection image GB in which the entire color-developing area is captured and the color-developing area is captured with the correct color. For example, the user terminal 10B compares the color information of the background (non-color-developing area) of the color-developing part 103B of each of the multiple images with predetermined reference color information, and selects the image with the smallest difference from the reference color information as the inspection image GB. The reference color information here is, for example, the color information of the background captured under illumination by a standard light source with a known spectral irradiance.

[0341] (Modification of Embodiment 3) Figure 43 is a sequence diagram showing the processing flow of the information processing system 1B according to the modified embodiment 3. This modified embodiment differs from the above-described embodiment in that multiple images (for example, a video) with different imaging positions are captured, each of the multiple images is transmitted to the information processing server 20B, and the image to be used for determination is selected by the information processing server 20B.

[0342] Steps S400 to S403 shown in Figure 43 are the same as steps S300 to S303 shown in Figure 42, so their explanation will be omitted. Steps S404 to S405 and S409 to S415 shown in Figure 43 are the same as steps S305 to S306 and S309 to S315 shown in Figure 42, so their explanation will be omitted. In other words, steps S406 to S408 will be explained here.

[0343] The user terminal 10B transmits each of the multiple images captured in step S403 to the information processing server 20B (step S406). The information processing server 20B receives the multiple images from the user terminal 10B (step S407) and selects one image from the received multiple images as the examination image GB (step S408). The method by which the information processing server 20B selects one image is the same as the method performed by the user terminal 10B in step S304, so the explanation is omitted.

[0344] (Modification of Embodiment 4) Figure 44 is a sequence diagram showing the processing flow of the information processing system 1B according to the modified embodiment 4. This modified embodiment differs from the embodiment described above in that multiple images (for example, a video) with different imaging positions are captured, and a determination is made for each of the multiple images.

[0345] Steps S500 to S507 shown in Figure 44 are the same as steps S400 to S407 shown in Figure 43, so their explanation will be omitted. Steps S512 to S515 shown in Figure 44 are the same as steps S412 to S415 shown in Figure 43, so their explanation will be omitted. In other words, steps S508 to S511 will be explained here.

[0346] The information processing server 20B determines whether or not to perform image processing on each of the multiple images received from the user terminal 10B (step S508). If the information processing server 20B determines that image processing should be performed, it performs the necessary image processing (step S509) and determines whether the processed image indicates positive, negative, or undeterminable (step S510). On the other hand, if the information processing server 20B determines that no image processing is to be performed, it determines whether the image itself is positive, negative, or undeterminable based on the unprocessed image. Based on the determination results of each of the multiple images, the information processing server 20B determines whether the subject (test strip 100B) is positive, negative, or undeterminable. For example, the information processing server 20B determines that the most frequent determination result among the multiple images is the determination result for that subject. For example, if 13 out of 15 images are determined to be positive, the information processing server 20B determines that the subject is positive.

[0347] Alternatively, the information processing server 20B may determine the determination result for a subject as "undeterminable" if the proportion of the most frequent determination result among multiple images is less than a threshold. In this case, for example, if the threshold is set to 1 / 2 and 7 out of 15 images are determined to be positive, 5 to be undeterminable, and 3 to be negative, the information processing server 20B determines that the proportion of images determined to be positive out of all images (7 / 15) is less than the threshold (1 / 2), and determines the determination result for that subject as "undeterminable".

[0348] As described above, the information processing system 1B of the embodiment is a system that processes information related to testing using a test piece that exhibits a color depending on whether or not the sample contains the object to be tested. The information processing system 1B includes, for example, an imaging unit 16B and a determination unit 232B. The imaging unit 16B images the test strip 100B, which is the subject, so as to include the color-exposing area 103B (the color-exposing region where color is exhibited) on the test strip 100B. The determination unit 232B determines whether or not the color-exposing area 103B is positive based on the image captured by the imaging unit 16B. The determination model is a trained model that has learned the correspondence between images and positive results by performing machine learning on a training dataset in which training images, which are captured so as to include the color-exposing area 103B on an unspecified test strip 100B, are labeled with a code indicating whether or not the color-exposing area 103B in the training image is positive. The determination model estimates the degree to which the input image is positive based on the pre-learned correspondence and outputs the estimated result. The training images used by the determination model include multiple images of the same subject captured in different imaging environments. As a result, the information processing system 1B of this embodiment can accurately determine the degree to which an image shows positivity when an examination image GB taken in various imaging environments is input.

[0349] Here, test strip 100B is an example of a "test specimen." Colored area 103B is an example of a "colored region."

[0350] Furthermore, in the information processing system 1B of this embodiment, the training images learned by the judgment model include multiple images with different concentrations of the test object supplied to the test strip 100B. As a result, in the information processing system 1B of this embodiment, the judgment model can make an accurate determination even when it is difficult to determine whether the result is positive or negative with the naked eye.

[0351] Furthermore, in the information processing system 1B of this embodiment, the image processing unit (at least one of the image processing unit 131B and the image processing unit 231B) may be configured to convert information indicating the color of an image captured by the imaging unit 16B from information using a first color space to information using a second color space different from the first color space. The image processing unit may also be configured to convert the file format of an image captured by the imaging unit 16B. Furthermore, in the information processing system 1B of this embodiment, the image processing unit (at least one of the image processing unit 131B and the image processing unit 231B) may be configured to perform image processing to crop the coloring unit 103B in the image captured by the imaging unit 16B. As a result, in the information processing system 1B of this embodiment, when the image learned by the judgment model and the inspection image GB are different, the judgment model can be made to approach the learned content, and a positive or negative determination can be made with high accuracy.

[0352] Furthermore, in the information processing system 1B of this embodiment, the determination unit 232B determines whether the image shows a positive result, a negative result, or whether it is undeterminable (neither positive nor negative). If the determination unit 232B determines that it is undeterminable, it instructs the imaging unit 16B to image the subject again. Thus, in the information processing system 1B of this embodiment, if the determination is undeterminable, it is possible to perform imaging again.

[0353] Furthermore, in the information processing system 1B of this embodiment, the judgment model may output information indicating whether or not the input image shows a positive result. This allows a typical user to easily understand the results output by the judgment model. Furthermore, in the information processing system 1B of this embodiment, the training dataset may be configured to include a positive or negative code for each training image, and the concentration of the test substance contained in the sample in the training image. In this case, the judgment model is a trained model that has learned the correspondence between images and concentrations. The judgment model estimates the concentration of the test substance contained in the sample in the input image based on the learned correspondence. In other words, the judgment model estimates the concentration of the test substance contained in the sample supplied to the test strip 100B in the input image. As a result, the information processing system 1B of this embodiment can estimate the concentration of the test substance contained in the sample. Note that the input image may include a color correction index or an angle correction index. Furthermore, in the information processing system 1B of this embodiment, the training images include multiple images captured under illumination with different spectral emission characteristics. This makes it possible for the information processing system 1B of this embodiment to accurately determine the degree to which an image is positive when an inspection image GB captured in an environment illuminated with various illumination lights is input.

[0354] Furthermore, the information processing system 1B may perform a preliminary check to determine whether the image is undetectable or undetectable depending on the imaging environment in which the image was captured, before determining whether it is positive or negative. For example, the control unit 13B determines whether the image captured by the imaging unit 16B is difficult to use for determining whether it is positive or negative. For example, the control unit 13B determines that an image in which the color development unit 103B is not captured, or an image in which the color development unit 103B is out of focus, is an image that is difficult to use for determining whether it is positive or negative. If the control unit 13B determines that the image captured by the imaging unit 16B is an image that is difficult to use for determining whether it is positive or negative, it displays a message prompting the user to re-capture the image. Alternatively, the information processing server 20B may be configured to perform a pre-check. In this case, the user terminal 10B transmits the image captured by the imaging unit 16B to the information processing server 20B. The user terminal 10B performs a pre-check on the image received from the user terminal 10B, and if the image captured by the imaging unit 16B is difficult to use for determining whether it is positive or negative, it sends a notification to the user terminal 10B prompting it to take another image.

[0355] When a user takes an image of the test strip 100B with their smartphone, the control unit 13B may prompt the user to retake the image depending on the state of the captured image (for example, if there is a shadow in the captured image). This allows the control unit 13B to determine, based on the fingers and background in the image captured by the user, whether or not the image has been captured and sent to the information processing server in the past, and if it has been sent in the past, it can prompt the user to retake the image.

[0356] Alternatively, a judgment model may be trained using images taken with multiple smartphones from different equipment manufacturers and with different OS versions of user terminals (e.g., smartphones). By inputting these images into the judgment model, it may be possible to determine whether or not a positive result is indicated.

[0357] Furthermore, in the information processing system 1B according to the modified embodiment 1, the imaging control unit 130B displays the imaging area captured by the imaging unit 16B. The imaging control unit 130B identifies the color-producing area 103B included in the imaging area and converts the color of areas different from the identified color-producing area 103B into a single color. The imaging unit 16B captures the image processed by the imaging control unit 130B. As a result, in the information processing system 1B according to the modified embodiment 1, the color of areas different from the color-producing area is simplified so that the color of the color-producing area is less affected by the color of areas different from the color-producing area.

[0358] Furthermore, in the information processing system 1B according to the modified embodiment 2, the imaging unit 16B captures the same subject from each of the different imaging positions. The image processing unit 131B selects one image based on the color of each of the multiple images captured by the imaging unit 16B from different imaging positions. As a result, in the information processing system 1B according to the modified embodiment 2, it is possible to select an image to be used for determination from multiple images. Therefore, even if the color of the color development unit 103B is captured deviating from the standard color due to the relative positional relationship between the imaging position and the installation position of the illumination light, it is possible to select an image with little deviation from the standard color. Consequently, it becomes possible to accurately determine whether or not a result is positive.

[0359] Furthermore, in the information processing system 1B according to the modified embodiment 4, the imaging unit 16B captures the same subject from different imaging positions. The determination unit 232B determines whether each of the multiple images captured by the imaging unit 16B from different imaging positions indicates a positive result. The determination unit 232B determines whether a positive result is indicated based on the determination results of each of the multiple images. Thus, in the information processing system 1B according to the modified embodiment 4, it is possible to determine whether a positive result is indicated comprehensively using the determination results of each of the multiple images.

[0360] The information processing system 1B and information processing server 20B in the above-described embodiment may be implemented in whole or in part using a computer. In that case, the program for implementing this function may be recorded on a computer-readable recording medium, and the program recorded on this recording medium may be loaded into the computer system and executed. Here, "computer system" includes hardware such as the OS and peripheral devices. Furthermore, "computer-readable recording medium" refers to portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, and storage devices such as hard disks built into the computer system. Moreover, "computer-readable recording medium" may also include media that dynamically hold programs for a short period of time, such as communication lines used when transmitting programs via networks such as the Internet or communication lines such as telephone lines, and media that hold programs for a certain period of time, such as volatile memory inside the computer system that acts as a server or client in that case. Furthermore, the above-mentioned program may be a program for implementing a part of the above-mentioned function, or it may be a program that can implement the above-mentioned function in combination with a program already recorded in the computer system, or it may be a program implemented using a programmable logic device such as an FPGA.

[0361] Although embodiments of this invention have been described in detail above with reference to the drawings, the specific configuration is not limited to these embodiments and includes designs and the like that do not depart from the spirit of this invention.

[0362] Furthermore, the following inventions are also included in the present invention.

[0363] (Invention 1) An information processing method performed by an information processing system that processes information related to an inspection using the test specimen, comprising a test specimen, a first device, and a second device that is communicatively connected to the first device, The test piece is provided with individual identification information for identifying the individual test piece, and the test piece exhibits a color depending on whether or not the biological sample contains the object to be tested when a biological sample taken from the person being tested is supplied to the test piece. The first apparatus includes an imaging step of capturing a digital image that includes at least the region in the test piece in the state in which the color has been exhibited, A first communication step in which the first device transmits the digital image and the individual identification information to a second device which is communicably connected to the first device, The second device performs a determination step of determining whether the color information indicating the color in the digital image indicates the presence of the object to be inspected, based on the digital image received from the first device and determination criterion information for determining the presence or absence of the object to be inspected. The second device includes a storage control step in which it stores the digital image received from the first device in association with the individual identification information, An information processing method having

[0364] (Invention 2) The first apparatus further includes an acquisition step of acquiring subject information, which is information relating to the subject of inspection, wherein the subject information includes at least one piece of information selected from the group consisting of information that uniquely identifies the subject of inspection, information that indicates the attributes of the subject of inspection, and information that indicates the location where the inspection was performed on the subject of inspection. The first communication step transmits the information of the person to be inspected to the second device in association with the digital image. The information processing method according to Invention 1, wherein the memory control step involves storing the information of the person to be inspected in association with the individual identification information.

[0365] (Invention 3) The second device includes a second communication step in which it transmits the determination result determined by the determination step to the first device via a communication network, The first device performs a display step of displaying the determination result received from the second device, An information processing method according to invention 1 or 2, including the above.

[0366] (Invention 4) An information processing method according to any one of inventions 1 to 3, wherein the second device includes a second communication step of transmitting to the third device the information used for determination by the determination step and the determination result determined by the determination step, in association with the individual identification information.

[0367] (Invention 5) The information processing method according to Invention 4, wherein the third device includes a third communication step of transmitting to the second device the confirmation result of the determination result, which has been confirmed by a verifier who confirms the determination result based on the information received from the second device, in association with the individual identification information.

[0368] (Invention 6) The information processing method according to any one of Inventions 1 to 5, wherein in the memory control step, the determination result determined in the determination step is stored in association with the individual identification information without being associated with the person being examined, and the person being examined is stored in association with the individual identification information without being associated with the determination result.

[0369] (Invention 7) The individual identification information is information embedded in the code assigned to the test piece. In the imaging step, the digital image is captured such that it includes the region of the test piece to which the code is assigned. The information processing method according to any one of inventions 1 to 6, wherein in the first communication step, the individual identification information is transmitted to the second device by transmitting the digital image which includes the area in which the code is shown.

[0370] (Invention 8) The information embedded in the code includes, as specimen description information describing the specimen, information indicating at least one selected from the group consisting of the type of object being examined, the type of disease caused by the object being examined, and the manufacturer of the specimen. The information processing method described in Invention 7.

[0371] (Invention 9) In the imaging step, the digital image is captured such that the individual identification information and the test specimen description information are included in a single image. The information processing method described in Invention 8.

[0372] (Invention 10) The aforementioned test specimen is a lateral flow test strip. An information processing method according to any one of inventions 1 to 9.

[0373] (Invention 11) In the imaging step, when the test piece is imaged, a guide representing the outer shape of the test piece is displayed on the display unit of the first device. An information processing method according to any one of inventions 1 to 10.

[0374] (Invention 12) Color correction indicators are prepared, In the imaging step, the digital image is captured such that it includes the region of the test piece to which the color correction index is applied. The second device further includes a correction step of performing color correction on the digital image using the color correction index shown in the digital image received from the first device. An information processing method according to any one of inventions 1 to 11.

[0375] (Invention 13) An angle correction index has been prepared. In the imaging step, the digital image is captured such that it includes the region of the test piece to which the angle correction index is applied. The second device further includes a correction step of performing angle correction in the digital image using the angle correction index shown in the digital image received from the first device. An information processing method according to any one of inventions 1 to 12.

[0376] (Invention 14) The individual identification information is information embedded in the code assigned to the test piece. In the imaging step, the digital image is captured such that it includes the region of the test piece to which the code is assigned. In the correction step, at least one of color correction and angle correction is performed on the digital image using the code shown in the digital image received from the first device. The information processing method described in invention 12 or 13.

[0377] (Invention 15) An information processing system comprising a test specimen, a first device, and a second device communicated with the first device, which processes information relating to an inspection using the test specimen, The aforementioned test specimen is A color-exposing section, which, when a biological sample taken from the person being tested is supplied to the test piece, exhibits a color depending on whether or not the biological sample contains the object to be tested. It has, The test specimen is provided with individual identification information for identifying each individual test specimen. The first apparatus, An imaging unit captures a digital image that includes at least the region in the test piece in the state in which the aforementioned color has been exhibited, A first communication unit transmits the digital image and the individual identification information to an information processing server, It has, The second device is A determination unit determines whether the color information in the digital image indicates the presence of the object to be inspected, based on the digital image received from the first device and the determination criteria information for determining the presence or absence of the object to be inspected, A storage control unit that stores the digital image received from the first device in association with the individual identification information, Having, Information processing system.

[0378] (Invention 16) An information processing system comprising an inspection terminal, a user terminal, and an information processing server, which processes information related to inspections using test pieces to determine whether or not a biological sample contains a target substance, The aforementioned inspection terminal is A first acquisition unit that acquires individual identification information that identifies individual test pieces used in the examination of the person being examined, and examination information that shows the examination results of the person being examined, A registration unit that transmits the individual identification information and the inspection information acquired by the first acquisition unit to the information processing server, It has, The user terminal includes a second acquisition unit that acquires the individual identification information of the test piece used for the examination of the person being examined, and user information relating to the person being examined. A user registration unit transmits the individual identification information and user information acquired by the second acquisition unit to the information processing server, It has, The aforementioned information processing server is A registration control unit stores information in the inspection results database that associates the inspection information with the individual identification information based on the information received from the inspection terminal, and stores information in the user database that associates the user information with the individual identification information based on the information received from the user terminal. Having, Information processing system.

[0379] (Invention 17) The test piece has a color-changing portion that, when a biological sample taken from a person being tested is supplied to the test piece, displays a color corresponding to whether or not the biological sample contains the substance to be tested. The aforementioned inspection terminal is The system further includes an inspection determination unit that determines whether or not the biological sample contains the substance to be tested based on the color displayed in the color-developing unit after the biological sample has been supplied with the biological sample taken from the person to be tested, The first acquisition unit acquires the inspection result from the inspection determination unit as inspection information indicating the inspection result. The information processing system described in Invention 16.

[0380] (Invention 18) The aforementioned user terminal is The system further includes an inspection result request unit that transmits the individual identification information to the information processing server and requests the information processing server to provide the inspection result for an inspection using the test piece corresponding to the individual identification information, The aforementioned information processing server is An inspection result extraction unit that extracts the inspection results associated with the individual identification information by referring to the inspection result database based on the individual identification information notified from the user terminal, The device further comprises a device control unit that transmits the inspection results extracted by the inspection result extraction unit to the user terminal, An information processing system according to invention 16 or 17.

[0381] (Invention 19) The inspection result request unit requests the inspection result from the information processing server by transmitting the user information along with the individual identification information to the information processing server. The information processing system described in Invention 18.

[0382] (Invention 20) The aforementioned information processing server is The system further includes a notification determination unit that determines whether or not to notify the user terminal of the inspection results based on the user information notified from the user terminal and the information stored in the user database, The inspection result extraction unit extracts the inspection result when the notification determination unit determines that the inspection result should be notified to the user terminal. The information processing system described in Invention 19.

[0383] (Invention 21) A third acquisition unit that acquires the inspection results associated with the individual identification information from the user terminal, The system includes a condition determination unit that determines whether the inspection result obtained by the third acquisition unit satisfies the entry conditions. The event venue will be equipped with even more terminals. An information processing system according to invention 19 or 20.

[0384] (Invention 22) The device control unit transmits the barcode or two-dimensional code containing the inspection results extracted by the inspection result extraction unit to the user terminal. The third acquisition unit acquires the inspection result associated with the individual identification information from the user terminal by reading the barcode or two-dimensional code. The information processing system described in Invention 21.

[0385] (Invention 23) The device control unit transmits to the user terminal the password used when displaying the inspection results extracted by the inspection result extraction unit. The user terminal transmits the individual identification information and the password to the event venue terminal. The third acquisition unit acquires the inspection result associated with the individual identification information by transmitting the individual identification information and the password to the information processing server. The information processing system described in Invention 21.

[0386] (Invention 24) An information processing system comprising an inspection terminal, a user terminal, and an information processing server, which processes information related to inspections using test pieces to determine whether or not a biological sample contains a target substance, The aforementioned inspection terminal is Individual identification information that identifies the individual test piece used in the examination of the person being examined, and examination information that shows the examination results of the person being examined are obtained. The acquired individual identification information and the inspection information are transmitted to the information processing server. The aforementioned user terminal is The individual identification information of the test piece used in the examination of the subject of the examination, and user information relating to the subject of the examination are obtained. The acquired individual identification information and user information are transmitted to the information processing server. The aforementioned information processing server is Based on the information received from the inspection terminal, the system stores information in the inspection results database that associates the inspection information with the individual identification information, and based on the information received from the user terminal, the system stores information in the user database that associates the user information with the individual identification information. Information processing methods.

[0387] (Invention 25) An information processing method performed by an information processing system that processes information related to testing using a test piece that exhibits a color depending on whether or not the sample contains a substance to be tested, The imaging unit images the test piece, which is the subject, such that the imaging unit includes a color-exposing region in the test piece where the color is exhibited. The determination unit uses a determination model to determine whether the image captured by the imaging unit shows a positive result indicating that the colored region contains the object to be inspected. The judgment model is a trained model that learns the correspondence between images and positive results by performing machine learning on a training dataset in which training images are captured so as to include the colored region of an unspecified test piece, and each training image is labeled with a code indicating whether or not the colored region in the training image shows a positive result. Based on this correspondence, it estimates the degree to which the input image shows a positive result and outputs the estimated result. The aforementioned training images include multiple images of the same subject taken in different imaging environments. Information processing methods.

[0388] (Invention 26) The judgment model outputs information indicating whether or not the input image shows a positive result. Information processing method described in Invention 25.

[0389] (Invention 27) The training dataset includes training images with the aforementioned codes and the concentration of the substance to be tested contained in the sample in the training image. The judgment model estimates the concentration of the substance to be tested in the sample in the input image and outputs the estimated result. The information processing method according to invention 25 or 26.

[0390] (Invention 28) The aforementioned training images include multiple images showing different concentrations of the substance being tested, supplied to the test specimen. An information processing method according to any one of inventions 25 to 27.

[0391] (Invention 29) The aforementioned training images include multiple images created under different imaging environments by illuminating with illumination light having different spectral emission characteristics. An information processing method according to any one of inventions 25 to 28.

[0392] (Invention 30) The image processing unit performs image processing which includes at least one of the following: converting the color information of the image captured by the imaging unit from information using a first color space to information using a second color space different from the first color space, and converting the file format of the image captured by the imaging unit. The determination unit makes a determination using the image processed by the image processing unit. An information processing method according to any one of inventions 25 to 29.

[0393] (Invention 31) The image processing unit performs image processing to crop the colored region in the image captured by the imaging unit. The determination unit makes a determination using the image processed by the image processing unit. An information processing method according to any one of inventions 25 to 30.

[0394] (Invention 32) The imaging unit captures the same subject from each of the different imaging positions, The image processing unit selects one image based on the color of each of the multiple images captured by the imaging unit at different imaging positions. The determination unit makes a determination using the image selected by the image processing unit. An information processing method according to any one of inventions 25 to 31.

[0395] (Invention 33) The imaging unit captures the same subject from each of the different imaging positions, The determination unit makes a determination for each of the multiple images captured by the imaging unit at different imaging positions, and determines whether or not the positive result is indicated based on the determination result for each of the multiple images. An information processing method according to any one of inventions 25 to 31.

[0396] (Invention 34) The imaging control unit displays the imaging area captured by the imaging unit, identifies the colored area included in the imaging area, and performs image processing to convert the color of areas different from the identified colored area into a single color. The imaging unit captures the image processed by the imaging control unit, The determination unit makes a determination using the image captured by the imaging unit. Information processing methods described in Inventions 25 to 33.

[0397] (Invention 35) The determination unit determines, based on the degree to which the positive result is shown by inputting the image into the determination model, whether the image shows a positive result, whether the colored area shows a negative result indicating that the object to be examined is not present, or whether it is impossible to determine as neither positive nor negative is shown. If it is impossible to determine, the imaging unit is instructed to image the subject again. Information processing methods described in Inventions 25 to 34.

[0398] (Invention 36) An information processing system for processing information related to testing using a test piece that exhibits a color depending on whether or not the sample contains the substance to be tested, An imaging unit that images the test piece, which is the subject, such that the image includes a color-exposing region in the test piece where the color is exhibited, A determination unit that uses a determination model to determine whether the image captured by the imaging unit shows a positive result indicating that the colored region contains the object to be inspected, Equipped with, The judgment model is a trained model that learns the correspondence between images and positive results by performing machine learning on a training dataset in which training images captured to include the colored region of an unspecified test piece are labeled with a code indicating whether or not the colored region in the training image shows a positive result, estimates the degree to which the input image shows a positive result based on the correspondence, and outputs the estimated result. The aforementioned training images include multiple images of the same subject taken in different imaging environments. Information processing system.

[0399] (Invention 37) A user terminal having the aforementioned imaging unit, An information processing server having the aforementioned determination unit, Equipped with, The user terminal transmits the image captured by the imaging unit to the information processing server. The information processing system described in Invention 36. [Industrial applicability]

[0400] According to the present invention, inspections using highly reliable methods can be performed in a manner that makes it difficult for highly confidential information to be leaked. Furthermore, according to the present invention, data security can be enhanced when using test results. In particular, the person who underwent the test and their test results are stored in separate databases. This makes it possible to prevent the test results from being easily linked to individuals, thereby protecting the privacy of the person who underwent the test. Furthermore, according to the present invention, when making a determination using images captured by the user, it is possible to accurately determine the results of images captured in various imaging environments. [Explanation of symbols]

[0401] 1, 1A, 1B… Information Processing Systems 10…User terminal (device 1) 10A... Inspection terminal 10B...User terminal 11,11A,11B…Communication Department (1st Communication Department) 12,12A,12B…Storage section 13, 13A, 13B... Control Units 130…Imaging Control Unit 130A…Acquisition Department (1st Acquisition Department) 130B...Imaging Control Unit 131A...Inspection and Judgment Unit 131B...Image Processing Unit 132A...Registration Section 14,14A,14B…Display section 15, 15A, 15B... Input section 16, 16A, 16B… Imaging Unit 20, 20A, 20B... Information processing server (second device) 21,21A,21B…Communication Department (Second Communication Department) 22,22A,22B…Storage section 220... Individual Information 220B... Judgment Model Information 221...Information on individuals to be tested 221B... Test result information 222... Test result information 23…Control Unit 23B... Control Unit 230…Acquisition Department 230A…Acquisition Department 230B…Acquisition Department 231...Correction section 231A...Registration Control Unit 231B...Image Processing Unit 232...Judgment section 232A…Notification determination unit 232B...Judgment section 233...Memory Control Unit 233A...Inspection result extraction unit 233B...Device Control Unit 234A...Device Control Unit 30…Institutional Server (Third Device) 30A...User terminal 31A…Communication Department 32A…Storage section 33A...Control Unit 330A…Acquisition Department (Second Acquisition Department) 331A...User Registration Section 332A...Inspection Result Request Section 333A...Device Control Unit 34A…Display section 35A...Input section 40A…Event venue terminal 41A…Communication Department 42A…Storage section 420A...Input Condition Information Section 43A...Control Unit 430A…Acquisition Department (3rd Acquisition Department) 431A…Condition judgment section 432A...Device Control Unit 44A…Display section 45A...Input section 46A…Imaging unit

Claims

1. An information processing method performed by an information processing system that processes information relating to inspection using a test piece, comprising a first device and a second device that is communicably connected to the first device, The test piece is provided with individual identification information for identifying the individual test piece, and is equipped with a color-changing section that, when a biological sample taken from the person being tested is supplied to the test piece, displays a color depending on whether or not the biological sample contains the object to be tested. The first apparatus includes an imaging step of capturing a digital image that includes at least the region in the test piece in the state in which the color has been exhibited, A first communication step in which the first device transmits the digital image and the individual identification information to the second device which is communicably connected to the first device, The second device performs a determination step of determining whether the color information indicating the color in the digital image indicates the presence of the object to be inspected, based on the digital image received from the first device and determination criterion information for determining the presence or absence of the object to be inspected. The second device includes a storage control step in which it stores the digital image received from the first device in association with the individual identification information, The second device includes a second communication step in which it transmits to the third device the information used in the determination step and the determination result determined by the determination step, in association with the individual identification information. Having, Information processing methods.

2. The first apparatus further includes an acquisition step of acquiring subject information, which is information relating to the subject of inspection, wherein the subject information includes at least one piece of information selected from the group consisting of information that uniquely identifies the subject of inspection, information that indicates the attributes of the subject of inspection, and information that indicates the location where the inspection was performed on the subject of inspection. The first communication step transmits the information of the person to be inspected to the second device in association with the digital image. The memory control step involves storing the subject information in association with the individual identification information. The information processing method according to claim 1.

3. The second device includes a second communication step in which it transmits the determination result determined by the determination step to the first device via a communication network, The first device performs a display step of displaying the determination result received from the second device, This also includes, The information processing method according to claim 1 or claim 2.

4. The third device further includes a third communication step of transmitting to the second device the confirmation result of the determination result, which has been confirmed by a verifier who confirms the determination result based on the information received from the second device, in association with the individual identification information. The information processing method according to claim 1.

5. In the memory control step, the determination result determined by the determination step is stored in association with the individual identification information without being associated with the subject information, which is information relating to the subject of examination, and the subject information is stored in association with the individual identification information without being associated with the determination result. The information processing method according to claim 1 or claim 2.

6. The individual identification information is information embedded in the code assigned to the test piece. In the imaging step, the digital image is captured such that it includes the region of the test piece to which the code is assigned. In the first communication step, the individual identification information is transmitted to the second device by transmitting the digital image which includes the area where the code is indicated. The information processing method according to claim 1 or claim 2.

7. The information embedded in the code includes, as specimen description information describing the specimen, information indicating at least one selected from the group consisting of the type of object being examined, the type of disease caused by the object being examined, and the manufacturer of the specimen. The information processing method according to claim 6.

8. In the imaging step, the digital image is captured such that the individual identification information and the test specimen description information are included in a single image. The information processing method according to claim 7.

9. The aforementioned test specimen is a lateral flow test strip. The information processing method according to claim 1 or claim 2.

10. In the imaging step, when the test piece is imaged, a guide representing the outer shape of the test piece is displayed on the display unit of the first device. The information processing method according to claim 1 or claim 2.

11. Color correction indicators are prepared, In the imaging step, the digital image is captured such that it includes the region of the test piece to which the color correction index is applied. The second device further includes a correction step of performing color correction on the digital image using the color correction index shown in the digital image received from the first device. The information processing method according to claim 1 or claim 2.

12. An angle correction index has been prepared. In the imaging step, the digital image is captured such that it includes the region of the test piece to which the angle correction index is applied. The second device further includes a correction step of performing angle correction in the digital image using the angle correction index shown in the digital image received from the first device. The information processing method according to claim 1 or claim 2.

13. The individual identification information is information embedded in the code assigned to the test piece. In the imaging step, the digital image is captured such that it includes the region of the test piece to which the code is assigned. In the correction step, at least one of color correction and angle correction is performed on the digital image using the code shown in the digital image received from the first device. The information processing method according to claim 11.

14. An information processing system comprising a first device and a second device that is communicably connected to the first device, for processing information relating to inspection using a test piece, The test piece is provided with individual identification information for identifying the individual test piece, and is equipped with a color-changing section that, when a biological sample taken from the person being tested is supplied to the test piece, displays a color depending on whether or not the biological sample contains the object to be tested. The first apparatus is An imaging unit captures a digital image that includes at least the region in the test piece in the state in which the aforementioned color has been exhibited, The system includes a first communication unit that transmits the digital image and the individual identification information to an information processing server, The second device is A determination unit determines whether the color information in the digital image indicates the presence of the object to be inspected, based on the digital image received from the first device and the determination criteria information for determining the presence or absence of the object to be inspected, A storage control unit that stores the digital image received from the first device in association with the individual identification information, Having, Information processing system.

15. An information processing system comprising an inspection terminal, a user terminal, and an information processing server, which processes information related to an inspection using a test piece to determine whether or not a biological sample contains a target substance, wherein the inspection terminal is A first acquisition unit that acquires individual identification information that identifies individual test pieces used in the examination of the person being examined, and examination information that shows the examination results of the person being examined, A registration unit that transmits the individual identification information and the inspection information acquired by the first acquisition unit to the information processing server, It has, The user terminal includes a second acquisition unit that acquires the individual identification information of the test piece used for the examination of the person being examined, and user information relating to the person being examined. A user registration unit transmits the individual identification information and user information acquired by the second acquisition unit to the information processing server, It has, The aforementioned information processing server is A registration control unit stores information in the inspection results database that associates the inspection information with the individual identification information based on the information received from the inspection terminal, and stores information in the user database that associates the user information with the individual identification information based on the information received from the user terminal. Having, Information processing system.

16. The test piece has a color-changing portion that, when a biological sample taken from a person being tested is supplied to the test piece, displays a color corresponding to whether or not the biological sample contains the substance to be tested. The aforementioned inspection terminal is The system further includes an inspection determination unit that determines whether or not the biological sample contains the substance to be tested based on the color displayed in the color-developing unit after the biological sample has been supplied with the biological sample taken from the person to be tested, The first acquisition unit acquires the inspection result from the inspection determination unit as inspection information indicating the inspection result. The information processing system according to claim 15.

17. The aforementioned user terminal is The system further includes an inspection result request unit that transmits the individual identification information to the information processing server and requests the information processing server to provide the inspection result for an inspection using the test piece corresponding to the individual identification information, The aforementioned information processing server is An inspection result extraction unit that extracts the inspection results associated with the individual identification information by referring to the inspection result database based on the individual identification information notified from the user terminal, The device further comprises a device control unit that transmits the inspection results extracted by the inspection result extraction unit to the user terminal, The information processing system according to claim 15 or claim 16.

18. The inspection result request unit requests the inspection result from the information processing server by transmitting the user information along with the individual identification information to the information processing server. The information processing system according to claim 17.

19. The aforementioned information processing server is The system further includes a notification determination unit that determines whether or not to notify the user terminal of the inspection results based on the user information notified from the user terminal and the information stored in the user database, The inspection result extraction unit extracts the inspection result when the notification determination unit determines that the inspection result should be notified to the user terminal. The information processing system according to claim 18.

20. A third acquisition unit that acquires the inspection results associated with the individual identification information from the user terminal, The system includes a condition determination unit that determines whether the inspection result obtained by the third acquisition unit satisfies the entry conditions. The event venue will be equipped with even more terminals. The information processing system according to claim 18.

21. The device control unit transmits the barcode or two-dimensional code containing the inspection results extracted by the inspection result extraction unit to the user terminal. The third acquisition unit acquires the inspection result associated with the individual identification information from the user terminal by reading the barcode or two-dimensional code. The information processing system according to claim 20.

22. The device control unit transmits to the user terminal the password used when displaying the inspection results extracted by the inspection result extraction unit. The user terminal transmits the individual identification information and the password to the event venue terminal. The third acquisition unit acquires the inspection result associated with the individual identification information by transmitting the individual identification information and the password to the information processing server. The information processing system according to claim 20.

23. An information processing system comprising an inspection terminal, a user terminal, and an information processing server, which processes information related to an inspection using a test piece to determine whether or not a biological sample contains a target substance, wherein the inspection terminal is Individual identification information that identifies the individual test piece used in the examination of the person being examined, and examination information that shows the examination results of the person being examined are obtained. The acquired individual identification information and the inspection information are transmitted to the information processing server. The aforementioned user terminal is The individual identification information of the test piece used in the examination of the subject of the examination, and user information relating to the subject of the examination are obtained. The acquired individual identification information and user information are transmitted to the information processing server, and the information processing server, Based on the information received from the inspection terminal, the system stores information in the inspection results database that associates the inspection information with the individual identification information, and based on the information received from the user terminal, the system stores information in the user database that associates the user information with the individual identification information. Information processing methods.

24. An information processing method performed by an information processing system that processes information related to testing using a test piece that exhibits a color depending on whether or not the sample contains a substance to be tested, The imaging unit images the test piece, which is the subject, such that the imaging unit includes a color-exposing region in the test piece where the color is exhibited. The determination unit uses a determination model to determine whether the image captured by the imaging unit shows a positive result indicating that the colored region contains the object to be inspected. The judgment model is a trained model that learns the correspondence between images and positive results by performing machine learning on a training dataset in which training images captured to include the colored region of an unspecified test piece are labeled with a code indicating whether or not the colored region in the training image shows a positive result, estimates the degree to which the input image shows a positive result based on the correspondence, and outputs the estimated result. The aforementioned training images include multiple images of the same subject taken in different imaging environments, and multiple images of the object to be inspected supplied to the test piece with different concentrations. The breakdown of multiple images with different concentrations to be included in the training image is determined according to the object to be judged by the judgment model. Information processing methods.

25. The breakdown of the multiple images with different densities to be included in the training image is such that the number of low-density images with lower densities is greater than the number of high-density images with higher densities. The information processing method according to claim 24.

26. The judgment model outputs information indicating whether or not the input image shows a positive result. The information processing method according to claim 24.

27. The training dataset includes training images with the aforementioned codes and the concentration of the substance to be tested contained in the sample in the training image. The judgment model estimates the concentration of the substance to be tested in the sample in the input image and outputs the estimated result. The information processing method according to claim 24 or claim 26.

28. The aforementioned training images include multiple images created under different imaging environments by illuminating with illumination light having different spectral emission characteristics. The information processing method according to claim 24 or claim 26.

29. The image processing unit performs image processing which includes at least one of the following: converting the color information of the image captured by the imaging unit from information using a first color space to information using a second color space different from the first color space, and converting the file format of the image captured by the imaging unit. The determination unit makes a determination using the image processed by the image processing unit. The information processing method according to claim 24 or claim 26.

30. The image processing unit performs image processing to crop the colored region in the image captured by the imaging unit. The determination unit makes a determination using the image processed by the image processing unit. The information processing method according to claim 24 or claim 26.

31. The imaging unit captures the same subject from each of the different imaging positions, The image processing unit selects one image based on the color of each of the multiple images captured by the imaging unit at different imaging positions. The determination unit makes a determination using the image selected by the image processing unit. The information processing method according to claim 24 or claim 26.

32. The imaging unit captures the same subject from each of the different imaging positions, The determination unit makes a determination for each of the multiple images captured by the imaging unit at different imaging positions, and determines whether or not the positive result is indicated based on the determination result for each of the multiple images. The information processing method according to claim 24 or claim 26.

33. The imaging control unit displays the imaging area captured by the imaging unit, identifies the colored area included in the imaging area, and performs image processing to convert the color of areas different from the identified colored area into a single color. The imaging unit captures the image processed by the imaging control unit, The determination unit makes a determination using the image captured by the imaging unit. The information processing method according to claim 24 or claim 26.

34. The determination unit determines, based on the degree to which the positive result is shown by inputting the image into the determination model, whether the image shows a positive result, whether the colored area shows a negative result indicating that the object to be examined is not present, or whether it is impossible to determine as neither positive nor negative is shown. If it is impossible to determine, the imaging unit is instructed to image the subject again. The information processing method according to either claim 24 or claim 26.

35. An information processing system for processing information related to testing using a test piece that exhibits a color depending on whether or not the sample contains the substance to be tested, An imaging unit that images the test piece, which is the subject, such that the image includes a color-exposing region in the test piece where the color is exhibited, A determination unit that uses a determination model to determine whether the image captured by the imaging unit shows a positive result indicating that the colored region contains the object to be inspected, Equipped with, The judgment model is a trained model that learns the correspondence between images and positive results by performing machine learning on a training dataset in which training images captured to include the colored region of an unspecified test piece are labeled with a code indicating whether or not the colored region in the training image shows a positive result, estimates the degree to which the input image shows a positive result based on the correspondence, and outputs the estimated result. The aforementioned training images include multiple images of the same subject taken in different imaging environments, and multiple images of the object to be inspected supplied to the test piece with different concentrations. The breakdown of multiple images with different concentrations to be included in the training image is determined according to the object to be judged by the judgment model. Information processing system.

36. A user terminal having the aforementioned imaging unit, An information processing server having the aforementioned determination unit, Equipped with, The user terminal transmits the image captured by the imaging unit to the information processing server. The information processing system according to claim 35.

Images