Information collection system, information collection method, program, information collection device, and electronic device

Abstract

To acquire information for supporting diagnosis.SOLUTION: An information collection system has: image acquisition means that acquires an image obtained by photographing an affected part of a user; determination means that determines which symptom of a plurality of symptoms the image of the affected part indicates; and control means that controls to present inquiries and receive answers to the inquiries, the control means presenting a first inquiry group including an inquiry related to a first symptom determined based on the image of the affected area, and presenting a second inquiry group including an inquiry related to a second symptom determined based on the image of the affected area and answers to the first inquiry group.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an information collection system, an information collection method, a program, an information collection device, and an electronic device. [Background technology]

[0002] Patients sometimes take pictures of the affected area to make it easier for doctors to explain things to them during a diagnosis. Patent Document 1 describes a technology in which a patient's face is photographed with a camera to obtain a facial image, and the contents of the medical interview are changed depending on the patient's condition analyzed from the facial image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2020-27364 Summary of the Invention [Problem to be solved by the invention]

[0004] In the method of Patent Document 1, the number of questions is reduced depending on the patient's condition in order to reduce the burden on the patient, so there is a risk that sufficient information will not be obtained.

[0005] Even if a patient has saved images of the affected area, they may not be able to accurately remember information that cannot be found in the images, such as the exact circumstances under which they were injured or became ill, at the time of diagnosis. Furthermore, patients may not be aware of other symptoms related to their injury or illness. In such cases, useful information to assist a doctor in making a diagnosis may not be conveyed.

[0006] The present invention has been made in view of the above-mentioned problems, and has an object to make it possible to acquire information that assists diagnosis. [Means for solving the problem]

[0007] A first aspect of the present invention is a method for treating a patient, comprising: image acquisition means for acquiring an image of an affected area of ​​a user; The device includes a determining means for determining which of a plurality of symptoms the image of the affected area indicates, and a control means for presenting questions and receiving answers to the questions, the control means presenting a first group of questions including questions about a first symptom determined based on the image of the affected area, and presenting a second group of questions including questions about a second symptom determined based on the image of the affected area and answers to the first group of questions. the control means, when prompting the user to take an image, presents imaging instruction information which is information instructing the user to take an image that assists diagnosis, and the imaging instruction information is stored as metadata of an image taken based on the imaging instruction information. The information collection system is characterized by the above.

[0009] The present invention 2 The present invention provides an information collection method, The computer an image acquisition step of acquiring an image of an affected area of ​​the user; The computer a determining step of determining which of a plurality of symptoms the image of the affected area shows; The computer A control step of presenting a question and controlling to receive an answer to the question, The computer presenting a first group of questions including questions regarding a first symptom determined based on the image of the affected area; The computer a control step of presenting a second set of questions including questions about a second symptom determined based on the image of the affected area and the answers to the first set of questions. and in the control step, the computer presents imaging instruction information, which is information instructing the user to capture an image that assists diagnosis, when prompting the user to capture an image, and the imaging instruction information is stored as metadata of an image captured based on the imaging instruction information. The information gathering method is characterized by the above.

[0011] The present invention 3 The third aspect is a program for causing a computer to execute each step of the information gathering method described above. [Effects of the Invention]

[0016] According to the present invention, information that assists diagnosis can be obtained. [Brief explanation of the drawings]

[0017] [Figure 1]1 is a block diagram showing an example of the configuration of an information collection system according to a first embodiment. [Figure 2] 10 is a flowchart of a diagnostic information collection process according to the first embodiment. [Figure 3] FIG. 10 is an explanatory diagram of a first group of questions. [Figure 4] FIG. 10 is an explanatory diagram of a second group of questions. [Figure 5] FIG. 10 is an explanatory diagram of a second group of questions. [Figure 6] These are examples of symptoms targeted by the information collection system. [Figure 7] 10 is a display example of a screen relating to the diagnostic information collection process in the first embodiment. [Figure 8] 10 is a flowchart of a diagnostic information collection process according to the first embodiment. [Figure 9] This is an example of a display when imaging the cause of the first symptom. [Figure 10] FIG. 10 is an explanatory diagram of an example in which the next question to be presented is changed depending on the answer. [Figure 11] 10 is a flowchart of a diagnostic information collection process in the second embodiment. [Figure 12] 10 is a display example of a screen relating to diagnostic information collection processing in the second embodiment. [Figure 13] 11 is a flowchart of a diagnostic information collection process in the third embodiment. [Figure 14] 13 is a display example of a screen relating to diagnostic information collection processing in the third embodiment. [Figure 15] 13 is a modified example of a screen relating to the diagnostic information collection process in the third embodiment. [Figure 16] 13 is a flowchart of a diagnostic information collection process in the fourth embodiment. [Figure 17] 13 is a display example of a screen relating to diagnostic information collection processing in the fourth embodiment. [Figure 18] This is an example of a display when a question is determined based on information about the user. DETAILED DESCRIPTION OF THE INVENTION

[0018] <Embodiment 1> Preferred embodiments of the present invention will be described below with reference to the accompanying drawings. The technical scope of the present invention is determined by the claims and is not limited to the individual embodiments described below. Furthermore, not all combinations of features described in the embodiments are essential to the present invention. Furthermore, features described in separate embodiments can be combined as appropriate.

[0019] FIG. 1 is a block diagram illustrating an example of the configuration of an information collection system (image processing system) 1 according to a first embodiment. The information collection system 1 includes an operation terminal 100 and an analysis device 110. The operation terminal 100 receives user operations, such as capturing an image and answering a question. The operation terminal 100 is, for example, a smartphone. The operation terminal 100 may be an electronic device such as a tablet terminal or a personal computer, or may be implemented by application software installed on a mobile terminal. The CPU 101 controls the entire operation terminal 100. The secondary storage unit 102 is, for example, a hard disk, and stores programs related to the operation of the CPU 101. The primary storage unit 103 is, for example, a RAM, and is used as a work memory where programs read from the secondary storage unit 102 are loaded. The optical system 104 is composed of a lens, a shutter, and an aperture, and focuses light from a subject on an image sensor 105. The image sensor 105 converts the light focused by the optical system 104 into an image. The display unit 106 displays images and text. In the first embodiment, it is assumed that the display unit 106 is configured integrally with the operation terminal 100, but it may be configured as a separate unit. The operation unit 107 accepts user operations on the operation terminal 100 and outputs operation information according to the user operations. The operation unit 107 is a physical button, touch panel, or the like provided on the operation terminal 100. The communication unit 108 transmits an image of the user's affected area (affected area image) to the analysis device 110. The communication unit 108 also receives information on a group of questions from the analysis device 110 and transmits the user's answers to the received group of questions to the analysis device 110. The storage medium 109 is a storage medium (storage unit) including a removable optical disk, a magnetic card, an optical card, an IC card, or the like.

[0020] The analysis device 110 is an information collection device (server) that determines which of multiple symptoms an image of an affected area indicates and determines a set of questions to present to the user. The CPU 111 controls the entire analysis device 110. The secondary storage unit 112 is, for example, a hard disk, and stores programs related to the operation of the CPU 111. The primary storage unit 113 is, for example, a RAM, and is used as a work memory on which programs read from the secondary storage unit 112 are deployed. The communication unit 114 receives images of affected areas and answers to user questions from the operation terminal 100, and transmits information such as the set of questions to the operation terminal 100.

[0021] <Diagnosis information collection process 200> Next, the diagnostic information collection process 200 will be described with reference to Figures 2 to 5. Figure 2 is a flowchart of the diagnostic information collection process 200 performed by the operation terminal 100 and the analysis device 110. Figures 3(a) and 3(b) are explanatory diagrams of the first group of questions. Figures 4 and 5 are explanatory diagrams of the second group of questions.

[0022] In the diagnostic information collection process 200, the information collection system 1 acquires an image of the affected area, presents a first set of questions regarding a first symptom determined from the acquired image of the affected area, and controls the system to present a second set of questions based on the answers to the first set of questions. The diagnostic information collection process 200 in Figure 2 starts when the operation terminal 100 and the analysis device 110 are powered on.

[0023] In step S201, the CPU 101 of the operation terminal 100 photographs the affected area in response to a user's operation and acquires an affected area image (image acquisition). The CPU 101 may also acquire from the storage medium 109 an affected area image selected by the user from among images of the affected area photographed in advance.

[0024] In step S202, the CPU 101 transmits the image of the affected area acquired in step S201 to the analysis device 110.

[0025] In step S211, the CPU 111 of the analysis device 110 receives the image of the affected area transmitted from the operation terminal 100.

[0026] In step S212, the CPU 111 determines the symptom (first symptom) indicated by the affected area image obtained in step S211. The CPU 111 may determine the first symptom by rule-based processing. When determining by rule-based processing, the CPU 111 may determine the first symptom based on feature quantities of the affected area image, such as the shape or color of the affected area included in the image. The CPU 111 may also determine the first symptom using a trained model trained by machine learning, such as deep learning. The trained model is generated by having a training computer train using a neural network with images captured for each symptom as training data. The CPU 111 may input the affected area image to the trained model and determine the first symptom based on the output (inference result) from the trained model.

[0027] When multiple first symptoms are acquired from the affected area image, the CPU 111 may determine the symptom with the most likely result as the first symptom. For example, the CPU 111 may acquire a score indicating the likelihood of the symptom along with the acquired symptoms, and determine the first symptom based on the score. Note that the CPU 111 may terminate the diagnostic information collection process 200 when the first symptom is not acquired from the affected area image or when a likely result is not obtained.

[0028] In step S213, the CPU 111 determines a first group of questions according to the first symptom determined in step S212.

[0029] Here, the first group of questions will be described with reference to FIGS. 3(a) and 3(b). The table in FIG. 3(a) shows the correspondence between first symptoms and questions related to the first symptoms. Symptoms 301 to 305 are examples of first symptoms. Note that the first symptoms are not limited to these and may be any symptoms that can be determined based on an image. Questions 306 to 311 are questions directly related to the first symptom. Directly related questions are, for example, questions about the timing of the onset of the first symptom, the cause of the first symptom, the severity of the first symptom, etc. Questions 312 to 316 are questions about associated symptoms (second symptoms), which are symptoms caused in connection with the first symptom.

[0030] The CPU 111 determines the first question group so as to include questions related to the first symptom that correspond to rows marked with "O" in the column of the first symptom determined based on the image of the affected area. For example, if the CPU 111 determines that the first symptom is lymphoma, the CPU 111 determines the first question group so as to include questions 306, 310, 312 to 314, and 316 that are marked with "O" in the column of symptom 301 in FIG. 3(a).

[0031] In this way, the first group of questions includes questions about the first symptom determined based on the image of the affected area. The first group of questions may also include questions about symptoms related to the first symptom. The questions about symptoms related to the first symptom may include questions about multiple possible related symptoms, or questions about some of the multiple related symptoms may be prioritized. Some of the symptoms may be symptoms whose early onset influences the subsequent treatment strategy. For example, if the first symptom is lymphoma, the first group of questions may be determined to include questions about symptoms that can help a doctor determine whether the disease is malignant or benign. This allows the information collection system 1 to provide a doctor with information to assist in diagnosis.

[0032] The table in Figure 3(b) shows answer options corresponding to questions about the first symptom. For the first group of questions, items such as those shown in Figure 3(b) are determined as answer options. Note that the questions and answer options shown in Figure 3 are only examples, and questions and answer options with content and numbers appropriate to each of the other symptoms are also prepared in advance.

[0033] Returning to the explanation of Fig. 2, in step S214, CPU 111 of analysis device 110 transmits the first group of questions determined in step S213 to operation terminal 100.

[0034] In step S203, the CPU 101 of the operation terminal 100 receives the first group of questions from the analysis device 110.

[0035] In step S204, CPU 101 displays the first group of questions on display unit 106. Note that the method of presenting the first group of questions to the user is not limited to display, and any method that can be recognized by the user, such as audio notification, may be used.

[0036] In step S205, CPU 101 receives answers from the user to the first group of questions. CPU 101 acquires the answers to the questions by, for example, receiving user operation from operation unit 107 in response to answer options displayed on display unit 106. If the first group of questions includes multiple questions, CPU 101 repeatedly displays the questions and receives answers to the questions for each question.

[0037] In step S206, CPU 101 transmits the user's answers to the first group of questions to analysis device 110. If the first group of questions includes multiple questions, CPU 101 transmits the answers to analysis device 110 after receiving answers from the user to all questions in the first group of questions. Note that CPU 101 may transmit the answers to analysis device 110 each time it receives some of the answers to the first group of questions.

[0038] In step S215, CPU 111 of analysis device 110 receives the answers to the first group of questions from operation terminal 100.

[0039] In step S216, CPU 111 determines a second group of questions in accordance with the received answers to the first group of questions.

[0040] Here, the second symptom and the second group of questions will be described. The second symptom is a symptom determined based on the image of the affected area and the answers to the first group of questions. For example, the second symptom is a related symptom, which is a symptom caused in association with the first symptom. In FIG. 3(a), among questions 306 to 316 regarding the first symptom, questions 312 to 316 are questions regarding symptoms related to the first symptom, and are questions that confirm whether the user has the second symptom. The CPU 111 determines the symptom that the user is experiencing as the second symptom based on the answers to the questions regarding the related symptoms (second symptom). The CPU 111 determines the second group of questions so as to include more detailed questions regarding the second symptom than the first group of questions.

[0041] The table in Figure 4 shows the correspondence between the second symptoms and detailed questions about the second symptoms. Symptoms 401 to 405 are included in the first question group as questions 312 to 316, and are examples of symptoms for which the user has responded as to whether or not they have developed the condition. Questions 406 to 418 are detailed questions about the second symptoms.

[0042] Based on the answer received in step S215, CPU 111 determines the second symptom from among symptoms 401 to 405. CPU 111 determines the second question group to include questions corresponding to rows marked with "O" in the column of the symptom determined to be the second symptom. For example, when CPU 111 obtains an answer of "Yes" to question 312 ("Do you feel something strange in your mouth?") in FIG. 3(a), CPU 111 determines symptom 401 (an uncomfortable feeling in the mouth) to be the second symptom. CPU 111 determines the second question group to include questions 406 to 408 and question 410 marked with "O" in the column of symptom 401 in FIG. 4.

[0043] In this way, the second group of questions includes questions about the second symptom determined based on the answers to the first group of questions that are more detailed than those in the first group of questions. If there are overlapping questions between the first group of questions and the second group of questions, the CPU 111 may determine the second group of questions so as not to include the overlapping questions. The second symptom may be one or more. The detailed questions about the second symptom may be, for example, questions that identify the cause of the second symptom or questions about symptoms related to the second symptom. The second group of questions may also include more detailed questions about the first symptom.

[0044] The table in Figure 5 shows answer options corresponding to questions about the second symptom. For the second group of questions, items such as those shown in Figure 5 are set as answer options. Note that the questions and answer options shown in Figures 4 and 5 are only examples, and questions and answer options with content and numbers appropriate to each of the other symptoms are also prepared in advance.

[0045] Returning to the explanation of Fig. 2, in step S217, CPU 111 of analysis device 110 transmits the second group of questions determined in step S216 to operation terminal 100.

[0046] In step S207, the CPU 101 of the operation terminal 100 receives the second group of questions from the analysis device 110. In step S208, the CPU 101 displays the second group of questions on the display unit 106. In step S209, the CPU 101 accepts answers to the second group of questions from the user. If the second group of questions includes multiple questions, the CPU 101 The process of displaying the question and accepting the answer is repeated for each question.

[0047] In step S210, the CPU 101 displays the results acquired by the information collection system 1 on the display unit 106. The results acquired by the information collection system 1 include an image of the affected area, a first symptom, a first group of questions, answers to the first group of questions, a second symptom, a second group of questions, and answers to the second group of questions. When the CPU 101 receives an instruction from the user to end the diagnostic information collection process 200, it ends the diagnostic information collection process 200.

[0048] The results acquired by the information collection system 1 may be stored in the storage medium 109 of the operation terminal 100. This allows the user to, for example, display the stored data on the display unit 106 and explain it to the doctor. The results acquired by the information collection system 1 may also be transmitted to an external terminal device that the doctor can operate. This allows the doctor to check detailed information about the patient's symptoms at the time of or in advance of the examination. The user can retake an image of the affected area and modify the answers to the first and second groups of questions, among the information registered in the operation terminal.

[0049] Fig. 6 shows examples of symptoms targeted by the information collection system 1. As shown in Fig. 6, the characteristics of the affected area differ depending on the symptom, such as lymphoma, cuts, abrasions, burns, and hives. The analysis device 110 determines which symptom the photographed affected area is associated with based on the characteristics of the affected area, which differ depending on the symptom.

[0050] 7(a) to 7(d) are examples of displays on the display unit 106 of the operation terminal 100 relating to the diagnostic information collection process 200. Display examples in each step of the diagnostic information collection process 200 shown in FIG. 2 will be described with reference to FIGS. 7(a) to 7(d).

[0051] FIG. 7(a) is a display example of a screen 700 (step S201) on which a user takes an image. The screen 700 displays a message prompting the user to take an image, an area 701, a button 702, and a button 703. The area 701 is an area for displaying an image of the subject. The area 701 displays a live view of the subject being photographed. In the screen 700, the area 701 displays a live view of a user who has lymphoma in the neck. The area 701 also displays a photographed image of the affected area. The button 702 is a photographing button. When the CPU 101 detects that the user has selected the button 702, it photographs an image of the affected area.

[0052] In the first embodiment, the image of the affected area is assumed to be a still image, but it may be a video. The user can also retake the image of the affected area by pressing (touching) button 702 again. Button 703 is a button for proceeding to the next process. For example, when CPU 101 detects that button 703 has been pressed, it transmits the captured image to analysis device 110. CPU 101 may display a message asking the user whether or not to transmit the captured image to analysis device 110, and may perform control so that the captured image is transmitted to analysis device 110 when the user instructs transmission.

[0053] FIG. 7(b) is a display example of a screen 710 (step S205) that displays the first group of questions (step S204) and accepts answers from the user. The screen 710 is a display example when the first symptom is determined to be lymphoma based on an image of the affected area. The screen 710 displays a question ("Do you have pain?") that corresponds to the question 310 in FIG. 3 and answer options 711 to 714 for the question. The screen 710 shows a state in which option 712 ("It hurts a little") has been selected. The button 715 is a button for proceeding to the next process. For example, when the CPU 101 of the operation terminal 100 detects that the button 715 has been pressed, it controls the display to display the next question from the first group of questions.

[0054] FIG. 7(c) is a display example of screen 720 (step S209) that displays the second group of questions (step S208) and accepts answers from the user. Screen 720 is a display example when the second symptom is determined to be "discomfort in the mouth." Screen 720 displays a question corresponding to question 707 in FIG. 4 ("Do you have a mouth ulcer?") and answer options 721 to 724 for the question. Screen 720 shows a state in which option 721 ("No") has been selected. Button 725 is a button for proceeding to the next process. For example, when CPU 101 detects that button 725 has been pressed, it controls the display to display the next question from the second group of questions.

[0055] FIG. 7(d) is an example of a screen 730 (step S210) displaying the results acquired by the information collection system 1. The screen 730 displays the user's answers to the first and second question groups (items 731 and 733), a first symptom (item 732), an image of the affected area 734, a button 735, and a button 736. Item 733 includes a second symptom determined by the information collection system 1. The button 735 is a button for correcting the answers. The user can check the contents displayed on the screen 730 and consider whether or not corrections are necessary. The button 736 is a button for confirming the user's answers and the image of the affected area. For example, when the CPU 101 detects that the button 725 has been pressed, the CPU 101 stores the acquired results in the storage medium 109 of the operation terminal 100.

[0056] Thus, in the diagnostic information collection process 200, the information collection system 1 presents a first set of questions including questions about a first symptom determined based on the image of the affected area. The information collection system 1 presents a second set of questions including questions about a second symptom determined based on the image of the affected area and the answers to the first set of questions. This allows the information collection system 1 to obtain information to assist in diagnosis.

[0057] <Diagnosis information collection process 800> In the diagnostic information collection process 200, the CPU 111 of the analysis device 110 determines the first symptom based on the acquired image of the affected area. However, even if the symptom can be determined from the image, the first symptom may not be determined from the image of the affected area depending on how the image of the affected area was captured. In such cases, it is desirable for the information collection system 1 to retake an image that is useful for diagnosis. Therefore, the process including the case where the first symptom cannot be determined from the image of the affected area will be described with reference to FIG. 8.

[0058] 8 is a flowchart of the diagnostic information collection process 800. In the diagnostic information collection process 800, if the first symptom is not determined from the affected area image, information (photographing instruction information) instructing the operation terminal 100 to capture an image to assist in diagnosis is transmitted. The user re-photographs the affected area in accordance with the photographing instruction information, and acquires a new image of the affected area. This allows the information collection system 1 to determine the first symptom and acquire an image to assist in diagnosis.

[0059] Regarding the processing of operation terminal 100 in Fig. 8, steps S801 to S802 and S805 to S811 are respectively the same as the processing of steps S201 to S202 and S204 to S210 in Fig. 2. Similarly, regarding the processing of analysis device 110, steps S821 to S822 and S824 to S829 are respectively the same as the processing of steps S211 to S212 and S213 to S217 in Fig. 2. In the explanation of diagnostic information collection processing 800, explanation of processing common to diagnostic information collection processing 200 will be omitted, and the following processing that is different will be explained.

[0060] In step S823, the CPU 111 of the analysis device 110 determines whether or not the first symptom has been determined in step S822. When determining the first symptom by rule-based processing using the feature amount of the affected area image, the CPU 111 proceeds to step S826 if the "no symptom" has been determined, and proceeds to step S824 if the first symptom has been determined. When determining the first symptom using deep learning, the CPU 111 proceeds to step S826 if the accuracy of the inference result is 70% or less, and proceeds to step S824 if the accuracy is higher than 70%, for example.

[0061] In step S826, the CPU 111 transmits information (imaging instruction information) instructing the operation terminal 100 to capture an image that assists diagnosis. The imaging instruction information includes, for example, at least one of the region to be imaged, the imaging direction, the size of the subject to be imaged, and the setting parameters of the imaging device. For example, if the image of the affected area is out of focus, the CPU 111 may include in the imaging instruction information a message urging the user to adjust the focus. Furthermore, if the image of the affected area is dark, the CPU 111 may include in the imaging instruction information a message urging the user to capture an image that is brighter than the image received in step S821. The CPU 111 may determine and transmit the imaging instruction information based on the received image.

[0062] In step S803, the CPU 101 of the operation terminal 100 receives the first set of questions or the imaging instruction information from the analysis device 110.

[0063] In step S804, CPU 101 determines whether the information received in step S803 is a first group of questions. If CPU 101 receives the first group of questions, it proceeds to step S805, and if it receives shooting instruction information, it proceeds to step S822.

[0064] In step S812, CPU 101 displays the imaging instruction information received in step S803 on display unit 106. When re-imaging the affected area, CPU 101 displays a message, for example, prompting the user to adjust the focus or change the brightness of the image during imaging. By displaying such a message, the user of operation terminal 100 can learn points to be careful of when re-imaging the affected area. After step S812, CPU 101 returns to step S801, images the affected area, and acquires an image of the affected area.

[0065] In the diagnostic information collection process 800, control is performed so that the imaging instruction information is displayed when the first symptom is not determined based on the acquired affected area image, but control may also be performed so that the imaging instruction information is displayed when the affected area image is first captured. This allows the user of the operation terminal 100 to capture an image of the affected area knowing from the beginning the points to pay attention to.

[0066] In this way, in the diagnostic information collection process 800, the information collection system 1 displays imaging instruction information when the user photographs the affected area. The information collection system 1 can acquire an image that supports diagnosis by photographing the affected area image according to the imaging instruction information.

[0067] In the diagnostic information collection process 200 and the diagnostic information collection process 800, the captured image is an image of the affected area, but images of areas other than the affected area may also be useful for treatment. Therefore, the CPU 111 of the analysis device 110 may prompt the user to capture an image of an object that explains the cause of the first symptom. For example, if a user has a cut, capturing an image of the object that caused the cut as a subject, generating and recording the image, can be useful for a doctor's diagnosis.

[0068] A specific description will be given with reference to Figures 3(a) and 9. If the user answers question 307 in Figure 3(a) "What caused the cut?" by selecting an option other than option D "I don't know" in Figure 3(b), CPU 111 of analysis device 110 prompts the user to take a photo of the object that caused the cut.

[0069] 9 shows an example of a display on the display unit 106 of the operation terminal 100 when photographing the cause of the first symptom. A screen 900 displays a photographing instruction 901, an area 902, and buttons 903 to 906. The photographing instruction 901 includes a message prompting the user to photograph the object that caused the first symptom. In FIG. 9, the photographing instruction 901 displays a message prompting the user to photograph the object that caused the cut. As shown in FIG. 9, the photographing instruction 901 may also include a message of precautions to take when photographing. Similar to the area 701 in FIG. 7(a), the area 902 displays a live view of the subject to be photographed. The user selects one of buttons 903 to 906 depending on the image displayed in the area 902. In this way, the information collection system 1 also photographs images of areas other than the injured or ill area. This allows the doctor to more clearly identify the cause of the first symptom, etc. If the user cannot photograph the object that caused the symptom because it is not nearby, for example, the user presses button 905 ("not nearby"). By pressing button 905, the user can skip photographing.

[0070] In the explanation of the diagnostic information collection process 200 and the diagnostic information collection process 800, the first group of questions is determined according to symptoms determined from an image of an affected area. The operation terminal 100 displays questions according to the received first group of questions. The operation terminal 100 may change the next question to be presented according to the user's answer from the received first group of questions. An example of changing the next question to be presented according to the user's answer will be explained with reference to FIGS. 10(a) to 10(e).

[0071] FIG. 10(a) is a display example of a screen 1000 (step S201) on which a user takes an image. Similar to screen 700 in FIG. 7(a), screen 1000 displays an area 1001 for displaying a subject, a shooting button, and a button 1002 for proceeding to the next process. Screen 1000 shows a state in which an image of a hand being bitten by an animal is displayed in area 1001. When CPU 101 of operation terminal 100 detects that button 1002 has been pressed, it proceeds to the next process.

[0072] FIG. 10(b) is an example of a screen 1010 that displays a first set of questions (step S204) and accepts answers from the user (step S205). Screen 1010 is an example of a screen that is displayed when the first symptom is determined to be an "animal bite." Screen 1010 displays a question ("What bit you?"), answer options 1011 to 1015 ("Dog," "Cat," "Snake," and "I don't know"), and a button 1015 for proceeding to the next process. When option 1011 ("Dog") is selected and button 1015 is pressed, CPU 101 displays the screen shown in FIG. 10(c) as the next screen. When option 1013 ("Snake") is selected and button 1015 is pressed, CPU 101 displays the screen shown in FIG. 10(d) as the next screen.

[0073] FIG. 10(c) is an example of a screen 1020 that displays the question about "dogs" selected on the screen 1010 ("Is it a stray dog?") and answer options.

[0074] FIG. 10(d) is an example of a screen 1021 that displays the question about "snakes" selected on the screen 1010 ("Do you know what kind of snake it is?") and answer options.

[0075] After answering the questions shown in Figure 10(c) or 10(d), CPU 101 displays screen 1030 shown in Figure 10(e). Screen 1030 is an example of a screen that displays a common question regardless of the type of animal that bitten the person (the cause of the first symptom). Screen 1030 displays a question asking about the size of the wound and options for answering the question.

[0076] In this way, CPU 101 changes the question to be presented on the next screen depending on the answer to the previous question. The question to be presented on the next screen may be, for example, a question that specifies more detailed content of the answer to the previous question. This allows information collection system 1 to record detailed information about symptoms depending on the user's answer.

[0077] <Embodiment 2> In the first embodiment, the information collection system 1 presents a second set of questions regarding the second symptom based on the image of the affected area or the answers to the first set of questions. In the second embodiment, the information collection system 1 prompts the patient to take an image of the area exhibiting the second symptom based on the image of the affected area or the answers to the first set of questions. This allows the information collection system 1 to acquire an image of the second symptom related to the first symptom and obtain information to support the doctor's diagnosis.

[0078] <Diagnosis information collection process 1100> The configuration of the information collection system 1 of the second embodiment is the same as the configuration (FIG. 1) of the first embodiment. The diagnostic information collection process 1100 will be described below with reference to FIG.

[0079] Fig. 11 is a flowchart of diagnostic information collection processing 1100. With regard to the processing of operation terminal 100 in Fig. 11, the processing of steps S1101 to S1106 is the same as the processing of steps S201 to S206 in Fig. 2. Similarly, with regard to the processing of analysis device 110, the processing of steps S1111 to S1115 is the same as the processing of steps S211 to S217 in Fig. 2. In the explanation of diagnostic information collection processing 1100, explanation of processing common to diagnostic information collection processing 200 will be omitted, and the following processing that is different will be explained.

[0080] In step S1116, the CPU 111 of the analysis device 110 determines the second symptom based on the image of the affected area or the answers to the first group of questions, and determines information (photographing instruction information) that instructs capturing an image to assist in diagnosis. The photographing instruction information includes the area showing the second symptom as a photographing item. There may be one or more photographing items. Furthermore, the photographing instruction information may include information on the size of the subject, the orientation of the subject, and the brightness of the image, in addition to the area showing the second symptom.

[0081] In step S1117, the CPU 111 transmits the image capturing instruction information to the operation terminal 100. In step S1107, the CPU 101 of the operation terminal 100 receives the image capturing instruction information from the analysis device 110.

[0082] In step S1108, the CPU 101 displays imaging instruction information on the display unit 106, prompting the user to capture an image of the area showing the second symptom. By prompting the user to capture an image of the area showing the second symptom, the information collection system 1 can acquire not only an image of the area showing the first symptom (affected area image; first image), but also an image of the area showing the second symptom (second image).

[0083] In step S1109, CPU 101 captures a second image based on the received image capture instruction information. Note that the number of second images captured is not limited to one. CPU 101 may perform control so that multiple second images are captured depending on the first symptom or the answers to the first set of questions. When CPU 101 detects that the capture of the second images has ended, the process proceeds to step S1110.

[0084] In step S1110, CPU 101 displays the results acquired by information collection system 1 on display unit 106. The results acquired by information collection system 1 include a first image, a first symptom, a first group of questions, answers to the first group of questions, a second image, and a second symptom. When CPU 101 receives an instruction from the user to end diagnostic information collection process 1100, it ends diagnostic information collection process 1100.

[0085] 12(a) to 12(c) are examples of displays on the display unit 106 of the operation terminal 100 related to the diagnostic information collection process 1100. Note that in FIGS. 12(a) to 12(c), an example will be described in which the first symptom is determined to be "lymphoma."

[0086] FIG. 12(a) shows a first set of questions (step S1104) and asks the user for answers. 12 is a display example of a screen 1200 (step S1105) for receiving a response. Screen 1200 shows a state in which the question "Do you feel any discomfort in your mouth?" from the first question group is displayed, and option 1202 ("Yes") is selected from answer options 1201 to 1203.

[0087] FIG. 12(b) is an example of a screen 1210 (step S1109) that displays shooting instruction information (step S1108) and captures the second image. Screen 1210 displays item 1211 and area 1212. Item 1211 displays a message urging the user to capture the second image ("Please take a picture so that your throat is clearly visible"). Area 1212, like area 701 in FIG. 7(a), displays a live view of the subject being captured. On screen 1210, area 1212 displays the user's throat.

[0088] 12(c) is a display example of the results acquired by information collection system 1 (step S1110). Screen 1220 displays the user's answers to the first group of questions (items 1221), area 1222, and acquired images 1223 to 1225. Image 1223 is the first image, and images 1224 and 1225 are second images. Images 1223 to 1225 are displayed as thumbnails, and when one of the images is selected, the selected image is enlarged and displayed in area 1222. The user can refer to screen 1220 to check the answers and also the captured images.

[0089] In the second embodiment, the information collection system 1 prompts the patient to take an image of a region exhibiting a second symptom based on an image of the affected area or answers to the first set of questions. This allows the information collection system 1 to acquire an image of a region exhibiting the first symptom as well as an image of a region exhibiting a second symptom associated with the first symptom, thereby assisting the doctor in making a diagnosis.

[0090] <Embodiment 3> An information collection system 1 according to the third embodiment performs processing that combines the processing according to the first and second embodiments. That is, the information collection system 1 determines a first symptom based on an image of the affected area and presents a first set of questions including questions about the first symptom. The information collection system 1 determines a second symptom based on the image of the affected area and the answers to the first set of questions. The information collection system 1 presents a second set of questions including questions about the second symptom and further prompts the patient to take an image of a region exhibiting the second symptom. As a result, the information collection system 1 can obtain the answers to the second set of questions and an image of the region exhibiting the second symptom, and obtain information to support a doctor's diagnosis.

[0091] <Diagnostic information collection process 1300> The configuration of the information collection system 1 of the third embodiment is the same as the configuration (FIG. 1) of the first embodiment. The diagnostic information collection process 1300 will be described below with reference to FIG.

[0092] Fig. 13 is a flowchart of diagnostic information collection processing 1300. With regard to the processing of operation terminal 100 in Fig. 13, the processing of steps S1301 to S1306 and steps S1308 to S1309 are the same as the processing of steps S201 to S206 and steps S208 to S209, respectively, in Fig. 2. Similarly, with regard to the processing of analysis device 110, the processing of steps S1321 to S1326 are the same as the processing of steps S211 to S216 in Fig. 2. In the explanation of diagnostic information collection processing 1100, explanation of processing common to diagnostic information collection processing 200 will be omitted, and the following processing that is different will be explained.

[0093] In step S1327, the CPU 111 of the analysis device 110 determines information (photographing instruction information) that instructs that an image for assisting diagnosis be photographed. The photographing instruction information includes a region showing the second symptom as a photographing item. Step S1327 is the same as step S in FIG. This is the same processing as 1116.

[0094] In step S1328, the CPU 111 transmits to the operation terminal 100 the second group of questions determined in step S1326 and the shooting instruction information determined in step S1327.

[0095] In step S1307, the CPU 101 of the operation terminal 100 receives the second set of questions and the imaging instruction information from the analysis device 110.

[0096] In step S1310, CPU 101 displays imaging instruction information. In step S1311, CPU 101 captures an image (second image) of a region exhibiting a second symptom. Steps S1310 to S1311 are the same as the processes in steps S1108 to S1109 in FIG.

[0097] In step S1110, the CPU 101 displays the results acquired by the information collection system 1 on the display unit 106. The results acquired by the information collection system 1 include an image of the affected area (first image), first symptoms, a first group of questions, answers to the first group of questions, a second image, second symptoms, a second group of questions, and answers to the second group of questions. When the CPU 101 receives an instruction from the user to end the diagnostic information collection process 1300, it ends the diagnostic information collection process 1300.

[0098] 14(a) to 14(c) are examples of displays on the display unit 106 of the operation terminal 100 relating to the diagnostic information collection process 1300. Note that in FIGS. 14(a) to 14(c), an example will be described in which the first symptom is determined to be "lymphoma."

[0099] 14(a) is an example of a screen 1400 (step S1309) that displays the second group of questions (step S1308) and accepts an answer from the user. Screen 1400 shows a state in which the question "Do you have a sore throat?" from the second group of questions is displayed, and option 1402 ("A little sore") is selected from answer options 1401 to 1404.

[0100] FIG. 14(b) is an example of a display screen 1410 (step S1311) that displays imaging instruction information (step S1310) and captures the second image. Screen 1410 displays a message prompting the user to capture the second image, item 1411, area 1412, and area 1413. Screen 1410 displays a message prompting the user to capture the second image, saying, "Please capture the throat." Item 1411 displays imaging points based on the imaging instruction information. Area 1412 displays good examples of the second image. Area 1413, like area 701 in FIG. 7(a), displays a live view of the subject being captured. The user can capture the second image while referring to the imaging points and good examples of images. This allows the information collection system 1 to acquire images that are useful for diagnosis.

[0101] FIG. 14(c) is a display example of screen 1420 (step S1312) of the results acquired by information collection system 1. Screen 1420 displays the user's answers (items 1421) to the first and second question groups, area 1422, and acquired images 1423 to 1424. Image 1423 is the first image, and image 1424 is the second image. Images 1423 to 1424 are displayed as thumbnails, and when one of the images is selected, the selected image is enlarged and displayed in area 1422. The user can refer to screen 1420 to check the answers and the first and second images that were taken.

[0102] In this way, in the diagnostic information collection process 1300, the information collection system 1 presents a second group of questions based on the image of the affected area and the answers to the first group of questions, and further prompts the patient to take an image of a part showing the second symptom. The information collection system 1 can obtain detailed information and images useful for diagnosis, as well as obtain detailed information about the second symptom and an image of the area showing the second symptom.

[0103] 15(a) and (b) are examples of displays on the display unit 106 of the operation terminal 100 involved in the diagnostic information collection process 1300. The basic screen configuration of FIG. 15(a), which is the capture screen for the second image, is the same as FIG. 14(b), but the screen configuration of FIG. 15(b), which is the display screen for the results, is different from FIG. 14(c). Below, we will explain the differences between FIGS. 15(a) and (b) and FIGS. 14(b) and (c), mainly.

[0104] FIG. 15(a) is an example of a screen displaying shooting instruction information (step S1310) and capturing a second image (step S1311), similar to FIG. 14(b). Screen 1500 displays a message urging the user to capture a second image, item 1501, area 1502, and area 1503. Screen 1500 displays a message urging the user to capture a second image ("Please capture a picture of your face."). Item 1501 displays the shooting point. Area 1502 displays good examples of face images, and area 1503 displays the image being captured. Similar to FIG. 14(b), the user can capture a second image while referring to the shooting point and good examples of images.

[0105] FIG. 15(b) is a display example of the results acquired by the information collection system 1 (step S1312). Screen 1510 displays the user's answers to the first group of questions (item 1511), area 1512, and acquired images 1513 to 1515. Screen 1510 also displays instructions for taking pictures (photography points) in item 1516. Item 1516 displays instructions for taking pictures of an image selected from the thumbnail images. On screen 1510, image 1515 is selected from the thumbnail images, and the instructions for taking pictures of image 1515 are displayed in item 1516.

[0106] The instructions given at the time of imaging based on the imaging instruction information may be embedded as metadata in the captured image and saved. This allows the information collection system 1 to display the instructions given at the time of imaging together with the first image or the second image at the time of diagnosis. By displaying the instructions given at the time of imaging, the doctor can confirm the intention behind the image being captured.

[0107] <Embodiment 4> In the first to third embodiments, the information collection system 1 first acquires an image and determines the first symptom based on the acquired image. In the fourth embodiment, unlike the first to third embodiments, the information collection system 1 first presents a set of preliminary questions and prompts the user to take an image of the affected area based on the answers to the preliminary questions. The information collection system 1 determines the first symptom based on the answers to the questions and the image of the affected area. This allows the information collection system 1 to accurately determine the first symptom.

[0108] <Diagnostic information collection process 1600> The configuration of the information collection system 1 of the fourth embodiment is the same as the configuration (FIG. 1) of the first embodiment. The diagnostic information collection process 1600 will be described below with reference to FIG.

[0109] 16 is a flowchart of the diagnostic information collection process 1600. In the process of the operation terminal 100 in FIG. 16, step S1604 and steps S1606 to S1609 are the same as the process of step S201 and steps S207 to S210 in FIG. 2, respectively. Similarly, in the process of the analysis device 110, step S1614 is the same as the process of step S217 in FIG. 2. In the explanation of the diagnostic information collection process 1600, the same steps as those in the diagnostic information collection process 200 will be explained. The explanation of the processing will be omitted, and the following processing that is different will be explained.

[0110] In step S1601, the CPU 101 of the operation terminal 100 displays a first group of questions. The first group of questions displayed in step S1601 includes questions for confirming the symptoms the user is experiencing and questions for determining whether an image is required. The questions for confirming the symptoms include questions for identifying the type of symptom, the location of the symptom, and the severity of the symptom. The questions for determining whether an image is required include, for example, questions for determining whether the symptom is visible on the surface.

[0111] In step S1602, CPU 101 accepts answers to the first group of questions from the user. In step S1603, CPU 101 displays the image capture items determined based on the content accepted in step S1602, and prompts the user to capture an image of the affected area. The image capture items may be items that do not specify a specific area, such as "affected area," or items that specify a specific area, such as "eyes."

[0112] If CPU 101 determines from the content received in step S1602 that images are not required, it may skip steps S1603 and S1604 and proceed to step S1605. It may be determined that images of the affected area are not required, for example, when a response regarding a symptom that does not appear externally (e.g., abdominal pain) is received. In step S1605, CPU 101 transmits the responses to the first group of questions and the images to analysis device 110.

[0113] In step S1611, CPU 111 of analysis device 110 receives the answers to the first group of questions and the image from operation terminal 100. In step S1612, CPU 111 determines the first symptom based on the answers to the first group of questions or based on the answers to the first group of questions and the image of the affected area. Thus, unlike embodiments 1 to 3 in which the first symptom is determined based on the image of the affected area, in embodiment 4, CPU 111 determines the first symptom based on the answers to the first group of questions and the image of the affected area. This allows CPU 111 to accurately determine the first symptom.

[0114] In step S1613, CPU 111 determines a second set of questions. The second set of questions is determined based on the first symptom. For example, a case will be described where the first symptom is infectious conjunctivitis. Infectious conjunctivitis may be accompanied by a fever such as pool fever. Therefore, when CPU 111 determines that the first symptom is infectious conjunctivitis, the second set of questions includes questions about fever.

[0115] 17(a) to 17(c) are display examples of the display unit 106 of the operation terminal 100 involved in the diagnostic information collection process 1600. FIG. 17(a) is a display example of a screen 1700 (step S1602) that displays a first group of questions (step S1601) and accepts answers from the user. The screen 1700 displays an item 1701 that displays a question, and options 1702 to 1706. In FIG. 17(a), item 1701 displays "What symptoms are you experiencing?" as a question from the first group of questions for confirming symptoms. Options 1702 are options that identify the type of symptom. Options 1703 to 1705 are options that narrow down the area where the symptom is present. Options 1706 are options that identify the severity of the symptom. From the answers to options 1702 to 1706, the information collection system 1 can confirm the symptoms that the user is experiencing.

[0116] Fig. 17(d) is an example of the options displayed in Fig. 17(a). In Fig. 17(d), item a corresponds to option 1702, item b corresponds to option 1703, item c corresponds to option 1704, item d corresponds to option 1705, and item e corresponds to option 1706.

[0117] Item a is an option that specifies the type of symptom. Item b is an option that specifies the body part where the symptom is present. Item c is an option that more accurately specifies the body part selected in item b. For example, if "face" is selected in option 1703 (item b), option 1704 (item c) displays "eyes," "nose," and "mouth." Item d is an option that more accurately specifies the body part selected in item c. For example, if "eyes" is selected in option 1704 (item c), option 1705 (item d) displays "left eye" and "right eye." Item e is an option that more accurately specifies the severity of the symptom selected in item a. For example, if "painful" is selected in option 1702 (item a), option 1706 (item e) displays "slight pain" and "very pain." Note that the number of items and options is just an example, and items and options corresponding to various symptoms are prepared in advance.

[0118] Fig. 17(b) is a display example of a screen 1710 (step S1604) that displays the imaging items (step S1603) and captures an image. Screen 1710 displays items 1711 and an area 1717. In Fig. 17(b), item 1711 displays a message prompting the user to take an image ("Please take an image of the affected area"). Area 1717 displays the image being captured.

[0119] 17(c) is an example of a screen 1720 (step S1608) that displays the second group of questions (step S1607) and accepts answers from the user. Screen 1720 displays an item 1721 that displays a question and answer options. On screen 1720, item 1721 displays "Do you have a fever?" as an example of the second group of questions.

[0120] In this way, in the diagnostic information collection process 1600, the information collection system 1 determines the first symptom based on the answers to the first group of questions and the image of the affected area. The information collection system 1 can accurately determine the first symptom.

[0121] Here, an example of changing the questions to be presented based on information about the user will be described. Some symptoms are characterized by the gender or age of the patient who develops them. For example, approximately 98% of gout patients are male. When symptoms similar to those of gout are acquired, the information collection system 1 can accurately determine the symptoms by taking the user's gender into account. Furthermore, 80 to 90% of hand, foot, and mouth disease patients are children under the age of five. When symptoms similar to those of hand, foot, and mouth disease are acquired, the information collection system 1 can accurately determine the symptoms by taking the user's age into account. Therefore, the information collection system 1 acquires information about the user and changes the questions to be presented depending on the acquired information. This allows the information collection system 1 to accurately determine the symptoms.

[0122] 18(a) to 18(e) are examples of displays on the display unit 106 of the operation terminal 100 when the first group of questions and the second group of questions are determined based on information about the user. 18(a) and 18(b) are examples of displays on a screen that displays the first group of questions (step S1601) and accepts answers from the user (step S1602). 18(c) and 18(d) are examples of displays on a screen that displays the second group of questions (step S1606) and accepts answers from the user (step S1607).

[0123] In FIG. 18(a), a screen 1800 displays an item 1801 that displays a question about the user, and options 1802 to 1803. In FIG. 18(a), item 1801 displays "Please enter your gender and age" as an example of a first group of questions. Option 1802 is an option for specifying gender. Option 1803 is an option for specifying age. From the answers to options 1802 to 1803, the information collection system 1 acquires information about the user's gender and age.

[0124] 18(b), a screen 1810 displays an item 1811 that displays a question about symptoms, and options 1812 to 1817. From the answers to the options 1812 to 1817, the information collection system 1 acquires information about the type of symptom, the location of pain, and the degree of pain.

[0125] 18(c) and 18(d) are examples of displaying questions about gout. If symptoms similar to those of gout are acquired from the responses to screens 1800 and 1810, CPU 111 of analysis device 110 includes questions about gout in the second group of questions. CPU 101 of operation terminal 100 presents questions about gout. For example, CPU 101 may display a screen asking whether or not the user has joint pain, as shown in FIG. 18(c). CPU 101 may also display a screen asking whether or not the user has kidney stones, as shown in FIG. 18(d). In this way, by presenting the first group of questions and the second group of questions based on information about the user, symptoms can be accurately determined.

[0126] The CPU 111 of the analysis device 110 may determine the questions to be presented taking into consideration not only the user's gender and age, but also other information. For example, the CPU 111 may record data previously answered by the user, such as medical history, and determine the questions to be presented based on the past answers. For example, cerebral infarction is a disease with a high recurrence rate. Cerebral infarction is also one of the leading causes of death among Japanese people, so early detection is important. Symptoms of cerebral infarction include numbness in either half of the body or in the limbs, dizziness, vomiting, and slurred speech. If these symptoms are present, the information collection system 1 determines the questions to be presented by referring to the patient's past answers. This allows the information collection system 1 to present the user with questions that will lead to early detection of cerebral infarction.

[0127] <Other embodiments> Although the present invention has been described in detail above based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Parts of the above-described embodiments may be combined as appropriate.

[0128] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a recording medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]

[0129] 100: Operation terminal 101: CPU 105: Image sensor 106: Display unit 107: Operation unit 108: Communication unit 110: Analysis device 111: CPU 114: Communication department

Claims

1. image acquisition means for acquiring an image of the affected area of ​​the user; a determining means for determining which of a plurality of symptoms the image of the affected area shows; A control means for controlling to present a question and receive an answer to the question, presenting a first group of questions including questions regarding a first symptom determined based on the image of the affected area; a control means for presenting a second group of questions including questions regarding a second symptom determined based on the image of the affected area and the answers to the first group of questions; and the control means presents imaging instruction information, which is information instructing the user to capture an image to assist diagnosis, when prompting the user to capture an image; the photographing instruction information is stored as metadata of an image photographed based on the photographing instruction information; An information collection system comprising:

2. the control means prompts the user to take a re-image of the affected area when the determination means has not determined that the first symptom exists based on the image of the affected area. The information collection system according to claim 1 .

3. the control means prompts the user to take a photograph of the subject to explain the cause of the first symptom.

3. The information collection system according to claim 1.

4. the control means prompts the imaging of the region exhibiting the second symptom. The information collection system according to any one of claims 1 to 3.

5. The imaging instruction information includes at least one of an imaging region, an imaging direction, a size of the imaging target, and a setting parameter of the imaging device. The information collection system according to any one of claims 1 to 4.

6. The control means determines the next question depending on the user's answer to the immediately preceding question. Determine, The information collection system according to any one of claims 1 to 5.

7. the control means determines the first set of questions and the second set of questions based on information about the user or answers given by the user in the past; The information collection system according to any one of claims 1 to 6.

8. The determination means determines which of a plurality of symptoms the image of the affected area represents by using a trained model trained using images acquired by photographing each symptom. The information collection system according to any one of claims 1 to 7.

9. the control means presents a group of preliminary questions for determining which of a plurality of symptoms the subject is experiencing; The information collection system according to claim 1 , wherein the first symptom is determined based on answers to the preliminary group of questions and an image of the affected area.

10. The apparatus further comprises a recording means for recording in a recording unit, in association with the image of the affected area, the first symptom, the first group of questions, the answers to the first group of questions, the second symptom, the second group of questions, the answers to the second group of questions, and an image obtained by photographing the user in response to a prompt from the control means. The information collection system according to any one of claims 1 to 9.

11. 1. A method of collecting information, comprising: an image acquisition step in which a computer acquires an image of the affected area of ​​the user; a determining step in which the computer determines which of a plurality of symptoms the image of the affected area shows; a control step of controlling the computer to present a question and receive an answer to the question, the computer presents a first set of questions including questions regarding a first symptom determined based on the image of the affected area; a control step in which the computer presents a second set of questions including questions regarding a second symptom determined based on the image of the affected area and the answers to the first set of questions; and In the control step, the computer presents imaging instruction information, which is information instructing the user to capture an image that assists diagnosis, when prompting the user to capture an image; the photographing instruction information is stored as metadata of an image photographed based on the photographing instruction information; An information gathering method comprising:

12. A program for causing a computer to execute each step of the information gathering method according to claim 11.

Images