Computer program, information processing method, and information processing device

Abstract

The present invention provides a computer program, an information processing method, and an information processing device that are expected to facilitate the use by medical institutions of learning models that perform judgments based on medical images. [Solution] The computer program of this embodiment acquires related information associated with the storage location of a patient's medical images from medical institution staff, transmits the acquired related information to a server device equipped with a learning model that performs inference based on the medical images, acquires from the server device the results of inference performed using the learning model based on the medical images acquired from the storage location based on the related information, and causes the computer to execute a process of outputting the acquired inference results.

Description

[Technical Field]

[0001] The present disclosure relates to a computer program, an information processing method, and an information processing device that perform processing related to a medical institution. [Background technology]

[0002] Patent Document 1 proposes an oral health prediction device that uses a machine learning algorithm. This oral health prediction device predicts oral health status by comprehensively analyzing the presence or absence of orthodontic treatment, the state of dental caries, the state of prosthetic appliances, etc., based on oral photographs uploaded by the user using a user terminal through photograph analysis using a machine learning algorithm, and provides the user with oral health status prediction information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2022-508923 Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure provides a computer program, an information processing method, and an information processing device that are expected to facilitate medical institutions' use of learning models that perform judgments based on medical images, etc. [Means for solving the problem]

[0005] A computer program according to one embodiment causes a computer to execute a process of acquiring related information associated with the storage location of a patient's medical images from a medical institution's staff member, transmitting the acquired related information to a server device equipped with a learning model that performs inference based on the medical images, acquiring from the server device the results of inference performed using the learning model based on the medical images acquired from the storage location based on the related information, and outputting the acquired inference results. [Effects of the Invention]

[0006] The present disclosure is expected to make it easier for medical institutions to use learning models that make judgments based on medical images. [Brief explanation of the drawings]

[0007] [Figure 1] 1 is a schematic diagram illustrating an overview of an information processing system according to an embodiment of the present invention. [Figure 2] FIG. 1 is a block diagram illustrating an example of a configuration of a smartphone according to an embodiment of the present invention. [Figure 3] 1 is a block diagram showing an example of the configuration of an AI determination server device according to the present embodiment. FIG. [Figure 4] 10 is a flowchart showing an example of a procedure of processing performed by the smartphone 1 according to the present embodiment. [Figure 5] FIG. 2 is a schematic diagram illustrating an example of a top screen. [Figure 6] FIG. 10 is a schematic diagram showing an example of a two-dimensional code acquisition screen. [Figure 7] FIG. 10 is a schematic diagram showing an example of a determination result display screen. [Figure 8] 10 is a flowchart showing an example of a processing procedure performed by the AI ​​determination server device according to the present embodiment. [Figure 9] FIG. 10 is a schematic diagram showing another example of the determination result display screen. DETAILED DESCRIPTION OF THE INVENTION

[0008] Specific examples of information processing systems according to embodiments of the present disclosure will be described below with reference to the drawings. Note that the present disclosure is not limited to these examples, but is defined by the claims, and is intended to include all modifications within the meaning and scope of the claims.

[0009] <System Overview> FIG. 1 is a schematic diagram for explaining an overview of an information processing system according to this embodiment. The information processing system according to this embodiment enables a doctor working at a general dental clinic (e.g., a dental clinic or dental office) to use various services provided by a regional base hospital (e.g., a university hospital). The information processing system according to this embodiment includes a smartphone 1 carried by a doctor at the dental clinic and a PC (personal computer) 2 provided at the dental clinic. The information processing system according to this embodiment also includes multiple server devices, such as an authentication server device 3, an AI (artificial intelligence) determination server device 4, and a reservation server device 5, all of which are provided at the regional base hospital. The information processing system according to this embodiment may also include a smartphone 6 carried by a patient who receives a dental clinic.

[0010] In the information processing system according to this embodiment, IDs are assigned to people associated with a regional base hospital in order to use the services. For example, if the regional base hospital is a university hospital, an ID may be assigned in advance to a doctor who is a graduate (alumna, alumna) of this university. A doctor at a dental clinic can use various services by logging in to the information processing system according to this embodiment by entering his or her ID and password, for example, on a smartphone 1. Note that in this embodiment, IDs may or may not be assigned to patients who visit a dental clinic. Furthermore, IDs may be assigned not only to university graduates, but also to various other people, such as university students and professors, as well as doctors and nurses working at a university or university hospital.

[0011] The authentication server device 3 at the regional base hospital manages IDs assigned to users such as doctors at dental clinics. The authentication server device 3 stores information required for authentication processing, such as passwords, along with the IDs in a database, and performs authentication processing to acquire the ID and password entered by the user on the smartphone 1 and determine whether or not the user is permitted to log in to the information processing system. If the authentication processing is successful, the authentication server device 3 permits the user to use, via the smartphone 1, services such as an AI judgment service provided by the AI ​​judgment server device 4 and a reservation service provided by the reservation server device 5.

[0012] The AI ​​judgment service provided by the AI ​​judgment server device 4 of the information processing system according to this embodiment performs image judgment processing using a learning model that has undergone machine learning in advance, based on medical images such as X-ray images provided by a user. In the AI ​​judgment service according to this embodiment, for example, a user uses a PC 2 installed in a dental clinic to upload X-ray images of a patient to be judged to the AI ​​judgment server device 4. The AI ​​judgment server device 4 stores the X-ray images uploaded from the dental clinic's PC 2 in a database and transmits information (related information) indicating the storage location of the X-ray images in the database to the PC 2 as a two-dimensional code. The user can obtain information about the storage location of the X-ray images by displaying the two-dimensional code received from the AI ​​judgment server device 4 on the PC 2 and reading the two-dimensional code with the smartphone 1.

[0013] The user specifies the storage location of the X-ray image using the 2D code read by the smartphone 1 and requests a judgment from the AI ​​judgment server device 4. In this embodiment, the AI ​​judgment server device 4 determines whether a predetermined procedure (e.g., tooth extraction) can be performed at the user's dental clinic based on the X-ray image of the patient's teeth, i.e., whether the patient's tooth extraction can be performed at the user's dental clinic or should be performed at a more well-equipped regional base hospital (e.g., a university hospital), and transmits the judgment result to the smartphone 1. If it is determined that the tooth extraction can be performed at the dental clinic, the user (the doctor) performs the patient's tooth extraction at the dental clinic. In the information processing system according to this embodiment, predetermined procedures suitable for determining whether the procedure should be performed at a general dental clinic or a more well-equipped regional base hospital include tooth extraction, treatment for periodontal disease, oral mucosal disease, orthodontics, or pediatric treatment.

[0014] If it is determined that the patient's tooth extraction procedure should be performed at a regional base hospital, the user (doctor) uses the reservation service provided by the reservation server device 5 on the smartphone 1 to refer the patient to the regional base hospital. At this time, the user provides contact information such as the patient's email address to the reservation server device 5. Thereafter, the reservation server device 5 communicates with the smartphone 6 or the like carried by the patient based on the provided contact information, and performs reservation processing to determine the date and time for the tooth extraction procedure at the regional base hospital.

[0015] In this embodiment, the information sent from the user's smartphone 1 and the dental clinic's PC 2 to the AI ​​judgment server device 4 does not include information that could identify an individual patient, such as the name, address, telephone number, or email address. This is to prevent the identification of the person to whom the X-ray images uploaded to the AI ​​judgment server device 4 belong. However, information that cannot identify an individual patient but can be used as a reference for judgment, such as the patient's gender or age, may be provided to the AI ​​judgment server device 4.

[0016] In addition, in this embodiment, three server devices, the authentication server device 3, the AI ​​determination server device 4, and the reservation server device 5, work together to perform the above processing, but this is not limited to this. By integrating or dividing the processing performed by the authentication server device 3, the AI ​​determination server device 4, and the reservation server device 5, the processing may be performed by two or fewer server devices, or by four or more server devices. For example, the AI ​​determination server device 4 may be divided into a server device that holds a database for storing X-ray images and a server device that holds AI (learning model) for judgment.

[0017] <Device configuration> FIG. 2 is a block diagram showing an example of the configuration of a smartphone 1 according to this embodiment. The smartphone 1 according to this embodiment is a portable information processing device carried by a user, such as a doctor at a dental clinic, and can be realized by installing a predetermined application program or the like on a general-purpose information processing device. The information processing device used by the user is not limited to the smartphone 1. However, from the viewpoints of ease of application program development, user convenience, and the like, the smartphone 1 is a suitable information processing device used by the user. The smartphone 1 according to this embodiment is configured to include a processing unit 11, a storage unit 12, a communication unit 13, a display unit 14, an operation unit 15, a camera 16, and the like.

[0018] The processing unit 11 is configured using an arithmetic processing device such as a CPU (Central Processing Unit), an MPU (Micro-Processing Unit) or a GPU (Graphics Processing Unit), and a storage device such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The processing unit 11 reads and executes a program 12a stored in the storage unit 12 to perform various processes such as authentication processing with the authentication server device 3, processing to acquire a two-dimensional code displayed on the PC 2, judgment processing using the AI ​​judgment server device 4, and reservation processing using the reservation server device 5.

[0019] The storage unit 12 is configured using a storage device such as a flash memory. The storage unit 12 stores various programs executed by the processing unit 11 and various data required for the processing of the processing unit 11. In the present embodiment, the storage unit 12 stores the program 12a executed by the processing unit 11. In the present embodiment, the program (computer program, program product) 12a is distributed by a remote server device or the like, acquired by the smartphone 1 via communication, and stored in the storage unit 12. However, the program 12a may be provided in a form recorded on a recording medium 99 such as a memory card or an optical disc, and the smartphone 1 may read the program 12a from the recording medium 99 and store it in the storage unit 12. The program 12a may be provided in a form distributed via a network or in a form recorded on the recording medium 99.

[0020] The communication unit 13 transmits and receives data to and from other devices via various networks N, such as a mobile phone communication network, a LAN (Local Area Network), and the Internet. In this embodiment, the communication unit 13 transmits and receives data to and from the authentication server device 3, the AI ​​judgment server device 4, and the reservation server device 5 via the network N. The communication unit 13 transmits and receives information such as a user's ID and password to and from the authentication server device 3, for example. The communication unit 13 transmits and receives information such as information on the storage location of an X-ray image obtained by reading a two-dimensional code and a judgment result based on the X-ray image to and from the AI ​​judgment server device 4, for example. The communication unit 13 also transmits and receives information on patients who will undergo tooth extraction procedures at a regional base hospital to and from the reservation server device 5.

[0021] The display unit 14 is configured using a liquid crystal display or the like, and displays various images, characters, etc. based on the processing of the processing unit 11. In this embodiment, the display unit 14 displays various screens such as a login screen for using the services provided by the information processing system according to this embodiment, a two-dimensional code reading screen, and a screen for displaying the determination results.

[0022] The operation unit 15 accepts user operations and notifies the processing unit 11 of the accepted operations. The operation unit 15 accepts user operations via an input device such as a touch panel or mechanical buttons provided on the surface of the display unit 14. The operation unit 15 may also be, for example, an input device such as a mouse and a keyboard, and these input devices may be configured to be detachable from the smartphone 1.

[0023] The camera 16 is configured using an imaging element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The camera 16 is provided on the housing of the smartphone 1, and provides an image captured by the imaging element to the processing unit 11.

[0024] In addition, in the smartphone 1 according to this embodiment, the processing unit 11 reads and executes the program 12a stored in the storage unit 12, whereby the authentication processing unit 11a, the code acquisition unit 11b, the determination processing unit 11c, the reservation processing unit 11d, the display processing unit 11e, etc. are realized as software functional units in the processing unit 11. Note that in this diagram, functional units related to the patient determination processing using AI are shown as functional units of the processing unit 11, and functional units related to other processing are not shown.

[0025] The authentication processing unit 11a communicates with the authentication server device 3 via the communication unit 13 to perform a user login process for the information processing system according to this embodiment. The authentication processing unit 11a receives, for example, an ID and a password from the user and transmits the received information, such as the ID and password, to the authentication server device 3. The authentication server device 3 receives the ID and password from the smartphone 1, determines whether or not the received information matches the ID and password registered in its own database, and transmits the determined authentication result to the smartphone 1. The authentication processing unit 11a receives the authentication result from the authentication server device 3, and if the authentication is successful, displays, for example, a menu screen for using services provided by the information processing system according to this embodiment. If the authentication is unsuccessful, it displays a message prompting the user to re-enter the ID and password. Note that the authentication process performed between the smartphone 1 and the authentication server device 3 is not limited to one based on the input of an ID and password, and various authentication methods, such as biometric authentication or SMS (Short Message Service) authentication, may be used.

[0026] The code acquisition unit 11b performs a process of acquiring the two-dimensional code displayed on the PC 2. For example, the code acquisition unit 11b displays a message prompting the user to photograph the two-dimensional code, activates the camera 16, and accepts a photographing operation by the user via the operation unit 15. The code acquisition unit 11b decodes the two-dimensional code photographed by the camera 16 to acquire information relating to the location where the patient's X-ray image is stored, such as a URL (Uniform Resource Locator), a path or file name of the X-ray image file, and the like.

[0027] The judgment processing unit 11c communicates with the AI ​​judgment server device 4 via the communication unit 13 to make a judgment based on the patient's X-ray image. The judgment processing unit 11c transmits an AI judgment request to the AI ​​judgment server device 4, including information on the storage location of the X-ray image obtained by decoding the two-dimensional code acquired by the code acquisition unit 11b. Upon receiving the AI ​​judgment request from the smartphone 1, the AI ​​judgment server device 4 reads the patient's X-ray image from a database based on the storage location information included in the AI ​​judgment request, performs a judgment using AI, i.e., a learning model generated in advance by machine learning, and transmits the judgment result to the smartphone 1. In this embodiment, the AI ​​judgment server device 4 determines whether or not tooth extraction treatment for this patient can be performed at a dental clinic based on the X-ray image of the patient's teeth. Upon receiving the judgment result from the AI ​​judgment server device 4, the judgment processing unit 11c displays the judgment result on the display unit 14.

[0028] The reservation processing unit 11d performs processing related to a reservation for a patient to receive treatment at a regional base hospital other than the dental clinic by communicating with the reservation server device 5 via the communication unit 13. For example, if the determination processing unit 11c determines that tooth extraction treatment at the dental clinic is impossible, the reservation processing unit 11d refers the patient to the regional base hospital based on a user's operation. The reservation processing unit 11d accepts input of information such as the patient's name and contact email address from the user, and transmits a tooth extraction treatment request including the accepted information to the reservation server device 5. Upon receiving the tooth extraction treatment request from the smartphone 1, the reservation server device 5 transmits an email containing the URL of a web page for making a reservation for tooth extraction treatment to the patient's smartphone 6 based on the patient's contact information included in the request. From then on, communication takes place between the patient's smartphone 6 and the reservation server device 5.

[0029] The display processing unit 11e performs processing to display various characters, images, etc. on the display unit 14. In the present embodiment, the display processing unit 11e displays various screens such as a login screen for the information processing system according to the present embodiment, a menu screen for using services provided by the information processing system according to the present embodiment, a reading screen for reading a two-dimensional code, a screen for displaying the results of AI determination, and a screen for introducing the patient to a regional base hospital and making an appointment for tooth extraction treatment.

[0030] FIG. 3 is a block diagram showing an example configuration of the AI ​​determination server device 4 according to this embodiment. The AI ​​determination server device 4 according to this embodiment is, for example, an information processing device managed and operated by a regional base hospital or a company commissioned by a regional base hospital, and can be realized by installing a predetermined application program or the like on a general-purpose information processing device. Note that the functions of the AI ​​determination server device 4 in this embodiment may be realized by multiple server devices. For example, the server device that manages medical images and the server device that performs determination processing can be separate devices. The AI ​​determination server device 4 according to this embodiment is configured with a processing unit 41, a memory unit 42, a communication unit 43, etc.

[0031] The processing unit 41 is configured using an arithmetic processing device such as a CPU, MPU, GPU, NPU (Neural network Processing Unit) or quantum processor, and storage devices such as a ROM and RAM. The processing unit 41 reads and executes a program 42a stored in the storage unit 42, thereby performing various processes such as a process for managing X-ray images (medical images) sent from the PC 2 of the dental clinic, and a judgment process using AI based on the X-ray images.

[0032] The storage unit 42 is configured using a large-capacity storage device such as a hard disk or an SSD (Solid State Drive). The storage unit 42 stores various programs executed by the processing unit 41 and various data required for the processing of the processing unit 41. In this embodiment, the storage unit 42 stores a program 42a executed by the processing unit 41. The storage unit 42 also includes a model information storage unit 42b that stores information about a learning model that has been machine-learned in advance, and a medical image storage unit 42c that stores X-ray images received from PC 2 at the dental clinic.

[0033] In this embodiment, the program (computer program, program product) 42a is provided in a form recorded on a recording medium 98 such as a memory card or optical disc, and the AI ​​determination server device 4 reads the program 42a from the recording medium 98 and stores it in the memory unit 42. However, the program 42a may also be written to the memory unit 42, for example, during the manufacturing stage of the AI ​​determination server device 4. Alternatively, for example, the program 42a may be distributed by a remote server device or the like and acquired by the AI ​​determination server device 4 via communication. For example, the program 42a may be recorded on the recording medium 98 and read by a writing device and written to the memory unit 42 of the AI ​​determination server device 4. The program 42a may be provided in a form distributed via a network, or may be provided in a form recorded on the recording medium 98.

[0034] The model information storage unit 42b stores information about various pre-generated learning models. The information about the learning models may include, for example, information indicating the configuration of the learning models and information about predetermined internal parameter values. In this embodiment, the learning model used for AI determination is a model generated in advance by machine learning to receive an X-ray image of a patient's teeth as input and output an inference result of whether or not the patient's tooth extraction procedure can be performed at a dental clinic (whether the tooth extraction procedure should be performed at a dental clinic or a regional base hospital). For example, a classification model such as a convolutional neural network (CNN) may be adopted as the learning model. This learning model may be generated in advance by performing so-called supervised machine learning processing using learning data (teacher data) that associates multiple X-ray images taken in advance with a correct answer flag indicating whether or not the dentist or other professional has determined for each X-ray image whether or not the tooth extraction procedure can be performed at a dental clinic. The machine learning processing for generating the learning model may be performed by the AI ​​determination server device 4 or another device.

[0035] The medical image storage unit 42c stores the X-ray images of the patient's teeth received from the dental clinic's PC 2. The AI ​​determination server device 4 may store information such as the dental clinic's identification information or the ID of the dental clinic's doctor in association with the X-ray images in the medical image storage unit 42c, but does not store information that could identify an individual, such as the patient's name or address, in the medical image storage unit 42c.

[0036] The communication unit 43 transmits and receives data to and from other devices via various networks N, such as a mobile phone communication network, a LAN (Local Area Network), and the Internet. In this embodiment, the communication unit 43 transmits and receives data to and from the smartphone 1, the PC 2, and the authentication server device 3 via the network N. The communication unit 43 receives, for example, a request for AI determination transmitted from the smartphone 1, and transmits the result of the AI ​​determination to the smartphone 1. The communication unit 43 receives, for example, an X-ray image of the patient's teeth transmitted from the PC 2. The communication unit 43 receives, for example, a notification from the authentication server device 3 that the user authentication has been successful.

[0037] In the AI ​​judgment server device 4 according to this embodiment, the processing unit 41 reads and executes the program 42a stored in the storage unit 42, thereby realizing a medical image management unit 41a, a judgment processing unit 41b, and the like as software functional units in the processing unit 41. Note that in this figure, functional units related to the process of managing X-ray images sent from the PC 2 and the AI ​​judgment process using the learning model stored in the model information storage unit 42b are shown as functional units of the processing unit 41, and functional units related to other processes are not shown.

[0038] The medical image management unit 41a manages X-ray images of patients' teeth stored in the medical image storage unit 42c. For example, when the communication unit 43 receives an X-ray image transmitted from PC2 at a dental clinic, the medical image management unit 41a stores the X-ray image in the medical image storage unit 42c, adding information such as the date and time of reception or identification information of the PC2 that transmitted the image as needed. The medical image management unit 41a acquires information necessary to read the X-ray image stored in the medical image storage unit 42c, such as information indicating the storage location of the X-ray image in the medical image storage unit 42c, and converts the acquired information into a two-dimensional code. The medical image management unit 41a transmits the acquired two-dimensional code to PC2 that transmitted the X-ray image.

[0039] The determination processing unit 41b makes a determination using the learning model stored in the model information storage unit 42b. The determination processing unit 41b receives an AI determination request from the user's smartphone 1 via the communication unit 43. This AI determination request includes information regarding the storage location of the X-ray image obtained by reading the above two-dimensional code. The determination processing unit 41b reads out the X-ray image of the patient's teeth from the medical image storage unit 42c based on the information included in the received AI determination request. The determination processing unit 41b constructs a learning model based on the information stored in the model information storage unit 42b, inputs the X-ray image read out from the medical image storage unit 42c into the learning model, and obtains an inference result on whether the tooth extraction treatment output by the learning model can be performed at the dental clinic. The determination processing unit 41b transmits the inference result obtained from the learning model to the original requesting smartphone 1.

[0040] <AI Determination Processing> FIG. 4 is a flowchart showing an example of the procedure of the processing performed by the smartphone 1 according to the present embodiment. The authentication processing unit 11a of the processing unit 11 of the smartphone 1 according to the present embodiment performs an authentication process for logging in to the information processing system according to the present embodiment by communicating with the authentication server device 3 via the communication unit 13 (step S1). Since the authentication process is an existing technology, detailed description thereof is omitted.

[0041] After successful authentication, the display processing unit 11e of the processing unit 11 displays a predetermined top screen on the display unit 14 (step S2). FIG. 5 is a schematic diagram showing an example of the top screen. The top screen in this example has, for example, a title string "Regional Base Hospital Portal" displayed at the topmost part, and buttons with labels "First Visit Reservation" and "AI Determination" arranged vertically below it. The user can select either the first visit reservation or the AI determination by performing a touch operation (tap operation) on the two buttons displayed on the top screen.

[0042] The processing unit 11 determines whether AI judgment has been selected on the top screen (step S3). If AI judgment has been selected (S3: YES), the display processing unit 11e displays a two-dimensional code acquisition screen on the display unit 14 to allow the smartphone 1 to acquire the two-dimensional code displayed on the PC 2 (step S4). FIG. 6 is a schematic diagram showing an example of the two-dimensional code acquisition screen. In this example, the two-dimensional code acquisition screen displays, for example, a title string "Read the two-dimensional code" at the top, and a message below the title string reads, "After uploading the X-ray image using your PC, read the two-dimensional code displayed on your PC." This message prompts the user to separately upload X-ray images of the patient's teeth. The user accesses the AI ​​judgment server device 4 using the PC 2 and uploads the X-ray image. After the X-ray image upload is complete, the AI ​​judgment server device 4 transmits a two-dimensional code indicating the storage location of the X-ray image to the PC 2, which then displays the two-dimensional code. An image captured by the camera 16 of the smartphone 1 is displayed within a rectangular frame provided in the center of the illustrated two-dimensional code acquisition screen, and the two-dimensional code is acquired by placing the two-dimensional code displayed by the PC 2 within this frame and performing a touch operation on the "Read" button. When the code acquisition unit 11b of the processing unit 11 receives an operation on the "Read" button while the two-dimensional code acquisition screen is displayed on the display unit 14, it acquires the two-dimensional code captured by the camera 16 (step S5).

[0043] The judgment processing unit 11c of the processing unit 11 transmits an AI judgment request, including information indicating the storage location of the X-ray image obtained by decoding the two-dimensional code acquired in step S5, to the AI ​​judgment server device 4 via the communication unit 13 (step S6). In response to the AI ​​judgment request transmitted by the smartphone 1, the AI ​​judgment server device 4 performs a judgment based on the X-ray image using a learning model and transmits the judgment result to the smartphone 1. The judgment processing unit 11c determines whether or not the judgment result from the AI ​​judgment server device 4 has been received via the communication unit 13 in response to the AI ​​judgment request (step S7). If the judgment result has not been received (S7: NO), the judgment processing unit 11c waits until the judgment result is received.

[0044] If the judgment result is received (S7: YES), the display processing unit 11e displays the received judgment result on the display unit 14 (step S8), and terminates the process. FIG. 7 is a schematic diagram showing an example of a judgment result display screen. In this example, the judgment result display screen displays, for example, a title string "AI Judgment Result" at the top, and below the title string, the AI ​​judgment results "Dental Clinic: 0.2" and "Regional Base Hospital: 0.8" are displayed. In this embodiment, the learning model of the AI ​​judgment server device 4 is configured to output an inference result regarding whether the tooth extraction procedure should be performed at a dental clinic or a regional base hospital as a numerical value such as a recommendation level (certainty, likelihood). The AI ​​judgment server device 4 transmits these numerical values ​​as the judgment result of the learning model, and the smartphone 1 that receives them displays these numerical values ​​as the judgment result. In this example, the recommendation level for performing the tooth extraction at a dental clinic is 0.2, and the recommendation level for performing the tooth extraction at a regional base hospital is 0.8, so the AI ​​recommends performing the tooth extraction at a regional base hospital. The smartphone 1 may indicate the recommendation level in stages, such as a five-point scale, instead of a numerical value.

[0045] Furthermore, on the judgment result display screen of this example, a bar indicating the difficulty of performing tooth extraction treatment and a rectangular area showing a sentence explaining the reason for the judgment are displayed side by side below the character string of the judgment result. The difficulty bar has a double arrow pointing up and down, with the upper end indicating a higher difficulty and the lower end indicating a lower difficulty (easier), and the difficulty level is indicated by the position of a black circle displayed over the arrow. The display processing unit 11f determines the position of the black circle on the difficulty bar based on the judgment result of the learning model, for example, assuming that the higher the recommendation level from the regional base hospital, the higher the difficulty of tooth extraction treatment. In this example, the display processing unit 11f displays black circles at the positions of the arrows on the difficulty bar at a ratio of 2:8 based on the judgment result of the learning model.

[0046] In addition, in the rectangular area to the left of the difficulty bar, for example, " reason 1. Ensuring patient safety 2. Requires advanced equipment and technology 3. Response to systemic diseases 4. Reoperation / specialized treatment required " is displayed. The smartphone 1 stores, for example, explanatory sentences corresponding to the judgment results of the learning model in the storage unit 12 in advance, and the display processing unit 11f reads out the explanatory sentences corresponding to the obtained judgment results and displays them on the judgment result display screen.

[0047] Furthermore, on the judgment result display screen of this example, the character string "Tooth Extraction Selection" is displayed below the rectangular area of ​​the difficulty level bar and the explanatory text, and further below that, a button labeled "Dental Clinic" and a button labeled "Regional Base Hospital" are displayed. These two buttons are used by the user who has viewed the AI ​​judgment result to select whether the patient's tooth extraction procedure should be performed at their own dental clinic or at a regional base hospital. When the "Dental Clinic" button is operated, the smartphone 1 can proceed with the process to, for example, make an appointment for tooth extraction at a dental clinic. When the "Regional Base Hospital" button is operated, the smartphone 1 can proceed with the process to, for example, make an appointment for tooth extraction at a regional base hospital.

[0048] If AI determination is not selected in step S3 (S3: NO), the processing unit 11 determines whether an initial consultation appointment is selected on the top screen (step S9). If an initial consultation appointment is not selected (S9: NO), the processing unit 11 waits until either AI determination or an initial consultation appointment is selected on the top screen. If an initial consultation appointment is selected (S9: YES), the display processing unit 11e displays an appointment screen (not shown) on the display unit 14 for accepting input of patient information for booking a tooth extraction procedure (step S10). On this appointment screen, the smartphone 1 accepts input of patient information such as name, telephone number, or email address. The appointment processing unit 11d of the processing unit 11 introduces the patient by transmitting the patient information entered on the appointment screen to the appointment server device 5 (step S11), and the process ends.

[0049] 8 is a flowchart showing an example of the processing procedure performed by the AI ​​determination server device 4 according to this embodiment. The processing unit 41 of the AI ​​determination server device 4 according to this embodiment determines whether or not an X-ray image has been received from PC2 via the communication unit 43 (step S31). If an X-ray image has been received (S31: YES), the medical image management unit 41a of the processing unit 41 stores the X-ray image received from PC2 in step S31 in the medical image storage unit 42c (step S32). The medical image management unit 41a encodes information indicating the storage location of the X-ray image stored in step S32 to generate a two-dimensional code (step S33). The medical image management unit 41a transmits the two-dimensional code generated in step S33 to PC2 (step S34), and the processing ends.

[0050] If the X-ray image has not been received from the PC 2 (S31: NO), the processing unit 41 determines whether or not an AI judgment request from the smartphone 1 has been received via the communication unit 43 (step S35). If the AI ​​judgment request has not been received (S35: NO), the processing unit 41 returns to step S31 and waits until the X-ray image is received from the PC 2 or the AI ​​judgment request is received from the smartphone 1. If the AI ​​judgment request has been received from the PC 2 (S35: YES), the judgment processing unit 41b of the processing unit 41 reads the X-ray image from the medical image storage unit 42c based on the information indicating the storage location included in the AI ​​judgment request received in step S35 (step S36). The judgment processing unit 41b inputs the X-ray image read in step S36 into the learning model stored in the model information storage unit 42b (step S37). The judgment processing unit 41b acquires the inference result, output by the learning model to which the X-ray image has been input in step S37, indicating whether or not the patient's tooth extraction procedure can be performed at the dental clinic (step S38). The determination processing unit 41b transmits the inference result acquired in step S38 to the smartphone 1 as the determination result via the communication unit 43 (step S39), and ends the process.

[0051] <Modification> In the information processing system according to the above-described embodiment, the degree of recommendation for performing tooth extraction at a dental clinic and the degree of recommendation for performing tooth extraction at a regional base hospital are presented to the user as the judgment result of the learning model. However, this is not limited to this. For example, the smartphone 1 may present the user with a binary judgment result of whether or not to perform the patient's tooth extraction at a dental clinic. FIG. 9 is a schematic diagram showing another example of a judgment result display screen. The judgment result display screen according to the modified example shown in FIG. 9 displays, for example, a title string "AI Judgment Result" at the top, and below the title string, a rectangular area with the string "Tooth extraction at a regional base hospital recommended" and a rectangular area with the string "Tooth extraction at a dental clinic recommended" are arranged vertically. Based on the judgment result obtained from the AI ​​judgment server device 4, the smartphone 1 according to the modified example presents the judgment result to the user by highlighting either the rectangular area "Tooth extraction at a regional base hospital recommended" or the rectangular area "Tooth extraction at a dental clinic recommended." In the illustrated example, the rectangular area "Tooth extraction at a regional base hospital recommended" is highlighted, indicating that the determination result is that it is recommended that the patient's tooth extraction be performed at a regional base hospital. In this embodiment, the AI ​​determination server device 4 determines whether tooth extraction can be performed at a dental clinic (whether tooth extraction should be performed at a dental clinic or a regional base hospital) based on an X-ray image. The display processing unit 11e highlights the rectangular area "Tooth extraction at a dental clinic recommended" when the AI ​​determination server device 4 determines that tooth extraction at a dental clinic is possible, and highlights the rectangular area "Tooth extraction at a regional base hospital recommended" when the AI ​​determination server device 4 determines that tooth extraction at a dental clinic is not possible.

[0052] In addition, the information processing system may not only present the judgment results to the user, but may also search for past X-ray images stored in the medical image storage unit 42c that are similar to the X-ray image currently provided by the user as the judgment target, and present the judgment results and similar cases to the user. In this case, the AI ​​judgment server device 4 may store past judgment results for these X-ray images, as well as information such as the patient's subsequent history, in the medical image storage unit 42c, for example, in association with the past X-ray images, and present the past judgment results and subsequent history of similar cases to the user.

[0053] Although the present embodiment has been described using dentistry as an example of medical care, the application of the information processing system according to the present embodiment is not limited to dentistry and can be applied to various fields, such as internal medicine, surgery, ophthalmology, otolaryngology, nursing care, and rehabilitation. Although the present embodiment has been described using dental clinics and regional base hospitals as examples of medical institutions, medical institutions are not limited to these. The information processing system according to the present embodiment is configured to transmit patient X-ray images from PC 2 to the AI ​​determination server device 4. However, the transmitted images are not limited to X-ray images. Various medical images, such as ordinary photographs of the user's affected area or images taken with an endoscope, may also be used. The learning model of the AI ​​determination server device 4 according to the present embodiment infers whether or not a tooth can be extracted at a dental clinic based on X-ray images of the patient's teeth. However, the inferences made by the learning model are not limited to whether or not a tooth can be extracted, and the learning model may perform a wide variety of inferences related to patient judgment. Furthermore, in the information processing system according to this embodiment, information (related information) indicating the storage location of the X-ray image is transmitted from the AI ​​judgment server device 4 to the PC 2 as a two-dimensional code, but this is not limited to this, and for example, a one-dimensional code may be used, or information in the form of a string such as a URL indicating the storage location may be used, and various other forms of related information may be adopted.

[0054] <Summary> In the information processing system according to the present embodiment configured as described above, the smartphone 1 acquires, from the PC 2, information (related information) relating to the storage location of a patient's X-ray images (medical images) from a doctor (staff member) at a dental clinic (medical institution) as a two-dimensional code. The smartphone 1 transmits the acquired related information to the AI ​​determination server device 4, which includes a learning model that performs inference based on the X-ray images. The AI ​​determination server device 4 reads the patient's X-ray images (medical images) from the medical image storage unit 42c based on the information received from the smartphone 1, and transmits the results of inference performed using the learning model based on the read X-ray images to the smartphone 1. The smartphone 1 acquires the inference results based on the learning model from the AI ​​determination server device 4 and displays (outputs) the acquired inference results. As a result, the information processing system according to the present embodiment is expected to facilitate the use by dental clinics of learning models that perform judgments based on X-ray images.

[0055] In the information processing system according to this embodiment, the learning model of the AI ​​determination server device 4 receives an X-ray image of a patient's teeth as an input and outputs the inference result of whether or not tooth extraction should be performed at a medical clinic. As a result, the information processing system according to this embodiment is expected to enable users such as doctors at dental clinics to easily determine whether a patient's tooth extraction should be performed at their own dental clinic or at a regional base hospital.

[0056] Furthermore, in the information processing system according to this embodiment, a PC (second computer) 2, which is different from the smartphone (first computer) 1, transmits an X-ray image to the AI ​​determination server device 4, receives a two-dimensional code associated with the storage location of the X-ray image from the AI ​​determination server device 4, and displays (outputs) it. The smartphone 1 acquires the two-dimensional code by photographing the two-dimensional code displayed by the PC 2 with the camera 16. As a result, the information processing system according to this embodiment is expected to enable X-ray images of a patient's teeth taken at a dental clinic to be transmitted directly to the AI ​​determination server device 4 from the PC 2, such as a PC connected to a device that takes X-ray images or a PC that manages electronic medical records at the dental clinic, without the smartphone 1 having to import the images.

[0057] 6, the smartphone 1 displays a message requesting the PC 2 to transmit the X-ray image to the AI ​​determination server device 4, accepts an operation to photograph the two-dimensional code displayed by the PC 2 using the camera 16, and transmits information about the storage location obtained by photographing the two-dimensional code to the AI ​​determination server device 4. As a result, the information processing system according to the present embodiment is expected to enable the smartphone 1 to easily obtain information about the storage location of the X-ray image, facilitating the use of AI determination using the smartphone 1.

[0058] Furthermore, in the information processing system according to this embodiment, the information sent by PC2 to the AI ​​determination server device 4 does not include identification information such as the name, address, or telephone number that could identify the patient. Furthermore, the two-dimensional code sent from the AI ​​determination server device 4 to PC2 does not include patient identification information. As a result, the information processing system according to this embodiment is expected to prevent personal information that could identify the patient from leaking from the dental clinic to the outside.

[0059] Furthermore, the information processing system according to this embodiment employs a dental clinic as an example of a medical institution, an X-ray image of a patient's teeth as an example of a medical image, and an example of a learning model employs one that has undergone machine learning in advance to accept the X-ray image of the patient's teeth as an input and output whether the tooth extraction procedure should be performed at the dental clinic or at a medical institution other than the dental clinic. As a result, the information processing system according to this embodiment is expected to assist staff members such as doctors at dental clinics in determining whether a patient's tooth extraction procedure should be performed at their own dental clinic or at another medical institution.

[0060] Furthermore, the information processing system according to this embodiment employs a regional base hospital as a medical institution different from a dental clinic. The smartphone 1 receives from the user an input of an ID (identification information) assigned to a person associated with the regional base hospital, performs authentication processing based on the received ID with the authentication server device 3, and acquires a two-dimensional code after the authentication processing is successful. As a result, the information processing system according to this embodiment is expected to manage users who use AI judgments, for example, by using an ID for using a service provided to a person associated with the regional base hospital.

[0061] The embodiments disclosed herein are to be considered in all respects as illustrative and not restrictive. The scope of the present disclosure is defined by the claims, not by the above meaning, and is intended to include all modifications within the meaning and scope of the claims.

[0062] The matters described in each embodiment can be combined with each other. In addition, the independent claims and dependent claims described in the claims can be combined with each other in any combination, regardless of the reference format. Furthermore, although the claims use a format in which a claim references two or more other claims (multiple claim format), this is not limited to this format. A multiple claim (multi-multi claim) that references at least one other multiple claim may also be used. [Explanation of symbols]

[0063] 1. Smartphone (information processing device, computer) 2 PC (second computer) 3. Authentication server device 4. AI Judgment Server Device (Server Device) 5. Reservation server device 6. Smartphones 11 Processing section 11a Authentication processing section 11b Code acquisition section 11c Judgment processing unit 11d Reservation Processing Unit 11e Display processing section 12 Storage section 12a Program (computer program) 13 Communications Department 14 Display section 15 Control section 16 Camera 41 Processing section 41a Medical Image Management Department 41b Judgment processing unit 42 Storage section 42a Program 42b Model information storage section 42c Medical Image Storage Unit 43 Communications Department 98,99 Recording media N Network

Claims

1. A computer, a second computer different from the first computer transmits the patient's medical images to a server device having a learning model that performs inference based on the medical images, receives related information associated with the storage location of the medical images from the server device, and acquires the related information output by the second computer from a medical institution worker by photographing the related information with a camera of the second computer; transmitting the acquired related information to the server device; obtaining from the server device a result of inference using the learning model based on the medical image obtained from a storage location based on the related information; Output the obtained inference results A computer program that executes a process.

2. The learning model receives a medical image as an input and outputs an inference result indicating whether or not treatment at the medical institution is possible.

2. The computer program of claim 1.

3. outputting a message requesting the second computer to transmit the medical image to the server device; Accepting an operation to photograph the related information by the camera; transmitting the related information obtained by photographing with the camera to the server device; 2. The computer program of claim 1.

4. the information transmitted by the second computer to the server device does not include identification information of the patient; The relevant information does not include the patient's identification information.

2. The computer program of claim 1.

5. the medical institution is a dental clinic, the medical image is an x-ray image of the patient's teeth; The learning model is machine-learned in advance to receive an X-ray image of the patient's teeth as an input and output whether a predetermined treatment should be performed at the dental clinic or at a medical institution other than the dental clinic.

2. The computer program of claim 1.

6. The medical institution other than the dental clinic is a regional base hospital, Accepting input of identification information assigned to a person related to the regional base hospital; After the authentication process based on the received identification information is successful, the related information is acquired.

6. A computer program according to claim 5.

7. The information processing device a second information processing device different from the information processing device transmits a medical image of a patient to a server device having a learning model that performs inference based on the medical image, receives related information associated with a storage location of the medical image from the server device, and acquires the related information output by the second information processing device from a medical institution worker by photographing the related information with a camera of the information processing device; transmitting the acquired related information to the server device; obtaining from the server device a result of inference using the learning model based on the medical image obtained from a storage location based on the related information; Output the obtained inference results Information processing methods.

8. a processing unit and a camera, The processing unit Another information processing device transmits a medical image of a patient to a server device having a learning model that performs inference based on the medical image, receives related information associated with a storage location of the medical image from the server device, and acquires the related information output by the other information processing device from a medical institution worker by photographing it with the camera; transmitting the acquired related information to the server device; obtaining from the server device a result of inference using the learning model based on the medical image obtained from a storage location based on the related information; Output the obtained inference results Information processing device.

Images