Information processing device, information processing system, computer program, and information processing method

Abstract

This study aims to clarify an information processing device, information processing system, computer program, and information processing method that can suppress oversights during image interpretation while ensuring independence from CAD. [Solution] The information processing device comprises an acquisition unit that acquires a medical image to be read, a first determination unit that determines whether or not there are findings based on the reading of the acquired medical image, a second determination unit that determines whether or not there are findings based on the image analysis processing of the acquired medical image, and a third determination unit that determines whether or not a final reading of the acquired medical image is necessary based on the determination results of the first and second determination units, respectively.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an information processing system, a computer program, and an information processing method.

Background Art

[0002] In the medical field in recent years, with the progress of radiation diagnostic equipment, the amount of image diagnostic information has increased dramatically, and the number of examinations has also increased. On the other hand, the current situation is that the number of specialists who perform radiation diagnosis professionally is small. Therefore, medical images taken at medical institutions such as clinics or health examination institutions are not only read by specialists at the medical institutions or health examination institutions, but also transmitted to another facility where there is a specialist using a communication network, and remote reading may be performed by the specialist at the facility.

[0003] In Patent Document 1, a medical image is transmitted from a requesting facility to a reading center, and at the reading center, primary reading and secondary reading are performed by two reading doctors. If there are differences in the reading results of both, a third reading is performed by another reading doctor, and a remote reading system is disclosed.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, if the reading doctor is tired or needs to read a large amount in a short time, there is a risk that the reading ability will decline, and there is also a risk that the reading ability will change depending on the physical condition of the reading doctor at that time. Therefore, even if primary reading and secondary reading are performed by two reading doctors, there is a possibility of overlooking. Also, in order to suppress overlooking, CAD (Computer While it is possible to implement Aided Detection (CAD), there is a risk that radiologists may be influenced by the CAD results and make incorrect judgments.

[0006] This disclosure is made in view of the above circumstances and reveals an information processing device, information processing system, computer program, and information processing method that can suppress oversights during image interpretation while ensuring independence from CAD. [Means for solving the problem]

[0007] The present invention includes multiple means for solving the above-mentioned problems, but to give one example, the information processing device comprises: an acquisition unit for acquiring a medical image to be read; a first determination unit for determining whether or not there are findings based on the reading of the medical image acquired by the acquisition unit; a second determination unit for determining whether or not there are findings based on image analysis processing of the medical image acquired by the acquisition unit; and a third determination unit for determining whether or not a final reading of the medical image acquired by the acquisition unit is necessary based on the determination results of the first determination unit and the second determination unit, respectively. [Effects of the Invention]

[0008] According to this disclosure, the radiologist's results can be made independent of CAD while reducing the likelihood of overlooking something during image interpretation. [Brief explanation of the drawing]

[0009] [Figure 1] This figure shows an example of the configuration of the information processing system of this embodiment. [Figure 2] This figure shows an example of a server configuration. [Figure 3] This figure shows an example of remote image interpretation processing performed by a server. [Figure 4] This figure shows the first example of how to determine whether a final image interpretation is necessary. [Figure 5] This figure shows the second example of determining whether a final image interpretation is necessary. [Figure 6] This figure shows the third example of determining whether a final image interpretation is necessary. [Figure 7] This figure shows the fourth example of determining whether a final image interpretation is necessary. [Figure 8] This figure shows the fifth example of determining whether a final image interpretation is necessary. [Figure 9] This figure shows the sixth example of determining whether a final image interpretation is necessary. [Modes for carrying out the invention]

[0010] The embodiments of this disclosure will be described below with reference to the drawings. Figure 1 is a diagram showing an example of the configuration of the information processing system of this embodiment. The remote image interpretation system will be described below as an example of an information processing system. The information processing system includes a server 50 as an information processing device. A first image interpretation terminal 10, a second image interpretation terminal 20, a final image interpretation terminal 30, and a remote image interpretation DB 40 are connected to the server 50. The first image interpretation terminal 10, the second image interpretation terminal 20, and the final image interpretation terminal 30 can be configured as, for example, personal computers. The server 50, the first image interpretation terminal 10, the second image interpretation terminal 20, the final image interpretation terminal 30, and the remote image interpretation DB 40 are installed, for example, within the facilities of a remote image interpretation service company. The first image interpretation terminal 10, the second image interpretation terminal 20, and the final image interpretation terminal 30 are terminals used by the first radiologist, the second radiologist, and the final radiologist, respectively, when interpreting images. The first radiologist, the second radiologist, and the final radiologist are all different radiologists.

[0011] Server 50 is connected to communication network 1. Terminal devices 101, 201, and 301 of the health checkup facilities 100, 200, and 300 are connected to communication network 1. These terminal devices 101, 201, and 301 can be composed of, for example, personal computers.

[0012] The terminal device 101 of the health checkup facility 100 can send and receive information with the terminal device 150 of the person being checked, for example, via email. Although the terminal device 150 of the person being checked is only illustrated for the health checkup facility 100 for convenience, the terminal devices 201 and 301 of the other health checkup facilities 200 and 300 can similarly send and receive information with the terminal devices of the person being checked, via email, etc. The terminal device 150 can consist of a smartphone, tablet, personal computer, etc.

[0013] The health checkup institutions 100, 200, and 300 are, for example, institutions where members of a health insurance association receive health checkups. They transmit medical images (examination images) taken with X-ray equipment, etc., from a large number of people undergoing health checkups to the server 50 via terminal devices 101, 201, and 301. Although not shown in the diagram, medical institutions such as hospitals and clinics without radiologists can also similarly transmit medical images taken with X-ray equipment, etc., from patients to the server 50 via terminal devices.

[0014] Remote image interpretation service companies have specialist radiologists interpret medical images requested by health checkup institutions (100, 200, 300) and medical institutions, and report the final results as a remote image interpretation service company to the health checkup institutions (100, 200, 300) and medical institutions. The final results include findings regarding the interpreted medical images.

[0015] In this specification, medical images are obtained by imaging using X-ray machines, ultrasound machines, CT (Computed Tomography) machines, MRI (Magnetic Resonance Imaging) machines, etc. It includes images. Radiography (also referred to as the radiography act) includes a professional radiologist looking at medical images to judge the medical images and create a report on the presence or absence of findings and the content of the findings. Findings are the results of radiography, the results of judging that there are abnormal parts such as nodules in the medical images to be radiographed, and also include opinions on the results. Note that findings include not only the results input by the radiologist but also the results based on image analysis processing by computers such as CAD (Computer Aided Detection: image processing software). The medical images may be stored in DICOM (Digital Imaging and Communications in Medicine) format data. DICOM data includes image information and tag information such as patient name and imaging site. Findings may be written as tag information in the DICOM data in which the medical images are stored, or may be stored as separate data from the DICOM data including the medical images. For example, findings by a radiologist may include information such as the presence or absence of findings, content, name, etc., and may be stored as plain text or encoded report data. Findings based on image analysis processing may be stored as DICOM-SR data encoding the presence or absence of findings, content, name, etc., or as DICOM-SC data imaged like a heat map.

[0016] FIG. 2 is a diagram showing an example of the configuration of the server 50. The server 50 includes a control unit 51 that controls the entire server 50, a communication unit 52, an interface unit 53, a recording medium reading unit 54, a memory 55, an image processing unit 56, and a storage unit 57.

[0017] The control unit 51 includes a CPU (Central Processing Unit), an MPU (Micro-Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-purpose computing on It is configured by incorporating all or part of graphics processing units), TPU (Tensor Processing Unit), etc. in required numbers. The control unit 51 has functions as an acquisition unit, a first determination unit, a second determination unit, and a third determination unit.

[0018] The memory 55 is composed of a semiconductor memory such as SRAM (Static Random Access Memory), DRAM (Dynamic Random Access Memory), flash memory, etc.

[0019] The communication unit 52 includes, for example, a communication module and has a communication function with the terminal devices 101, 201, 301 via the communication network 1. The communication unit 52 receives the medical images to be read and the request for reading from the terminal devices 101, 201, 301 through the communication network 1. The communication unit 52 transmits the final result regarding the medical images to be read to the terminal devices 101, 201, 301 through the communication network 1.

[0020] The interface unit 53 provides an interface function between the first reading terminal 10, the second reading terminal 20, the final reading terminal 30, and the remote reading DB 40. The server 50 can transmit and receive information to and from the first reading terminal 10, the second reading terminal 20, and the final reading terminal 30 through the interface unit 53. The server 50 can access the remote reading DB 40 through the interface unit 53.

[0021] The recording medium reading unit 54 can be configured by, for example, an optical disk drive, and can read a computer program (program product) recorded on a recording medium 541 (for example, an optically readable disk storage medium such as a CD-ROM) by the recording medium reading unit 54 and store it in the storage unit 57. The computer program 58 is deployed in the memory 55 and executed by the control unit 51. Note that the computer program 58 may be downloaded from an external device via the communication unit 52 and stored in the storage unit 57.

[0022] The storage unit 57 can be configured, for example, as a hard disk or semiconductor memory, and can store the required information. The storage unit 57 can store a computer program 58.

[0023] The image processing unit 56 can be composed of a CPU, MPU, GPU, GPGPU, TPU, DSP (Digital Signal Processors), or FPGA (Field-Programmable Gate Arrays), etc. The image processing unit 56 performs image analysis processing on the medical image to be interpreted and outputs the presence or absence of findings and the content of those findings, similar to those interpreted by a radiologist. The image processing unit 56 may be one or more image processing modules, or it may be a learning model generated by machine learning. By using a learning model generated by machine learning, it is possible to create unified criteria for judging findings for each specific radiology institution, radiology organization, or industry by training it with examples of findings agreed upon or defined by a representative within that organization.

[0024] A learning model comprises an input layer, an intermediate layer, and an output layer, and can be constructed, for example, as a Convolutional Neural Network (CNN). The intermediate layer comprises multiple convolutional layers, multiple pooling layers, and a fully connected layer. When a medical image is input, the learning model can output the presence or absence of findings and the content of those findings. The findings can be pre-encoded. For example, if there are 10 names for findings, the output layer can have 10 output nodes, and each output node can classify the findings.

[0025] The remote image interpretation database 40 stores the medical images to be interpreted, interpretation results based on the interpreting physician (presence or absence of findings, content of findings), results based on image analysis processing (presence or absence of findings, content of findings), determination of whether final interpretation is necessary, interpretation results based on final interpretation, and final results as a remote image interpretation service company.

[0026] Next, the processing procedure of server 50 will be described. The processing of server 50 can be implemented by computer program 58.

[0027] Figure 3 shows an example of remote image interpretation processing by server 50. For convenience, only terminal device 101 of health checkup institution 100 is shown below. The same applies to other health checkup institutions 200, 300 and medical institutions. Server 50 receives the medical images to be interpreted and the interpretation request from terminal device 101 (S1). The medical images to be interpreted can be received in batches, for example, in lot units. One lot may contain, for example, several tens to several hundred medical images.

[0028] Server 50 temporarily stores the received medical image to be read in the remote image reading DB 40 (S2), performs image analysis processing on the medical image using the image processing unit 56, and saves the image analysis results to the remote image reading DB 40 (S3). The image analysis results include the presence or absence of findings in the medical image and the content of those findings.

[0029] Server 50 transmits the medical image to be read to the first reading terminal 10 (S4). At the first reading terminal 10, the radiologist (first radiologist) performs the initial reading (first interpretation) (S5). Server 50 receives the initial reading result from the first reading terminal 10 (S6) and saves the received initial reading result to the remote reading DB 40 (S7). The initial reading result includes whether or not the radiologist made any findings regarding the medical image and the content of those findings.

[0030] In the case of double image interpretation, the server 50 performs the following processing: The server 50 transmits the medical image to be interpreted to the second interpretation terminal 20 (S8). The second interpretation terminal 20 performs a second interpretation (secondary interpretation) by the radiologist (second radiologist) (S9). The server 50 receives the second interpretation result from the second interpretation terminal 20 (S10) and saves the received second interpretation result to the remote interpretation DB 40 (S11). The second interpretation result includes whether or not the radiologist made any findings regarding the medical image and the content of those findings. In the case of single image interpretation, the processing described in steps S8 to S11 above is not performed.

[0031] Server 50 determines whether a final image interpretation is necessary (S12). Details of the determination of whether a final image interpretation is necessary will be described later. If it is determined that a final image interpretation is necessary, the following processing is performed. Specifically, Server 50 transmits the medical image to be interpreted, along with the associated first and second interpretation results, image analysis processing results, and information on the necessity determination result to the final image interpretation terminal 30 (S13). At the final image interpretation terminal 30, the radiologist (the final radiologist) performs the final image interpretation (S14). Server 50 receives the final image interpretation result from the final image interpretation terminal 30 (S15) and saves the received final image interpretation result to the remote image interpretation DB 40. The final image interpretation result includes whether or not there are findings on the medical image by the radiologist and the content of those findings. If it is determined that a final image interpretation is not necessary, the processing in steps S13 to S15 described above is not performed.

[0032] Server 50 generates the final result for the medical image to be interpreted (S16), sends the generated final result to terminal device 101 (S17), and terminates processing.

[0033] As described above, the server 50 acquires the medical image to be read via the communication unit 52, determines whether there are any findings based on the interpretation of the acquired medical image, determines whether there are any findings based on the image analysis processing of the acquired medical image, and determines whether a final interpretation of the acquired medical image is necessary based on the results of each determination.

[0034] This means that not only the radiologist's interpretation but also the presence or absence of findings from image analysis processing (including estimation by a learning model) is considered, thus complementing the radiologist's interpretation and reducing the likelihood of overlooking findings during image interpretation.

[0035] Server 50 can generate (obtain) a final result indicating the presence or absence of findings based on the interpretation of the medical image being interpreted, according to the final interpretation result. The final result includes the presence or absence of findings and the content of the findings (e.g., size and location of nodules). If a final interpretation is not required, the final result is generated based on both the first and second interpretation results (both of which show the presence or absence of findings) in the case of double interpretation, and based on the first interpretation result in the case of single interpretation.

[0036] When terminal device 101 receives the final results from server 50, the person in charge at the health checkup implementing institution 100 may create a health checkup result based on the final results and send (provide) the created health checkup result to terminal device 150 of the person being checked. Alternatively, the health checkup result may be mailed to the person being checked at home or at work.

[0037] Next, we will explain how to determine whether a final image interpretation is necessary.

[0038] Figure 4 shows the first example of determining whether a final interpretation is necessary. In the case of double interpretation, Figure 4 shows eight cases depending on the presence or absence of findings, indicating whether a final interpretation is necessary and providing examples of how to request a final interpretation. In Case 1, the first interpretation result is no findings, the second interpretation result is no findings, and the image analysis processing result shows findings, so it is determined that a final interpretation is necessary. In Case 1, the information "findings found only in image analysis processing" is presented to the final radiologist.

[0039] In Case 2, the first reading result is no findings, the second reading result is findings, and the image analysis processing result is also findings, and it is determined that a final reading is necessary. In Case 2, the final radiologist is presented with the information that "the image analysis processing shows findings, but the radiologist's findings differ."

[0040] In Case 3, the first image interpretation result shows findings, the second image interpretation result shows no findings, and the image analysis processing result shows findings, so it is determined that a final interpretation is necessary. In Case 3, the final radiologist is presented with the information that "the image analysis processing shows findings, but the radiologist's findings differ."

[0041] In Case 4, the first reading shows findings, the second reading shows no findings, and the image analysis processing results also show no findings, and it is determined that a final reading is necessary. In Case 4, the final radiologist is presented with the information that "the radiologist found findings, but the image analysis processing showed no findings."

[0042] In Case 5, the first reading result is no findings, the second reading result is findings, and the image analysis processing result is also no findings, and it is determined that a final reading is necessary. In Case 5, the final reading physician is presented with the information that "the radiologist found findings, but the image analysis processing found no findings."

[0043] Cases 6 through 8 are all determined to be unnecessary for final interpretation. Case 6 is when the first interpretation result is no findings, the second interpretation result is no findings, and the image analysis processing result is no findings. Case 7 is when the first interpretation result is findings, the second interpretation result is findings, and the image analysis processing result is no findings. Case 8 is when the first interpretation result is findings, the second interpretation result is findings, and the image analysis processing result is findings.

[0044] As in Case 1, the control unit 51 may determine that a final image interpretation is necessary if it determines there are no findings based on the image interpretation process, but also determines there are findings based on the image analysis process. This allows the radiologist to interpret the image without referring to the presence or absence of findings based on the image analysis process. As a result, the radiologist's interpretation results are independent of the results of the image analysis process, and the presence or absence of findings from the image analysis process is also taken into consideration. This complements the radiologist's interpretation results and helps to reduce oversights during image interpretation. Consequently, an image interpretation service with reduced oversights can be operated.

[0045] As in Case 2 or Case 3, the control unit 51 may determine that a final image interpretation is necessary if the presence or absence of findings based on the first and second image interpretations differ, and if there are findings based on the image analysis processing. This ensures that the radiologist's interpretation results are independent of the results of the image analysis processing, and also takes into account the presence or absence of findings from the image analysis processing, thereby complementing the radiologist's interpretation results and reducing the likelihood of oversights during image interpretation.

[0046] As in Case 4 or Case 5, the control unit 51 may determine that a final image interpretation is necessary if the presence or absence of findings based on the first and second image interpretations differ, and there are no findings based on the image analysis processing. This ensures independence from the results of the image analysis processing, and also takes into account the presence or absence of findings from the image analysis processing, thereby complementing the radiologist's interpretation results and reducing oversights during image interpretation.

[0047] As in Case 6 or Case 8, the control unit 51 may determine that a final image interpretation is unnecessary if the findings from the first image interpretation, the second image interpretation, and the image analysis processing are consistent. Also, as in Case 7, the control unit 51 may determine that a final image interpretation is unnecessary if the findings from the first and second image interpretations are consistent, but there are no findings from the image analysis processing.

[0048] Figure 5 shows a second example of how to determine whether a final interpretation is necessary. In the case of single interpretation, Figure 5 shows four cases depending on whether or not there are findings, indicating whether a final interpretation is necessary and examples of how to present the request for a final interpretation. In Case 1, the initial interpretation result is no findings, but the image analysis processing result shows findings, and it is determined that a final interpretation is necessary. In Case 1, the information "Findings found only in image analysis processing" is presented to the final radiologist.

[0049] In Case 2, the initial reading result shows findings, and the image analysis processing result also shows findings, so it is determined that a final reading is unnecessary. In Case 4, the initial reading result shows no findings, and the image analysis processing result also shows no findings, so it is determined that a final reading is unnecessary. In Case 3, the initial reading result shows findings, and the image analysis processing result also shows no findings, so it is determined that a final reading is unnecessary.

[0050] As in Case 1, the control unit 51 may determine that a final image interpretation is necessary if there are no findings based on the first image interpretation but there are findings based on the image analysis processing. This ensures that the radiologist's interpretation results are independent of the image analysis processing results, and also takes into account the presence or absence of findings from the image analysis processing. This complements the radiologist's interpretation results and helps to reduce oversights during image interpretation.

[0051] As in Case 2 or Case 4, the control unit 51 may determine that a final image interpretation is unnecessary if the findings from the first image interpretation and the image analysis process are consistent. Also, as in Case 3, the control unit 51 may determine that a final image interpretation is unnecessary if there are findings from the first image interpretation but no findings from the image analysis process.

[0052] Figure 6 shows a third example of determining whether a final interpretation is necessary. In the case of double interpretation, Figure 6 shows five different cases depending on the name of the finding, indicating whether a final interpretation is necessary and providing examples of how to request a final interpretation. In Figure 6, for convenience, different name of the finding is represented by codes A to C. By assigning a different code to each different name of the finding, the difference in the name of the finding can be identified by the difference in the code. In Case 1, the first interpretation result is name of finding A, the second interpretation result is name of finding B, and the image analysis processing result is name of finding C, and it is determined that a final interpretation is necessary. In Case 1, the information that "the name of the finding from the radiologist and the image analysis processing are all different" is presented to the final radiologist.

[0053] In Case 2, the first reading result is finding name A, the second reading result is finding name A, and the image analysis processing result is finding name B, and it is determined that a final reading is necessary. In Case 2, the final reading physician is presented with the information that "the finding name differs between the radiologist and the image analysis processing."

[0054] In Case 3, the first reading result is finding name A, the second reading result is finding name B, and the image analysis processing result is finding name A, so a final reading is deemed necessary. In Case 4, the first reading result is finding name B, the second reading result is finding name A, and the image analysis processing result is finding name A, so a final reading is deemed necessary. In Case 5, the first reading result, the second reading result, and the image analysis processing result are all the same (finding name A), so a final reading is not necessary.

[0055] As in Case 1 or Case 2, the control unit 51 identifies the name of the finding based on the image interpretation and the name of the finding based on the image analysis process. The control unit 51 may determine that a final image interpretation is necessary if the name of the finding based on the image interpretation differs from the name of the finding based on the image analysis process. Case 1 is when the names of the findings based on the first image interpretation, the second image interpretation, and the image analysis process are all different. Case 2 is when the names of the findings based on the first and second image interpretations match, but the names of the findings based on the image analysis process differ. Cases 3 and 4 are when the names of the findings based on the image interpretation (the name of the finding based on either the first or second image interpretation) do not match the names of the findings based on the image analysis process. This ensures that the radiologist's interpretation results are independent of the image analysis results, and the image analysis results are also taken into consideration, thus complementing the radiologist's interpretation results and reducing the likelihood of oversights during image interpretation.

[0056] Figure 7 shows the fourth example of determining whether a final interpretation is necessary. In the case of double interpretation, Figure 7 shows five different cases depending on the identified area, indicating whether a final interpretation is necessary and providing examples of how to request a final interpretation. In Figure 7, for convenience, different identified areas are represented by codes R1 to R3. By dividing a medical image into multiple sub-regions and assigning codes to each sub-region, the differences in codes can be used to identify the differences in identified areas.

[0057] In Case 1, the first reading result indicates site R1, the second reading result indicates site R2, and the image analysis processing result indicates site R3, and it is determined that a final reading is necessary. In Case 1, the final radiologist is presented with the information that "the sites pointed out by the radiologist and the image analysis processing are all different."

[0058] In Case 2, the first reading result indicates site R1, the second reading result indicates site R1, and the image analysis processing result indicates site R2, and it is determined that a final reading is necessary. In Case 2, the final radiologist is presented with the information that "the site identified by the radiologist and the image analysis processing differ."

[0059] In Case 3, the first reading result is for area R1, the second reading result is for area R2, and the image analysis processing result is for area R1, so a final reading is deemed necessary. In Case 4, the first reading result is for area R2, the second reading result is for area R1, and the image analysis processing result is for area R1, so a final reading is deemed necessary. In Case 5, the first reading result, the second reading result, and the image analysis processing result are all the same (area R1), so a final reading is not necessary.

[0060] As in Case 1 or Case 2, the control unit 51 determines the area related to the findings based on the image interpretation and determines the area related to the findings based on the image analysis process. The control unit 51 may determine that a final image interpretation is necessary if the area based on the image interpretation differs from the area based on the image analysis process. Case 1 is when the areas based on the first image interpretation, the second image interpretation, and the image analysis process are all different. Case 2 is when the areas based on the first and second image interpretations match, but the areas based on the image analysis process differ. Cases 3 and 4 are when the area based on the image interpretation (the area based on either the first or second image interpretation) does not match the area based on the image analysis process. As a result, the radiologist's interpretation results are made independent of the image analysis results, and the areas from the image analysis process are also taken into consideration, thus complementing the radiologist's interpretation results and reducing oversights during image interpretation.

[0061] In health checkups and comprehensive medical examinations, a judgment category is identified for each test. Therefore, the necessity of a final image interpretation can be determined by considering the judgment category. Examples of judgment categories include categories A, B, C, D1, D2, and E. Category A is "no abnormality," category B is "mild abnormality," category C is "requires follow-up observation," category D1 is "requires treatment," category D2 is "requires further examination," and category E is "currently undergoing treatment." Categories A to C are judged as normal, while categories D1 to E are judged as abnormal.

[0062] Figure 8 shows the fifth example of determining whether a final image interpretation is necessary. Figure 8 shows an example of a double image interpretation where both the first and second interpretation results are classified as "normal". In the example in Figure 8, seven cases are shown, depending on whether the findings in the first and second interpretations are different or the same, whether there are findings in the image analysis processing results, and whether the findings in the image analysis processing are different or the same as those in the first and second interpretations. The necessity of a final image interpretation and examples of how to request a final interpretation are shown for each case.

[0063] As in Case 1, no findings were found in either the first or second image interpretation (indicated by the symbol "-"), image analysis If the processing results show no findings, or if the findings from the image analysis process are not subject to determination as to whether they differ from or are the same as those in the first and second interpretations (indicated by the symbol "-"), it may be determined that a final interpretation is unnecessary.

[0064] As in Case 2, if there are no findings in both the first and second image interpretations (indicated by the symbol "-"), but findings are found in the image analysis processing results, and the findings from the image analysis processing differ from those of the first and second image interpretations, it may be determined that a final image interpretation is necessary. In this case, the example presented when requesting a final image interpretation may be, for example, "a case identified solely by image analysis processing."

[0065] As in Case 3, if the findings differ between the first and second image interpretations, and the image analysis results show no findings, and the findings from the image analysis are not subject to determination as to whether they differ from or are the same as those in the first and second image interpretations (indicated by the symbol "-"), then it may be determined that a final image interpretation is unnecessary.

[0066] As in Case 4, if the findings differ between the first and second interpretations, and if there are findings in the image analysis results, and the findings from the image analysis differ from those of the first and second interpretations, it may be determined that a final interpretation is necessary. In this case, an example of a case to present when requesting a final interpretation could be, for example, "a case in which the radiologist and the image analysis process differed in opinion."

[0067] As in Case 5, if the findings differ between the first and second image interpretations, and the image analysis results show findings that are the same as those in the first and second image interpretations, then it may be determined that a final image interpretation is unnecessary.

[0068] As in Case 6, if the findings are the same in the first and second image interpretations, and there are findings in the image analysis processing results, but the findings from the image analysis processing differ from those of the first and second image interpretations, it may be determined that a final image interpretation is necessary. In this case, an example of what to present when requesting a final image interpretation could be, for example, "There is a case that was picked up only by image analysis processing."

[0069] As in Case 7, if the findings are the same in the first and second image interpretations, and the image analysis results show findings that are the same as those in the first and second image interpretations, then it may be determined that a final image interpretation is unnecessary.

[0070] As described above, the control unit 51 may determine whether the classification indicated by the findings based on the image interpretation is normal or abnormal, and may also determine whether the classification indicated by the findings based on the image analysis processing is normal or not.

[0071] If the classification is normal, as in cases 2, 4, and 6, the control unit 51 may determine that a final image interpretation is necessary if there are findings based on image analysis processing that differ from findings based on image interpretation.

[0072] If the classification is normal, as in cases 5 and 7, the control unit 51 may determine that a final image interpretation is unnecessary if the findings from the image analysis process are the same as the findings based on the actual image interpretation. In this way, in cases where the likelihood of serious illness is low (when the classification is normal), the burden on the remote image interpretation center can be reduced by limiting the number of medical images to be interpreted in the final stage.

[0073] Figure 9 shows the sixth example of determining whether a final image interpretation is necessary. Figure 9 shows an example where either the first or second image interpretation result is classified as "abnormal." In the example in Figure 9, depending on whether the findings in the first and second image interpretations are different or the same, whether there are findings in the image analysis processing results, and whether the findings in the image analysis processing are different or the same as those in the first and second image interpretations, nine different cases are shown, along with the necessity of a final image interpretation and examples of how to present a request for a final interpretation.

[0074] If the classification is abnormal, as in cases 1-4 and 6-8, the control unit 51 may determine that a final image interpretation is necessary if there are discrepancies in the findings from the first image interpretation, the second image interpretation, and the image analysis processing.

[0075] The information processing device of this embodiment includes an acquisition unit that acquires a medical image to be read, a first determination unit that determines whether or not there are findings based on the reading of the medical image acquired by the acquisition unit, a second determination unit that determines whether or not there are findings based on the image analysis processing of the medical image acquired by the acquisition unit, and a third determination unit that determines whether or not a final reading of the medical image acquired by the acquisition unit is necessary based on the determination results of the first determination unit and the second determination unit, respectively.

[0076] In the information processing device of this embodiment, the third determination unit determines that a final image interpretation is necessary if the first determination unit determines that there are no findings and the second determination unit determines that there are findings.

[0077] In the information processing device of this embodiment, the first determination unit determines whether or not there are findings based on the first and second image interpretations performed by different physicians, and the third determination unit determines that a final image interpretation is necessary if the presence or absence of findings based on the first and second image interpretations differs.

[0078] In the information processing device of this embodiment, the first determination unit determines whether or not there are findings based on the first image interpretation by the physician, and the third determination unit determines that a final image interpretation is necessary if there are no findings based on the first image interpretation and there are findings based on the image analysis process.

[0079] In the information processing device of this embodiment, the first determination unit determines the name of the finding based on the image interpretation process, the second determination unit determines the name of the finding based on the image analysis process, and the third determination unit determines that a final image interpretation is necessary if the names of the findings determined by the first determination unit and the second determination unit are different.

[0080] In the information processing device of this embodiment, the first determination unit determines the area related to the findings based on the image interpretation process, the second determination unit determines the area related to the findings based on the image analysis process, and the third determination unit determines that a final image interpretation is necessary if the areas determined by the first determination unit and the second determination unit are different.

[0081] In the information processing device of this embodiment, the first determination unit determines whether the classification indicated by the findings based on the image interpretation is normal or abnormal, the second determination unit determines whether there are findings based on the image analysis process, and the third determination unit determines that if the first determination unit determines the classification is normal and there are findings determined by the second determination unit, and these findings are different from the findings determined by the first determination unit, then a final image interpretation is required.

[0082] In the information processing device of this embodiment, the first determination unit determines whether the classification indicated by the findings based on the first and second image interpretations performed by different physicians is normal or not, and the third determination unit determines that a final image interpretation is necessary if the classification indicated by the findings based on at least one of the first and second image interpretations is abnormal and the findings based on the first and second image interpretations are different.

[0083] In the information processing device of this embodiment, the third determination unit determines that a final image interpretation is necessary if the classification indicated by the findings based on at least one of the first image interpretation and the second image interpretation is abnormal, the findings based on the first image interpretation and the second image interpretation are the same, and the findings determined by the second determination unit are different from the aforementioned findings.

[0084] The information processing device of this embodiment includes a result acquisition unit that acquires a final result indicating whether or not there are findings based on the interpretation of medical images acquired by the acquisition unit, according to the determination result of the third determination unit.

[0085] In the information processing device of this embodiment, the second determination unit includes a learning model generated by machine learning that outputs whether or not there is a finding when a medical image is input.

[0086] The information processing system of this embodiment includes the aforementioned information processing device, acquires medical images of the subject to be read from a first terminal device, outputs a final result indicating the presence or absence of findings based on the reading of the medical images to a second terminal device, and provides the health examination results based on the final result to the subject's terminal device.

[0087] The computer program of this embodiment causes the computer to perform the following processes: acquire a medical image to be read; determine whether or not there are findings based on the reading of the acquired medical image; determine whether or not there are findings based on the image analysis process of the acquired medical image; and determine whether or not a final reading of the acquired medical image is necessary based on the results of the determination of whether or not there are findings based on the reading of the image and the image analysis process, respectively.

[0088] The information processing method of this embodiment acquires a medical image to be read, determines whether or not there are findings based on the reading of the acquired medical image, determines whether or not there are findings based on image analysis processing of the acquired medical image, and determines whether or not a final reading of the acquired medical image is necessary based on the determination results of the presence or absence of findings based on the reading of the image and the image analysis processing, respectively.

[0089] As described above, according to this embodiment, the radiologist's interpretation results are guaranteed to be independent of the image analysis results, and the presence or absence and content of findings from the image analysis are also taken into consideration. Therefore, the radiologist's interpretation results can be supplemented, and oversights during interpretation can be suppressed.

[0090] In particular, remote image interpretation services for health checkups require rapid interpretation of a large volume of medical images requested by health checkup institutions (for example, interpretation of a single medical image is required to be completed within a few seconds), which may increase the likelihood of oversights by radiologists during interpretation. According to this embodiment, the presence or absence and content of findings obtained through image analysis processing are also considered when determining whether a final interpretation is necessary, thereby suppressing oversights during interpretation. [Explanation of symbols]

[0091] 1. Communication Network 10. First image reading terminal 20. Second image reading terminal 30 Final image interpretation terminal 40 Remote Image Interpretation Database 50 servers 51 Control Unit 52 Communications Department 53 Interface section 54 Recording medium reading unit 541 Recording media 55 memory 56 Image Processing Unit 57 Memory section 58 Computer Programs 100, 200, 300 health checkup facilities 101, 102, 103, 150 Terminal devices

Claims

1. An acquisition unit that acquires medical images to be read, A first determination unit that determines whether or not there are findings based on the interpretation of medical images acquired by the acquisition unit, A second determination unit determines whether or not there are findings based on image analysis processing of the medical image acquired by the acquisition unit, A third determination unit determines whether a final interpretation of the medical image acquired by the acquisition unit is necessary, based on the determination results of the first determination unit and the second determination unit, respectively. Equipped with, The aforementioned determination unit, If the first determination unit determines that there is a finding, and the second determination unit determines that there is no finding, then it is determined that the final image interpretation is unnecessary. Information processing device.

2. The aforementioned final image interpretation is, This is performed by a radiologist who is different from the radiologist who performed the aforementioned image interpretation. The information processing apparatus according to claim 1.

3. The first determination unit is, Determine whether or not there are findings based on the first and second interpretations by different physicians. The aforementioned determination unit, If the presence or absence of findings based on the first image interpretation differs from the presence or absence of findings based on the second image interpretation, it is determined that a final image interpretation is necessary. The information processing apparatus according to claim 1 or claim 2.

4. The first determination unit is, Determine whether or not there are findings based on the radiologist's interpretation of the images. The second determination unit described above is: Determine the presence or absence of findings based on image analysis processing using CAD. The information processing apparatus according to any one of claims 1 to 3.

5. The first determination unit is, Determine the name of the finding based on the interpretation of the image. The second determination unit described above is: Determine the name of the finding based on image analysis processing, The aforementioned determination unit, If the names of the findings determined by the first and second determination units are different, it is determined that a final image interpretation is required. The information processing apparatus according to any one of claims 1 to 4.

6. The first determination unit is, Determine the body part related to the findings based on the interpretation of the image. The second determination unit described above is: The body part related to the findings based on image analysis processing is determined, The aforementioned determination unit, If the areas determined by the first determination unit and the second determination unit are different, it is determined that a final image interpretation is necessary. The information processing apparatus according to any one of claims 1 to 5.

7. The first determination unit is, Determine whether the findings based on the interpretation of the radiograph indicate a normal or abnormal classification. The second determination unit described above is: Determine the presence or absence of findings based on image analysis processing. The aforementioned determination unit, If the first determination unit determines the classification to be normal, and the second determination unit determines that there is a finding that differs from the finding determined by the first determination unit, then it is determined that a final image interpretation is necessary. The information processing apparatus according to any one of claims 1 to 6.

8. The first determination unit is, Determine whether the classification indicated by the findings based on the first and second image interpretations by different physicians is normal or not. The aforementioned determination unit, If the classification indicated by the findings based on at least one of the first and second image interpretations is abnormal, and the findings based on the first and second image interpretations differ, then it is determined that a final image interpretation is necessary. The information processing apparatus according to any one of claims 1 to 7.

9. The aforementioned determination unit, If the classification indicated by the findings based on at least one of the first and second image interpretations is abnormal, and the findings based on the first and second image interpretations are identical, and the findings determined by the second determination unit differ from the aforementioned findings, then it is determined that a final image interpretation is necessary. The information processing apparatus according to claim 8.

10. The system includes a result acquisition unit that acquires a final result indicating whether or not there are findings based on the interpretation of medical images acquired by the acquisition unit, according to the determination result of the third determination unit. An information processing apparatus according to any one of claims 1 to 9.

11. The second determination unit described above is: When a medical image is input, it outputs whether or not there are findings, including a machine learning-generated learning model. The information processing apparatus according to any one of claims 1 to 10.

12. The aforementioned determination unit, If the first determination unit determines there are no findings, and the second determination unit determines there are findings, then it is determined that a final image interpretation is necessary. The information processing apparatus according to any one of claims 1 to 11.

13. An acquisition unit that acquires medical images to be read, A first determination unit that determines whether or not there are findings based on the interpretation of medical images acquired by the acquisition unit, A second determination unit determines whether or not there are findings based on image analysis processing of the medical image acquired by the acquisition unit, A third determination unit determines whether a final interpretation of the medical image acquired by the acquisition unit is necessary, based on the determination results of the first determination unit and the second determination unit, respectively. Equipped with, The aforementioned determination unit, If the first determination unit determines that there is a finding and the second determination unit determines that there is no finding, a final result based on the results of the image interpretation is generated. Information processing device.

14. The information processing device comprises any one of claims 1 to 13, The medical images to be read from the subject are acquired from the first terminal device. The final result indicating the presence or absence of findings based on the interpretation of the aforementioned medical image is output to the second terminal device. The health examination results based on the aforementioned final results are provided to the terminal device of the subject. Information processing system.

15. Obtain the medical image to be interpreted, Determine whether or not there are findings based on the interpretation of the acquired medical images. Determine whether or not there are findings based on image analysis processing of the acquired medical images. Based on the results of each assessment, a determination is made as to whether or not final interpretation of the acquired medical images is necessary. If it is determined that there are findings based on the aforementioned image interpretation, and that there are no findings based on the aforementioned image analysis processing, then it is determined that the final image interpretation is unnecessary. A computer program that instructs a computer to perform a process.

16. Obtain the medical image to be interpreted, Determine whether or not there are findings based on the interpretation of the acquired medical images. Determine whether or not there are findings based on image analysis processing of the acquired medical images. Based on the results of each assessment, a determination is made as to whether a final interpretation of the previously acquired medical images is necessary. If it is determined that there are findings based on the aforementioned image interpretation, and that there are no findings based on the aforementioned image analysis processing, then a final result based on the results of the aforementioned image interpretation is generated. A computer program that instructs a computer to perform a process.

17. Obtain the medical image to be interpreted, Determine whether or not there are findings based on the interpretation of the acquired medical images. Determine whether or not there are findings based on image analysis processing of the acquired medical images. Based on the results of each assessment, a determination is made as to whether or not final interpretation of the acquired medical images is necessary. If it is determined that there are findings based on the aforementioned image interpretation, and that there are no findings based on the aforementioned image analysis processing, then it is determined that the final image interpretation is unnecessary. An information processing method that involves having a computer perform a task.

18. Obtain the medical image to be interpreted, Determine whether or not there are findings based on the interpretation of the acquired medical images. Determine whether or not there are findings based on image analysis processing of the acquired medical images. Based on the results of each assessment, a determination is made as to whether a final interpretation of the previously acquired medical images is necessary. If it is determined that there are findings based on the aforementioned image interpretation, and that there are no findings based on the aforementioned image analysis processing, then a final result based on the results of the aforementioned image interpretation is generated. An information processing method that involves having a computer perform a task.

Images