Analysis device, analysis method, and program

Abstract

To provide an analysis device, an analysis method, and a program that can present the next step to a user according to an analysis result and diagnostic result of medical information.SOLUTION: A analysis device includes: an analysis section that acquires "first medically-related information" obtained through computer processing on medical information; a generation section that generates structured data by structuring unstructured data acquired from information created by a user on the basis of the medical information; an acquisition section that acquires "second medically-related information" from the structured data; a comparison processing section that compares "the first medically-related information" acquired by the analysis section and "the second medically-related information" acquired by a data acquisition section 33; and an output section that outputs next step information on the basis of a comparison result obtained by comparing in the comparison processing section.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an analysis device, an analysis method, and a program. [Background technology]

[0002] In recent years, with the development of AI (Artificial Intelligence) technology, AI analysis has been introduced into the medical field, and attempts are being made to use AI to assist in the analysis and diagnosis of medical information, such as image diagnosis, which was previously performed by doctors. For example, Patent Document 1 discloses a diagnostic support device that detects differences between first medical information based on information created by a user and second medical information obtained by computer processing, and displays the differences between the two on a display unit in a display format that corresponds to the combination of the lesion names contained in the first medical information and the lesion names contained in the second medical information.

[0003] In clinical settings, there is a need to perform tests and diagnoses appropriately and quickly, and to streamline and optimize diagnostics to reduce the burden on doctors. The introduction of AI analysis is expected to contribute to the efficiency and optimization of such diagnoses. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 5501491 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the technology disclosed in Patent Document 1 merely indicates the difference between the first medical information and the second medical information. In other words, sufficient consideration is not given to the next steps, such as what actions should be taken depending on whether or not there is a difference. For this reason, there is a problem that even if AI analysis is introduced, it does not necessarily lead to more efficient and optimized diagnosis.

[0006] For example, after a primary image interpreter has interpreted a certain medical image, no determination is made as to whether or not the medical image should be passed on to the next step, which is the image interpretation step by a secondary image interpreter. For this reason, a secondary interpretation step is required for every interpretation, and the burden on the secondary interpretation physician is not reduced.

[0007] The present invention has been made in consideration of the problems in the prior art described above, and aims to provide an analysis device, an analysis method, and a program that can present the next step to the user based on the analysis results and diagnosis results of medical information. [Means for solving the problem]

[0008] In order to solve the above problem, the invention described in claim 1 is an analysis device, comprising: an analysis unit that acquires first medical information obtained by computer processing of medical information; a generation unit that generates structured data by structuring unstructured data acquired from information created by a user based on the medical information; an acquisition unit that acquires second medical information from the structured data; a comparison processing unit that compares the first medical information acquired by the analysis unit with the second medical information acquired by the acquisition unit; Based on the comparison result obtained by the comparison processing unit, Show what to do next an output unit that outputs next process information; The present invention is characterized by comprising:

[0009] The invention described in claim 17 is as follows: The computer runs 1. A method of analysis comprising: an analyzing step of acquiring first medical information obtained by computer processing of the medical information; a generating step of structuring unstructured data obtained from information created by a user based on the medical information to generate structured data; an acquisition step of acquiring second medical information from the structured data; a comparison process step of comparing the first medical information acquired in the analysis step with the second medical information acquired in the acquisition step; an output step of outputting next process information indicating what action should be taken next based on the comparison result obtained in the comparison processing step; The present invention is characterized by comprising:

[0010] Also, claims 19 The invention described in is a program, On the computer, an analysis function for acquiring first medical information obtained by computer processing of the medical information; a generation function for structuring unstructured data obtained from information created by a user based on the medical information to generate structured data; an acquisition function for acquiring second medical information from the structured data; a comparison processing function that compares the first medical information acquired by the analysis function with the second medical information acquired by the acquisition function; Based on the comparison result obtained by the comparison processing function, Show what to do next An output function that outputs the next process information; The present invention is characterized by realizing the above. [Effects of the Invention]

[0011] According to the present invention, it is possible to present the next step to the user in accordance with the analysis and diagnosis results of the medical information. [Brief explanation of the drawings]

[0012] [Figure 1]1 is a diagram illustrating the overall configuration of a medical image system according to an embodiment of the present invention. [Figure 2] 1 is a block diagram showing a functional configuration of an embodiment of an analysis device according to the present invention; [Figure 3] 1 is a table showing an example of structuring natural language text, which is unstructured data. [Figure 4] 10 is a flowchart showing an analysis process in a first QA pattern. [Figure 5] FIG. 5 is an explanatory diagram schematically showing the flow of the analysis process shown in FIG. 4. [Figure 6] 10 is a flowchart showing a comparison process. [Figure 7] 10 is a flowchart showing an analysis process in a second QA pattern. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, an embodiment of an analysis device, an analysis method, and a program according to the present invention will be described, although the scope of the invention is not limited to the illustrated examples.

[0014] [Configuration of medical imaging system] The analysis device in this embodiment performs analysis of medical images, which are medical information, in a medical image system, for example. FIG. 1 shows the system configuration of a medical image system 100.

[0015] As shown in Fig. 1, the medical image system 100 includes a modality 1, a console 2, an analysis device 3, an interpretation terminal 4, an image server 5, etc., which are connected via a communication network N such as a LAN (Local Area Network), a WAN (Wide Area Network), or the Internet. Each device constituting the medical image system 100 conforms to the HL7 (Health Level Seven) or DICOM (Digital Image and Communications in Medicine) standards, and communication between the devices is performed in accordance with HL7 or DICOM. Note that the number of modalities 1, consoles 2, interpretation terminals 4, etc. is not particularly limited.

[0016] The modality 1 is an image generating device such as an X-ray device (DR, CR), an ultrasound diagnostic device (US), a CT, or an MRI, and generates medical images as medical information by capturing an image of a patient's examination target area as a subject based on examination order information transmitted from a Radiology Information System (RIS) (not shown) or the like. In accordance with the DICOM standard, additional information (patient information, examination information, image ID, etc.) is written to the header of the image file of the medical image generated by the modality 1. The medical image thus annotated with additional information is transmitted to an analysis device 3 or an interpretation terminal 4 via a console 2 or the like.

[0017] The console 2 is an imaging control device that controls imaging in the modality 1. The console 2 outputs imaging conditions and image reading conditions to the modality 1 and acquires image data of medical images captured in the modality 1. The console 2 is configured with a control unit, display unit, operation unit, communication unit, memory unit, etc. (not shown), and each unit is connected by a bus.

[0018] The analysis device 3 is a device that performs various analyses on medical images, which are medical information. The analysis device 3 is configured as a PC, a mobile terminal, or a dedicated device. In this embodiment, the analysis device 3 includes a medical image management device such as a PACS (Picture Archiving and Communication System).

[0019] FIG. 2 is a block diagram showing the functional configuration of the analysis device 3. As shown in FIG. As shown in Figure 2, the analysis device 3 is configured with a control unit 31, a memory unit 32, a data acquisition unit 33, a data output unit 34, an operation unit 35, a display unit 36, etc., and each unit is connected by a bus 37.

[0020] The data acquisition unit 33 is an acquisition unit that acquires various data from an external device (for example, the console 2 or an interpretation terminal 4 described later). The data acquisition unit 33 is configured, for example, by a network interface or the like, and is configured to receive data from an external device connected by wire or wirelessly via the communication network N. In this embodiment, the data acquisition unit 33 is configured by a network interface or the like, but it can also be configured by a port into which a USB memory, an SD card, or the like can be inserted. In this embodiment, the data acquisition unit 33 acquires image data of medical images, for example, from the console 2. The data acquisition unit 33 also acquires information such as a diagnosis result (detection result information of a lesion that can be read from a medical image) regarding the medical image created by a user (for example, a doctor, etc.) based on the medical image, which is medical information, and an interpretation report, which is an interpretation result by an image interpretation doctor (for example, an image interpretation doctor who performs primary interpretation or secondary interpretation, etc.) from the image interpretation terminal 4. Furthermore, when additional information is added, such as when a region of interest (ROI) is set in the medical image by a user, such as an image interpretation doctor, the data acquisition unit 33 also acquires such additional information.

[0021] The data output unit 34 is an output unit that outputs information processed by the analysis device 3. There are no particular limitations on the destination to which the data output unit 34 outputs various pieces of information. For example, the information may be output to the display unit 36 ​​of the analysis device 3, the image interpretation terminal 4 or image server 5 (described later), various external display devices (not shown), or the like. Examples of the data output unit 34 include a network interface for communicating with the image interpretation terminal 4 and the image server 5, a connector for connecting to an external device (e.g., a display device, a printer, etc. not shown), and a port for various media such as a USB memory.

[0022] For example, when the next process is set based on the comparison result by the control unit 31 functioning as a comparison processing unit, the data output unit 34 outputs the next process information (also referred to as "next process information"). The process information (next process information) output from the data output unit 34 includes, for example, information on whether or not additional tests will be performed, and information on whether or not the "first medical information" or the "second medical information" will be used as information on a "definitive diagnosis."

[0023] For example, if the comparison result by the control unit 31 functioning as a comparison processor indicates that the "first medical information" and the "second medical information" do not match, the data output unit 34 may output, as process information (next process information), information requesting a diagnosis from a second user. Alternatively, if the comparison result by the control unit 31 functioning as a comparison processor indicates that the "first medical information" and the "second medical information" match, the data output unit 34 may output, as process information (next process information), information requesting a diagnosis from a second user. Here, the second user is, for example, a secondary radiologist (or final radiologist) who performs secondary interpretation when the "second medical information" is created by a primary radiologist who performs primary interpretation. For example, a request may be output to have the user (e.g., the primary radiologist) reconfirm the comparison of the results between the "first medical information" and the "second medical information." This allows the user to understand that the judgment made by the AI ​​analysis is different from their own. Furthermore, if the "first medical information" and the "second medical information" do not match, the response is not limited to a request for a diagnosis from the secondary radiologist (or final radiologist). For example, a request may be made to the user (e.g., the primary radiologist) who created the "second medical information" to reconfirm the diagnosis.

[0024] The operation unit 35 is composed of a keyboard with various keys, a pointing device such as a mouse, or a touch panel attached to the display unit 36. The operation unit 35 allows a user to input data, and specifically outputs operation signals input by key operations on the keyboard, mouse operations, or touch operations on the touch panel to the control unit 31.

[0025] The display unit 36 ​​is configured to include a monitor such as an LCD (Liquid Crystal Display), and displays various screens according to instructions of a display signal input from the control unit 31. The number of monitors is not limited to one, and multiple monitors may be provided. As will be described later, the display unit 36 ​​appropriately displays statistical information and the like output from the control unit 31 (the control unit 31 as a comparison processing unit).

[0026] The control unit 31 is configured with a CPU (Central Processing Unit), RAM (Random Access Memory), etc., and comprehensively controls the operations of each unit of the analysis device 3. Specifically, the CPU reads out various processing programs stored in the program storage unit 321 of the storage unit 32, loads them into the RAM, and executes various processes in accordance with the programs. In this embodiment, the control unit 31 realizes various functions as follows in cooperation with the programs.

[0027] The control unit 31 functions as an analysis unit that acquires "first medical information" by computer processing of the medical information. Specifically, lesion detection and analysis processing is performed on the medical images acquired by the data acquisition unit 33, and the detection and analysis results of one or more types of lesions are output as "first medical information." Here, the computer processing used may be, for example, AI analysis using AI (Artificial Intelligence) that performs image diagnosis and image analysis, including lesion detection using CAD (Computer Aided Diagnosis).

[0028] The control unit 31 also functions as a learning unit that learns the correspondence between, for example, medical information (medical images in this embodiment) and medical information (such as the name of a lesion), and the control unit 31 as an analysis unit obtains "first medical information" by computer processing the medical information (medical images) based on the correspondence between the medical information (medical images) and medical information learned by the learning unit. That is, for example, a machine learning model created by deep learning or other methods using a large amount of training data (pairs of medical images showing lesions and correct labels (lesion areas in the medical images and the diagnosis of the lesion (type of lesion), etc.)) is used to detect and analyze lesions from input medical images. The "first medical information" thus acquired is information indicating, for example, the name of the lesion, the location of the lesion, etc., and is attached to the image data of the medical image as auxiliary information.

[0029] In this embodiment, the control unit 31 also functions as an acquisition unit (comparison object acquisition unit) that acquires a comparison object to be compared with the "first medical information" obtained by AI analysis. The control unit 31, which serves as a comparison object acquisition unit, acquires "second medical information" as a comparison object to be compared with "first medical information" based on information created by a user based on medical information on an interpretation terminal 4, etc.

[0030] Note that information created by users (e.g., radiologists) is generally unstructured data. Here, unstructured data refers to, for example, medical information (e.g., medical images, electrocardiogram waveform data, etc.; in this embodiment, medical images in particular) itself, or information created by a user based on medical information (e.g., information in a radiology report written in natural language regarding medical images). In contrast, the "first medical information," which is the result of AI analysis, is structured data. Therefore, in order to compare the two, the "second medical information" used as a comparison target must also be structured, and must be structured as structured data consisting of character strings, etc., that can be compared with the "first medical information."

[0031] In this embodiment, structuring includes analyzing text, images, audio, video, etc. and tagging them with metadata. In this embodiment, structuring includes, for example, dividing unstructured data (e.g., natural sentences in radiology report information) acquired from user-created information (e.g., radiology report information) into words (morphemes) based on medical information (e.g., medical images) and giving meaning to the words. Giving meaning to words includes, for example, classifying sentences into subject, predicate, object, and complement (SVOC). Giving meaning to words also includes classifying words by attribute (location, findings, disease name, positive / negative, positive / negative judgment, significant findings, and numerical values). In this embodiment, structured data refers to data that has been structured as described above.

[0032] In this embodiment, the control unit 31 functions as a generation unit that structures unstructured data obtained from information (e.g., natural language in an interpretation report) created by a user based on medical information (e.g., medical images) to generate structured data. Specifically, for example, the storage unit 32 is provided with a structured dictionary 323 in which words are classified into predetermined attributes, and the control unit 31, which serves as a generation unit, assigns meaning to the words that make up the unstructured data by classifying them into attributes according to this structured dictionary 323. The structured dictionary 323 also includes one obtained by machine learning.

[0033] FIG. 3 shows an example in which a radiology report (natural language, which is unstructured data) is divided into words and structured by applying the structured dictionary 323. As shown in Figure 3, for example, if the original sentence (natural text) of a radiology report is "There is a slightly lobulated mass measuring 4.5 x 4 x 4.5 cm on the right side of the anterior mediastinum," the sentence describing where it is, its size, and what it is is first divided into words. As a result, the location is determined to be "on the right side of the anterior mediastinum," the size (numerical value) is "approximately 4.5 x 4 x 4.5 cm," the finding is "lobulated," and the disease name is "mass." The affirmative / negative is "yes" because of the word "there is," which corresponds to an important finding ("○" in Figure 3). By dividing each word into semantically assigned words in this way, the natural text, which was previously unstructured data, becomes structured data. The control unit 31 also functions as an acquisition unit (comparison target acquisition unit) that acquires "second medical information" that can be compared with "first medical information" from the structured data structured in this manner.

[0034] Furthermore, the control unit 31 functions as a comparison processing unit that compares the "first medical information" acquired as the analysis unit with the structured "second medical information" acquired as the acquisition unit. That is, the two are compared and the results of the comparison are output. Specifically, the agreement and disagreement (difference) between the "first medical information" and the "second medical information" will be clarified. Since both the "first medical information" and the "second medical information" are structured data, they can be compared side by side.

[0035] The method by which the control unit 31 serving as the comparison processing unit compares the "first medical information" and the "second medical information" is not particularly limited. The control unit 31 may function as a comparison processing unit, and as a classification unit that classifies the "second medical information" into information that is easy to compare with the "first medical information" (referred to as "third medical information"), based on the premise that the "first medical information" and the "second medical information" are compared. Here, the "second medical information" includes any of the following: the name of an imaging finding, the name of a disease, or the name of an anatomical location. The expressions used by users (radiography doctors, etc.) to express the names of imaging findings, the name of a disease, the name of an anatomical location, etc., vary widely and vary from person to person. For this reason, it is effective to classify the "second medical information" as "third medical information" in order to match it with the "first medical information" and to consolidate it into a single expression as much as possible.

[0036] For example, if a user (e.g., a radiologist) uses expressions such as "nodule," "mass," and "faint circular shadow," the control unit 31, as a classification unit, will group these all together as the expression "nodule." If the "first medical information," which is the result of the AI ​​analysis, contains the term "nodule," the control unit 31, as a comparison processing unit, will determine that the term matches the AI ​​analysis result by grouping the term "mass" with "nodule," even if the original expression used by the user (e.g., a radiologist) is "mass," and the actual words do not match.

[0037] It should be noted that the control unit 31 as a classification unit is not limited to classifying "second medical information" into "third medical information." For example, when grouping together expressions that make up the "second medical information," the control unit 31 as a classification unit may classify the expressions into "first medical information," which is the analysis result of the AI.

[0038] For example, if a user (radiologist, etc.) uses expressions such as "upper lung field," "upper lung field," and "upper lung," and the "first medical information" that is the result of the AI ​​analysis expresses all of these as "upper lung field," the control unit 31, which acts as a classification unit, will consolidate all of these into the expression "upper lung field," which is used in the AI ​​analysis result. This allows the "second medical information" and the "first medical information" to be matched with complete terminology agreement, improving matching accuracy.

[0039] In addition, the method by which the control unit 31 as a classification unit classifies the "second medical information" into the "third medical information" or the "second medical information" into the "first medical information" is not particularly limited. For example, the memory unit 32 is provided with a correspondence registration unit 324 that pre-registers the correspondence between "second medical information" and "third medical information" and the correspondence between "second medical information" and "first medical information," and the control unit 31, as a classification unit, performs classification by referring to this correspondence registration unit 324.

[0040] Furthermore, the control unit 31 as a classification unit may also function as a learning unit that learns the correspondence between the "second medical information" and the "first medical information" and associate them through learning. When associating the two through learning, the similarity between the "second medical information" and the "first medical information" is calculated. In this case, the control unit 31 also functions as a similarity calculation unit that calculates the similarity between the two.

[0041] For example, when the "second medical information" is structured text data, text mining (similarity calculation) is performed between the "second medical information" and the "first medical information." The similarity can be calculated by creating a vector space model that expresses the frequency of each word in a document in the form of a vector. This method allows the similarity between the data to be compared to be calculated by comparing the vectors of the data to be compared. When calculating the similarity in this way, it is preferable that the control unit 31 serving as the similarity calculation unit has previously learned the similarity between the "second medical information" and the "first medical information" by machine learning or the like. Note that the method for calculating the similarity is not particularly limited, and various methods can be used.

[0042] Furthermore, if the control unit 31 can broadly define terms such as pathology information to allow for flexible matching when analyzing medical information (e.g., medical images) as an analysis unit, even if there is a slight discrepancy in the expressions of "first medical information" and "second medical information," the terms constituting the "first medical information" can be included in the definition of the terms constituting the "first medical information" to determine whether they match or not. In this case, there is no need to classify the "second medical information" into "first medical information" or "third medical information," and comparison processing between the two can be performed even when the control unit 31 does not function as a classification unit.

[0043] Note that, if the control unit 31 as a classification unit can classify the "second medical information" by referring to information registered in advance in the association registration unit 324, it is preferable to classify the "second medical information" based on the information registered in the association registration unit 324, and if the "second medical information" is not registered in the association registration unit 324, it is preferable to classify the "second medical information" by learning as a learning unit. This makes it possible to prioritize the user's intentions when the user has registered an association in advance.

[0044] Furthermore, if the structured "second medical information" acquired by the control unit 31 as an acquisition unit is unknown lesion information, it will not correspond to anything previously registered in the correspondence registration unit 324, and it will not be possible to calculate the similarity with the "first medical information" which is the analysis result of the AI. In this case, the control unit 31 functions as a lesion information classification unit, classifying the "second medical information" into "first medical information," and as a classification result presentation unit that presents the classification results of the lesion information classification unit to the user and requests approval.

[0045] Specifically, for example, by analyzing the words that make up the "second medical information," it extracts words that are judged to be the closest to the words used in the AI ​​analysis results registered in the association registration unit 324. Then, by outputting the classification results as the lesion information classification unit to the display unit 36 ​​or the like, it presents the classification results to the user as the classification result presentation unit, and requests approval of the classification results as to whether or not it is okay to associate unknown lesion information that makes up the "second medical information" with the words. As a result, if the classification result is approved by the user, the control unit 31 as a learning unit learns the unknown lesion information as predetermined lesion information according to the classification result, and registers the learning result in the association registration unit 324. As a result, the next time the same lesion information is read, correct classification can be performed by referring to the correspondence registration unit 324.

[0046] The memory unit 32 is composed of an HDD (Hard Disk Drive), semiconductor memory, etc., and stores programs for performing various processes including the analysis of medical information such as medical images, which will be described later, as well as parameters, files, etc. required for executing the programs. The storage unit 32 of this embodiment includes, for example, a program storage unit 321 that stores various programs, as well as a learning data storage unit 322, a structured dictionary 323, an association registration unit 324, and the like.

[0047] As described above, the learning data storage unit 322 stores, for example, a large amount of learning data and a machine learning model created by learning using this data through deep learning or the like. In addition, the structured dictionary 323 is dictionary data used to structure unstructured data such as an interpretation report created by a user (radiography physician) as described above, and generate structured data called "second medical information." The correspondence registration unit 324 is a correspondence table or the like in which the correspondence between words when structured data is matched with each other is registered in advance.

[0048] The image interpretation terminal 4 is a computer device that includes, for example, a control unit, an operation unit, a display unit, a storage unit, a communication unit, etc., and that reads out medical images, which are medical information, from the image server 5, etc., and displays them for image interpretation. The users (primary and secondary radiologists) interpret the medical images on the radiology terminal 4 and create an interpretation report or the like which is the diagnostic result of the radiologist regarding the medical images. Furthermore, the user (primary doctor or secondary doctor) may attach information indicating, for example, a region of interest (ROI) to the medical image on the image interpretation terminal 4. Information indicating a region of interest (ROI) is, for example, a mark or a frame attached to a part determined to be a lesion, and is set on the image by the user (primary radiologist or secondary radiologist) touching the display screen or specifying it with an operation unit such as a pointing device. Information indicating a region of interest (ROI) is information consisting of coordinate information indicating a position and area, and is itself structured data generated based on medical information. In this case, the generation unit that generates the structured data is the control unit of the radiology terminal 4 that sets information (coordinate information, etc.) indicating the region of interest (ROI) in accordance with the operation of the user (primary radiologist or secondary radiologist).

[0049] The image server 5 is, for example, a server that constitutes a PACS (Picture Archiving and Communication Systems), and stores in a database the medical images output from the modality 1 in association with patient information (patient ID, patient name, date of birth, age, gender, height, weight, etc.), examination information (examination ID, examination date and time, type of modality, examination area, requesting department, purpose of examination, etc.), image ID of the medical image, information on the AI ​​analysis results output from the control unit 31 of the analysis device 3 (i.e., ``first medical information'') and the interpretation report created by the user (radiography doctor) on the interpretation terminal 4, ``second medical information'' which is the diagnosis result of the radiology doctor, and matching results (comparison results) output from the control unit 31 (comparison processing unit) of the analysis device 3. Furthermore, the image server 5 reads out the medical image requested by the image interpretation terminal 4 and various types of additional information attached to the medical image from the database, and displays them on the image interpretation terminal 4.

[0050] [Analysis Method in This Embodiment] In this embodiment, the analysis method includes an analysis step of acquiring "first medical information" obtained by computer processing of medical information such as medical images; a generation step of structuring unstructured data acquired from information created by a user based on the medical information to generate structured data; an acquisition step of acquiring "second medical information" from the generated structured data; a comparison processing step of comparing the "first medical information" acquired in the analysis step with the "second medical information" acquired in the acquisition step; and an output step of outputting next process information based on the comparison results obtained in the comparison processing step.

[0051] According to the analysis method of this embodiment, by taking into consideration both the analysis results of the AI ​​and the diagnostic results of the radiologist, quality assurance (hereinafter referred to as "QA") can be performed on the diagnostic accuracy of medical information (medical images). As for QA patterns, the flow of the analysis method differs depending on how reliable the AI ​​analysis results are. The first QA pattern is a flow that is adopted when the AI ​​analysis results are not very reliable and the AI ​​analysis cannot be fully trusted.

[0052] FIG. 4 is a flowchart showing the analysis process in the first QA pattern, and FIG. 5 is an explanatory diagram showing a schematic flow of the process. As shown in Figures 4 and 5, in the first QA pattern, the target medical information (medical image) is first analyzed by AI (AI application) in the control unit 31 of the analysis device 3, and the analysis result (diagnosis result), "first medical information," is obtained (step S1; analysis process).

[0053] Furthermore, information such as an interpretation report created by a user (a radiologist who performs primary interpretation) reading the target medical information (here, a medical image) is acquired by the data acquisition unit 33 (step S2). Then, the unstructured data acquired from the information is structured by the control unit 31 as a generation unit to generate structured data (step S3; generation step), and the control unit 31 as an acquisition unit acquires "second medical information" from this structured data (step S4; acquisition step). Then, the control unit 31, which functions as a comparison processing unit, matches (compares) the "first medical information" with the "second medical information" (step S5; comparison processing step).

[0054] FIG. 6 is a flowchart showing the comparison process steps. As shown in FIG. 6, in this comparison process, first, the control unit 31 determines whether or not the lesion information such as findings and disease name that constitute the "second medical information" has been pre-registered in the correspondence registration unit 324 (step S11). If the lesion information constituting the "second medical information" has been registered in advance in the correspondence registration unit 324 (step S11; YES), the control unit 31 compares the "first medical information" with the "second medical information" based on the registered information and determines whether they match or mismatch (step S12). If they match (step S12; YES), it determines that the "first medical information" and the "second medical information" match (step S13), and if they do not match (step S12; NO), it determines that the "first medical information" and the "second medical information" do not match (step S14).

[0055] On the other hand, if the lesion information constituting the "second medical information" has not been registered in advance in the association registration unit 324 (step S11; NO), the control unit 31 calculates the similarity between the "first medical information" and the "second medical information" by machine learning (step S15). Then, it determines whether the calculated similarity is equal to or greater than a predetermined threshold (step S16), and if it is equal to or greater than the predetermined threshold (step S16; YES), it determines that the "first medical information" and the "second medical information" match (step S17). If it is not equal to or greater than the predetermined threshold (step S16; NO), it determines that the "first medical information" and the "second medical information" do not match (step S18).

[0056] If the lesion information such as findings or disease name that constitutes the "second medical information" is unknown, the control unit 31 classifies it as one of the words that appear in the analysis results of the AI, and presents the classification result to the user (e.g., a radiologist) for approval. If approved, this is registered as new association information in the association registration unit 324. If the new association is registered in the association registration unit 324, the association registered in the association registration unit 324 will be referenced the next time the same lesion information is input. On the other hand, if it is not approved, it is reclassified into another word and the process is repeated until it is approved by the user.

[0057] When it is determined in the comparison processing step whether the "first medical information" and the "second medical information" match or do not match, the process returns to Figures 4 and 5, and based on the comparison results obtained in the comparison processing step, the control unit 31 determines what should be done as the next step (step S6), and outputs the determination result as next step information from the data output unit 34, etc. (step S7; output step). For example, if the "first medical information" and the "second medical information" match, the matched information is determined as the "definitive diagnosis information."

[0058] If the two do not match, the information to send the image to a second user (that is, a second or final image interpreting physician other than the primary image interpreting physician) is output as "next process information." In this case, the medical image data, the "first medical information," the "second medical information," and information such as the matching results (e.g., what content matches and what is determined to be inconsistent) are sent to the interpretation terminal 4 operated by the secondary radiologist. The secondary radiologist then refers to this information to perform secondary interpretation, and prepares diagnostic results such as an interpretation report as "second medical information (in secondary interpretation)," which becomes "definitive diagnostic information." However, the "next process information" is not limited to this, and if it is determined that further testing is necessary (for example, if the "second medical information" based on the diagnosis of the primary radiologist contains a statement indicating the need for re-examination), instructions for additional testing, etc. will be output as the "next process information."

[0059] In this way, the process shown in Figures 4 and 5 matches (compares) the "second medical information" based on the diagnosis result of the primary radiologist with the "first medical information" which is the analysis result (diagnosis result) of the AI, and can inform the user of the next step information based on the result (matching result). This reduces the burden on the secondary interpretation physician, as, for example, if the "first medical information" and "second medical information" match, the image will not be read for secondary interpretation, allowing the secondary interpretation physician to focus on cases that require secondary interpretation, and to perform efficient and appropriate interpretation. In addition, unstructured data, such as radiology reports created by users, is structured and then compared with the "first medical information," which is the result of the AI ​​analysis, allowing for appropriate comparison processing.

[0060] When "definitive diagnosis information" is issued for a medical image as medical information, the medical image is associated with the "definitive diagnosis information" determined by the analysis device 3 and stored in the image server 5. The storage location of medical images and various information associated therewith (such as "first medical information" and "second medical information"), "definitive diagnosis information", etc. is not particularly limited. For example, if the analysis device 3, interpretation terminal 4, and image server 5 constitute a PACS, this information may be collectively stored and managed in an information management server on the PACS. Furthermore, it is not necessary to store all of the above information; for example, only the medical image and the "definitive diagnosis information" may be stored as a set.

[0061] The term "definitive diagnosis information" used here refers to a diagnosis determined by a doctor based on medical images and findings and analysis results obtained based on the images. The final diagnosis for a patient may be made by, for example, a clinician, taking into consideration the judgment of the doctor who created this "definitive diagnosis information," as well as test data and examination data obtained from various tests and examinations.

[0062] In contrast to the above, if the reliability of the AI ​​analysis results is extremely high and the AI ​​analysis can be fully trusted, the second QA pattern flow is adopted. FIG. 7 is a flowchart showing the analysis process in the second QA pattern. As shown in Figure 7, in the second QA pattern, first, the target medical information (medical image) is analyzed by AI in the control unit 31 of the analysis device 3, and the "first medical information" which is the analysis result (diagnosis result) is obtained (step S21). In this case, it is not necessary to obtain the "second medical information (in the primary reading)," which is the diagnosis result of the primary reading physician.

[0063] Then, the control unit 31 determines whether the "first medical information" determines that the medical image is normal (step S22). That is, the control unit 31 determines whether the "first medical information" includes any abnormal findings in the medical image. If the "first medical information" determines that the medical image is normal (step S22; YES), the "first medical information", which is the analysis result by the AI, is set as "definitive diagnosis information" (step S23).

[0064] In this case, the work of the radiologist can be reduced for images that the AI ​​judges to be normal, reducing the burden on the radiologist and enabling efficient image diagnosis. Furthermore, even if the "first medical information" judges the medical image to be normal, this does not immediately become "definitive diagnosis information." Instead, a "normal label" indicating that the medical image is normal and does not contain abnormal findings can be attached to the "first medical information," which is the result of analysis by AI, and the medical image to be judged and the "first medical information" can be sent to a secondary radiologist (or final radiologist), and the diagnosis result of the secondary radiologist can be considered "definitive diagnosis information." In this case, the burden on the radiologist can be reduced by assigning a "normal label" while still seeking a diagnosis from the secondary radiologist (final radiologist).

[0065] The second QA pattern can be applied not only to cases where the reliability of the AI ​​analysis results is complete, but also to cases where the scope of the reliability is limited. In other words, for example, when a single image needs to be interpreted from different perspectives, the diagnosis of a specific lesion can be left to AI analysis, and the "first medical information" that is the result of that analysis can be trusted, while for other lesions, the "first medical information" that is the result of AI analysis can be used in combination with the "second medical information" based on the diagnosis result of the radiologist. Specifically, when an X-ray image taken during a medical examination or other such procedure is expanded to capture the chest and abdomen (or the upper body in a longer format), the "first medical information," which is the result of analysis by AI, is trusted for chest diagnosis and used as the "definitive diagnosis information," but for the abdomen, the "first medical information," which is the result of analysis by AI, may be used in combination with the "second medical information," which is based on the diagnosis result of the radiologist. In particular, "medical information" is not limited to still images, but can also be dynamic images, in which case the number of diagnostic elements increases beyond that of still images. For this reason, even if the application is limited to separate responses by medical department or diagnostic subject, such as relying on the "first medical information" that is the analysis result by AI in principle when diagnosing the respiratory system, and using a combination of the "first medical information" that is the analysis result by AI and the "second medical information" based on the diagnosis result of the radiologist, it is possible to expect benefits such as more efficient diagnosis and a reduction in the burden on the radiologist.

[0066] On the other hand, if the "first medical information" does not determine that the medical image is normal (if abnormal findings are included, step S22; NO), the medical image to be judged and the "first medical information" are sent to a secondary image interpreter (or final image interpreter) for secondary interpretation (or final image interpreter) (step S24). Then, the diagnosis result of the secondary image interpreter is set as "definitive diagnosis information" (step S25). In this case, the control unit 31 as a comparison processing unit may also compare the "first medical information" that is the analysis result of the AI ​​with the "definitive diagnosis information" that is the diagnosis result of the secondary radiologist, and determine whether they match or not. When the matching results are output, the matching results are also stored in the image server 5 or the like together with the medical images and the "definitive diagnosis information." By linking and storing the matching results with the medical images and the "definitive diagnosis information," it becomes possible to refer to them later when a clinician makes a final diagnosis, etc.

[0067] 〔effect〕 As described above, the analysis device 3 of this embodiment includes the control unit 31 as an analysis unit that acquires ``first medical information'' obtained by computer processing of medical information (i.e., AI analysis), the control unit 31 as a generation unit that structures unstructured data acquired from information created by a user based on the medical information to generate structured data, the control unit 31 as an acquisition unit that acquires ``second medical information'' from the structured data, the control unit 31 as a comparison processing unit that compares the ``first medical information'' acquired by the control unit 31 with the ``second medical information,'' and an output unit (data output unit 34) that outputs next process information based on the comparison result. By comparing the interpretation physician's judgment with the AI ​​analysis results and showing the user the next steps based on the comparison results, efficient and effective diagnosis can be achieved. In particular, in the case of image diagnosis, the presence or absence of secondary interpretation is determined based on the comparison results with the AI ​​analysis results. This reduces the burden on the secondary interpretation physician and enables efficient image diagnosis.

[0068] If the process information output from the output unit (data output unit 34) is information on whether or not additional tests should be performed, the necessary tests can be presented to the user based on the results of matching the "first medical information" with the "second medical information." This allows the user to properly understand the necessary steps.

[0069] In addition, the process information output from the output unit (data output unit 34) can present to the user whether the "first medical information," which is the result of the AI's analysis, or the "second medical information," which is information based on the interpretation results by the radiologist, should be used as a definitive diagnosis or whether it should be sent to a secondary radiologist. This allows the user to recognize when the "first medical information" or the like is to be used as a definitive diagnosis, and avoids the hassle of having to send all image diagnoses to a secondary radiologist.

[0070] Furthermore, if the comparison results obtained by the control unit 31 as a comparison processing unit do not match the "first medical information" and the "second medical information", information requesting a diagnosis from a second user (e.g., a secondary radiologist) is output as process information. This allows the user to recognize when a case needs to be referred to a secondary interpretation, and avoids the hassle of having to refer all image diagnoses to a secondary interpretation physician.

[0071] In addition, the control unit 31 may function as a classification unit that classifies the ``second medical information'' into ``third medical information,'' and compares the ``first medical information'' with the ``third medical information.'' The content and expressions written in radiological reports vary widely depending on the user (radiologist), and may not necessarily correspond to the results of AI analysis. Even in such cases, it is possible to standardize the input fluctuations for each user, enabling accurate matching (comparison) with the AI ​​analysis results.

[0072] Furthermore, if a registration unit (correspondence registration unit 324) is provided that pre-registers the correspondence between "second medical information" and "third medical information," and the control unit 31, acting as a classification unit, classifies "second medical information" into "third medical information" based on the correspondence between "second medical information" and "third medical information" registered in the correspondence registration unit 324, classification can be performed that reflects the intention of the user who made the pre-registration.

[0073] Furthermore, if the correspondence between "second medical information" and "third medical information" is learned, and the control unit 31 as a classification unit classifies "second medical information" as "third medical information" based on the learned correspondence between "second medical information" and "third medical information," appropriate classification can be performed even if there is no prior registration.

[0074] In addition, the control unit 31 may function as a classification unit that classifies the "second medical information" into the "first medical information," and the "first medical information" may be compared with the "first medical information." The content and expressions written in radiological reports vary widely depending on the user (radiologist), and may not necessarily correspond to the results of AI analysis. Even in such cases, it is possible to standardize the input fluctuations for each user, enabling accurate matching (comparison) with the AI ​​analysis results.

[0075] Furthermore, if a registration unit (correspondence registration unit 324) is provided that pre-registers the correspondence between "second medical information" and "first medical information," and the control unit 31, acting as a classification unit, classifies "second medical information" into "first medical information" based on the correspondence between "second medical information" and "first medical information" registered in the correspondence registration unit 324, classification can be performed that reflects the intention of the user who made the pre-registration.

[0076] Furthermore, if the correspondence between "second medical information" and "first medical information" is learned, and the control unit 31 as a classification unit classifies "second medical information" into "first medical information" based on the learned correspondence between "second medical information" and "first medical information," appropriate classification can be performed even if there is no prior registration.

[0077] Furthermore, if there is no prior registration in the correspondence registration unit 324, the "second medical information" is classified as the "first medical information" based on the learned correspondence between the "second medical information" and the "first medical information," and appropriate classification can be performed even when there is no prior registration while reflecting the user's intentions.

[0078] In addition, a similarity calculation unit may be provided that calculates the similarity between the "second medical information" and the "first medical information." In this case, the correspondence between the "first medical information" and the "second medical information" is learned based on the similarity. This allows the correspondence between the "second medical information" and the "first medical information" to be properly learned.

[0079] Furthermore, if the "second medical information" is unknown lesion information, the control unit 31 may act as a lesion information classifier to classify the "second medical information" as "first medical information" and present the classification result to the user for approval. In this case, if the classification result is approved, the unknown lesion information is learned as predetermined lesion information according to the classification result and registered in the registration unit (association registration unit 324). As a result, from the next time onwards, classification can be performed using the information registered in the correspondence registration unit 324, enabling efficient and appropriate classification.

[0080] In addition, when a user (such as a radiologist) assigns a region of interest (ROI) to a medical image, and location information, etc., is automatically added as additional information on the radiology terminal 4, etc., the medical image is acquired by the analysis device 3 with structured data attached. According to this embodiment, data attached in such a structured form is also included in the "second medical information" to be compared with the "first medical information," and can be appropriately used as the subject of comparison.

[0081] [Modification] Although the embodiment of the present invention has been described above, it goes without saying that the present invention is not limited to such an embodiment, and various modifications are possible without departing from the spirit of the present invention.

[0082] For example, in the above embodiment, the medical information to be analyzed by the analysis device 3 is a medical image, but the medical information is not limited to a medical "image." Information obtained through various tests on patients may be broadly included in medical information, and for example, results obtained from various tests, such as electrocardiogram waveform data, heart sound data, and data related to blood flow, may also be included in medical information.

[0083] In this embodiment, in FIG. 1, the analysis device 3, the interpretation terminal 4, and the image server 5 are illustrated as separate and independent devices, but the analysis device 3 and the image server 5, or the analysis device 3, the interpretation terminal 4, and the image server 5 may be configured as a single device or a single system.

[0084] It goes without saying that the present invention is not limited to the above-described embodiments and modifications, and can be modified as appropriate without departing from the spirit of the present invention. [Explanation of symbols]

[0085] 1. Modality 2 Console 3 Analysis device 4. Image reading terminal 5. Image Server 31 Control Unit 32 Storage section 33 Data Acquisition Section 36 Display section 100 Medical Imaging Systems

Claims

1. an analysis unit that acquires first medical information obtained by computer processing of the medical information; a generation unit that generates structured data by structuring unstructured data acquired from information created by a user based on the medical information; an acquisition unit that acquires second medical information from the structured data; a comparison processing unit that compares the first medical information acquired by the analysis unit with the second medical information acquired by the acquisition unit; an output unit that outputs next process information indicating what action should be taken next based on the comparison result obtained by the comparison processing unit; An analysis device comprising:

2. The analysis device according to claim 1 , wherein the output unit outputs, as the process information, information on whether or not an additional test is to be performed.

3. 3. The analysis device according to claim 1, wherein the output unit outputs, as the process information, information indicating whether the first medical information or the second medical information is to be a definitive diagnosis.

4. 4. The analysis device according to claim 1, wherein when the comparison result obtained by the comparison processing unit does not match between the first medical information and the second medical information, the output unit outputs, as the process information, information requesting a diagnosis from a second user.

5. a classification unit that classifies the second medical information acquired by the acquisition unit into third medical information; 4. The analysis device according to claim 1, further comprising: a comparison processing unit that compares the first medical information acquired by the analysis unit with the third medical information classified by the classification unit.

6. a registration unit that registers in advance the correspondence between the second medical information and the third medical information; The analysis device according to claim 5, wherein the classification unit classifies the second medical information acquired by the acquisition unit into the third medical information based on the correspondence between the second medical information and the third medical information registered by the registration unit.

7. a learning unit that learns a correspondence between the second medical information and the third medical information; The analysis device according to claim 5, wherein the classification unit classifies the second medical information acquired by the acquisition unit into the third medical information based on the correspondence between the second medical information and the third medical information learned by the learning unit.

8. a classification unit that classifies a plurality of expressions for specific information used in the second medical information acquired by the acquisition unit into a single expression for the specific information used in the first medical information; 4. The analysis device according to claim 1, further comprising: a comparison processing unit that compares the first medical information acquired by the analysis unit with the second medical information classified by the classification unit.

9. a registration unit that registers in advance the correspondence between the first medical information and the second medical information; The analysis device according to claim 8 , wherein the classification unit classifies the second medical information acquired by the acquisition unit into the first medical information based on the correspondence between the first medical information and the second medical information registered by the registration unit.

10. a learning unit that learns a correspondence between the first medical information and the second medical information; The analysis device according to claim 8 , wherein the classification unit classifies the second medical information acquired by the acquisition unit into the first medical information based on the correspondence between the first medical information and the second medical information learned by the learning unit.

11. a learning unit that learns a correspondence between the first medical information and the second medical information; When the correspondence between the first medical information and the second medical information is not registered in the registration unit, the classification unit: The analysis device according to claim 9, wherein the second medical information acquired by the acquisition unit is classified into the first medical information based on the correspondence between the first medical information and the second medical information learned by the learning unit.

12. a pre-trained similarity calculation unit that calculates a similarity between the second medical information and the first medical information acquired by the acquisition unit; The analysis device according to claim 11 , wherein the learning unit learns the correspondence between the first medical information and the second medical information based on the similarity.

13. a lesion information classifying unit that classifies the second medical information acquired by the acquiring unit into the first medical information when the second medical information acquired by the acquiring unit is unknown lesion information; a classification result presentation unit that presents the classification result by the lesion information classification unit to a user and requests approval; Equipped with The analysis device according to claim 12 , wherein the learning unit, when the classification result is approved, learns the unknown lesion information as predetermined lesion information according to the classification result and registers the information in the registration unit.

14. The analysis device according to claim 1 , wherein the generation unit generates the structured data by structuring lesion information based on the acquired unstructured data.

15. an analysis unit that acquires first medical information obtained by computer processing of the medical information; an acquisition unit that acquires second medical information from structured data that is based on the medical information; a comparison processing unit that compares the first medical information acquired by the analysis unit with the second medical information acquired by the acquisition unit; an output unit that outputs next process information indicating what action should be taken next based on the comparison result obtained by the comparison processing unit; An analysis device comprising:

16. The analysis device according to claim 15 , wherein the output unit outputs, as the process information, information on whether or not an additional test is to be performed.

17. A computer-implemented analysis method comprising: an analyzing step of acquiring first medical information obtained by computer processing of the medical information; a generating step of structuring unstructured data obtained from information created by a user based on the medical information to generate structured data; an acquiring step of acquiring second medical information from the structured data; a comparison process step of comparing the first medical information acquired in the analysis step with the second medical information acquired in the acquisition step; an output step of outputting next process information indicating what action should be taken next based on the comparison result obtained in the comparison processing step; Analysis methods including.

18. The analysis method according to claim 17 , wherein the output step outputs information indicating whether or not an additional test is to be performed as the process information.

19. On the computer, an analysis function for acquiring first medical information obtained by computer processing of the medical information; a generation function for structuring unstructured data obtained from information created by a user based on the medical information to generate structured data; an acquisition function for acquiring second medical information from the structured data; a comparison processing function that compares the first medical information acquired by the analysis function with the second medical information acquired by the acquisition function; an output function for outputting next process information indicating what action should be taken next based on the comparison result obtained by the comparison processing function; A program to make this happen.

20. 20. The program according to claim 19, wherein the output function outputs information on whether or not an additional inspection is to be performed as the process information.

Images