Information processing device, method and program

The information processing device facilitates comparison and identification of differences in medical documents by identifying and displaying corresponding descriptions differently, addressing the limitations of existing methods in comparing current and past reports.

JP2024162560APending Publication Date: 2024-11-21FUJIFILM CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023078181
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-10
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

Existing methods, such as those described in Patent Document 1, fail to facilitate a comparison between current and past medical image interpretation reports.

Method used

An information processing device that acquires multiple medical documents created at different times, identifies corresponding descriptions, and displays them differently to enable easy comparison, including highlighting and distinguishing between descriptions and related medical images.

Benefits of technology

Enables easy comparison and identification of differences in medical documents like image interpretation reports created at different times, enhancing the efficiency of medical document review processes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024162560000001_ABST
    Figure 2024162560000001_ABST
Patent Text Reader

Abstract

To enable an information processing device, method and program to easily compare medical documents such as interpretation reports having different creation times.SOLUTION: A processor is configured to: acquire a plurality of medical documents having different creation times; identify mutually corresponding descriptions in each of one medical document among the plurality of medical documents and at least one other medical document other than the one medical document; display the one medical document on a display; receive designation of a character string for the one medical document; and display a description of the at least one other medical document which corresponds to a description including the designated character string in a manner different from other descriptions other than the description corresponding to the description including the designated character string.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, a method, and a program. [Background technology]

[0002] In recent years, advances in medical equipment such as CT (Computed Tomography) and MRI (Magnetic Resonance Imaging) devices have made it possible to perform image diagnosis using higher quality, higher resolution medical images. In particular, when performing image diagnosis using CT images and MRI images, a diagnostic report is created that includes the results of interpreting the images. Various methods have been proposed to support the creation of medical documents such as diagnostic reports.

[0003] For example, Patent Document 1 proposes a method of acquiring the most recent current medical image of a patient and a past image interpretation report of the same patient, identifying characters contained in the image interpretation report that correspond to a specified position in the displayed current medical image, and displaying the identified characters in an emphasized manner. According to the method described in Patent Document 1, a user can easily refer to descriptions in past image interpretation reports related to the current medical image, and therefore can easily create an image interpretation report for the current medical image. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-153249 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, the technique described in Patent Document 1 cannot compare a current radiology report created for a current medical image with a past radiology report.

[0006] The present disclosure has been made in consideration of the above circumstances, and has an object to make it possible to easily compare medical documents, such as radiology reports, created at different times. [Means for solving the problem]

[0007] The information processing device according to the present disclosure includes at least one processor, the processor acquiring a plurality of medical documents created at different times, Identifying corresponding descriptions in one medical document among the plurality of medical documents and at least one other medical document other than the one medical document; Displaying one medical document on a display; Accepting a character string specification for one medical document; A description of at least one other medical document corresponding to a description including the specified character string is displayed differently from other descriptions other than the description corresponding to the description including the specified character string.

[0008] In addition, in the information processing device according to the present disclosure, the processor may classify descriptions included in each of the multiple medical documents by lesion, and identify corresponding descriptions for each lesion.

[0009] In addition, in the information processing device according to the present disclosure, the processor further identifies differences between corresponding descriptions included in each of the plurality of medical documents; In at least one other medical document, the difference may be displayed instead of or in addition to a description corresponding to the description including the specified character string, in a manner that differs from a description other than the difference.

[0010] In addition, in the information processing device according to the present disclosure, the medical document includes a medical image corresponding to the medical document, The processor may be adapted to display at least a sub-region in the medical image associated with the differently displayed description differently from other regions other than the sub-region.

[0011] Furthermore, in the information processing device according to the present disclosure, the processor may display character strings related to corresponding descriptions in a single medical document in a manner different from other character strings that are not related character strings.

[0012] Furthermore, in the information processing device according to the present disclosure, the processor may display a description including a character string in a medical document in a manner different from other descriptions other than the description including the character string.

[0013] In addition, in the information processing device according to the present disclosure, the one medical document may be a medical document currently being created.

[0014] In addition, in the information processing device according to the present disclosure, the multiple medical documents may include at least some medical documents acquired by different modalities.

[0015] In addition, in an information processing device according to the present disclosure, when displaying a plurality of other medical documents, the processor may display the descriptions of other medical documents in a manner that gives priority to those documents that were created closer to a given medical document in date of creation.

[0016] The information processing method according to the present disclosure includes: acquiring a plurality of medical documents created at different times by a computer; Identifying corresponding descriptions in one medical document among the plurality of medical documents and at least one other medical document other than the one medical document; Displaying one medical document on a display; Accepting a character string specification for one medical document; A description of at least one other medical document corresponding to a description including the specified character string is displayed differently from other descriptions other than the description corresponding to the description including the specified character string.

[0017] The information processing program according to the present disclosure includes a procedure for acquiring a plurality of medical documents created at different times; A step of identifying corresponding descriptions in one medical document among the plurality of medical documents and at least one other medical document other than the one medical document; displaying a medical document on a display; receiving a character string specification for one medical document; and displaying a description of at least one other medical document corresponding to the description including the specified character string in a manner different from other descriptions other than the description corresponding to the description including the specified character string. Effect of the Invention

[0018] According to the present disclosure, it is possible to easily compare medical documents such as radiology reports created at different times. [Brief description of the drawings]

[0019] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of a medical information system to which an information processing device according to a first embodiment of the present disclosure is applied; [Diagram 2] FIG. 1 is a diagram showing a schematic configuration of an information processing apparatus according to a first embodiment; [Diagram 3] Functional configuration diagram of an information processing device according to a first embodiment [Figure 4] FIG. 1 is a diagram for explaining specification of a description in the first embodiment. [Diagram 5] FIG. 13 is a diagram showing a display screen of an image interpretation report in the first embodiment. [Figure 6] FIG. 13 is a diagram showing a display screen of an interpretation report in the first embodiment. [Figure 7] 1 is a flowchart showing the processing performed in the first embodiment. [Figure 8] FIG. 11 is a diagram showing another example of the display screen of the image interpretation report in the first embodiment. [Figure 9] FIG. 13 is a diagram showing a screen for creating an interpretation report in the second embodiment. [Figure 10] FIG. 13 is a diagram showing a display screen of an image interpretation report in the third embodiment. [Figure 11]FIG. 13 is a diagram for explaining the description and specification of differences in the fourth embodiment. [Figure 12] FIG. 13 is a diagram showing a display screen of an interpretation report in the fourth embodiment. [Figure 13] FIG. 13 is a diagram showing another example of the display screen of the image interpretation report in the fourth embodiment. [Figure 14] Diagram showing the display screen for multiple image interpretation reports [Figure 15] FIG. 13 is a diagram showing another example of a display screen for multiple image interpretation reports. [Figure 16] FIG. 11 is a diagram showing another example of the display screen of the image interpretation report in the first embodiment. [Figure 17] FIG. 11 is a diagram showing another example of the display screen of the image interpretation report in the first embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. First, a configuration of a medical information system 1 to which an information processing device according to the present embodiment is applied will be described. FIG. 1 is a diagram showing a schematic configuration of the medical information system 1. The medical information system 1 shown in FIG. 1 is a system for performing, based on an examination order from a doctor of a medical department using a known ordering system, imaging of a subject's examination target part, storage of medical images acquired by imaging, interpretation of the medical images by a radiology doctor and creation of an interpretation report, and viewing of the interpretation report by a doctor of the requesting medical department and detailed observation of the medical image to be interpreted.

[0021] As shown in Figure 1, the medical information system 1 is composed of multiple imaging devices 2, multiple reading WSs (Work Stations) 3 which are reading terminals, a medical treatment WS 4, an image server 5, an image database (hereinafter referred to as image DB (DataBase)) 6, a report server 7 and a report database (hereinafter referred to as report DB) 8, all of which are connected in a state capable of communicating with each other via a wired or wireless network 10.

[0022] Each device is a computer installed with an application program for functioning as a component of the medical information system 1. The application program is recorded on a recording medium such as a DVD (Digital Versatile Disc) or a CD-ROM (Compact Disc Read Only Memory) and distributed, and is installed on the computer from the recording medium. Alternatively, the application program is stored in a storage device of a server computer connected to the network 10 or in a network storage in a state accessible from the outside, and is downloaded to the computer upon request and installed.

[0023] The imaging device 2 is a device (modality) that generates a medical image representing a diagnostic target part of a subject by imaging the diagnostic target part. Specifically, it is a plain X-ray device, a CT device, an MRI device, a PET (Positron Emission Tomography) device, etc. The medical image generated by the imaging device 2 is transmitted to the image server 5 and stored in the image DB 6.

[0024] The image interpretation WS3 is a computer used by, for example, a radiologist to interpret medical images and prepare image interpretation reports, and includes the information processing device 20 according to this embodiment. The image interpretation WS3 performs a request to view a medical image to the image server 5, various image processing for the medical image received from the image server 5, displays the medical image, and accepts input of a comment on the medical image. The image interpretation WS3 also performs an analysis process for the medical image and the input comment, supports the creation of an image interpretation report based on the analysis result, requests the report server 7 to register and view the image interpretation report, and displays the image interpretation report received from the report server 7. These processes are performed by the image interpretation WS3 executing a software program for each process.

[0025] The medical treatment WS4 is a computer used by doctors in the medical department for detailed observation of images, viewing of interpretation reports, creation of electronic medical records, etc., and includes the information processing device 20 according to this embodiment. The medical treatment WS4 requests the image server 5 to view images, displays images received from the image server 5, requests the report server 7 to view interpretation reports, and displays interpretation reports received from the report server 7. These processes are performed by the medical treatment WS4 executing software programs for each process.

[0026] The image server 5 is a general-purpose computer in which a software program that provides the functions of a database management system (DBMS) is installed. The image server 5 also includes a storage in which the image DB 6 is configured. This storage may be a hard disk device connected to the image server 5 via a data bus, or a disk device connected to a NAS (Network Attached Storage) and a SAN (Storage Area Network) connected to the network 10. When the image server 5 receives a request to register a medical image from the imaging device 2, the image server 5 formats the medical image for a database and registers it in the image DB 6. In this embodiment, it is assumed that a diagnostic guideline corresponding to a disease is also stored in the image server 5, but this is not limited thereto.

[0027] The image DB 6 registers image data and supplementary information of medical images acquired by the imaging device 2. The supplementary information includes, for example, an image ID (identification) for identifying each medical image, a patient ID for identifying the subject, an examination ID for identifying the examination, a unique ID (UID: unique identification) assigned to each medical image, the examination date and time when the medical image was generated, the type of imaging device used in the examination to acquire the medical image, patient information such as the patient's name, age, and sex, the examination site (imaging site), imaging information (imaging protocol, imaging sequence, imaging method, imaging conditions, use of contrast agent, etc.), and a series number or collection number when multiple medical images are acquired in one examination.

[0028] In addition, when the image server 5 receives a viewing request from the image interpretation WS3 and medical treatment WS4 via the network 10, it searches for medical images registered in the image DB6 and transmits the searched medical images to the image interpretation WS3 and medical treatment WS4 that originated the request.

[0029] A software program that provides a general-purpose computer with the functions of a database management system is installed in the report server 7. When the report server 7 receives a request to register an interpretation report from the interpretation WS 3, the report server 7 converts the interpretation report into a database format and registers it in the report DB 8.

[0030] The report DB 8 registers an interpretation report including at least a finding statement created by an image interpretation doctor using the image interpretation WS 3. The image interpretation report may include information such as a medical image to be interpreted, an image ID for identifying the medical image, an image interpretation doctor ID for identifying the image interpretation doctor who performed the image interpretation, a lesion name, position information of the lesion, information for accessing a medical image including a specific region, and property information.

[0031] In addition, when the report server 7 receives a request to view an interpretation report from the interpretation WS3 and the medical treatment WS4 via the network 10, it searches for the interpretation report registered in the report DB8 and transmits the searched interpretation report to the interpretation WS3 and the medical treatment WS4 that originated the request.

[0032] In this embodiment, the medical image is a three-dimensional CT image consisting of multiple cross-sectional images of the lungs as a diagnostic target, and an interpretation report on abnormal shadows in the lungs is created by interpreting the CT image in the interpretation WS 3. The medical image is not limited to a CT image, and any medical image such as an MRI image or a simple two-dimensional image obtained by a simple X-ray imaging device can be used.

[0033] The network 10 is a wired or wireless local area network that connects various devices in the hospital. If the image interpretation WS3 is installed in other hospitals or clinics, the network 10 may be configured to connect the local area networks of the hospitals via the Internet or a dedicated line.

[0034] Next, an information processing device according to a first embodiment of the present disclosure will be described. FIG. 2 describes a hardware configuration of the information processing device according to the first embodiment. As shown in FIG. 2, the information processing device 20 includes a CPU (Central Processing Unit) 11, a non-volatile storage 13, and a memory 16 as a temporary storage area. The information processing device 20 also includes a display 14 such as a liquid crystal display, an input device 15 such as a keyboard and a mouse, and a network I / F (InterFace) 17 connected to a network 10. The CPU 11, the storage 13, the display 14, the input device 15, the memory 16, and the network I / F 17 are connected to a bus 18. The CPU 11 is an example of a processor in the present disclosure.

[0035] The storage 13 is realized by a hard disk drive (HDD), a solid state drive (SSD), a flash memory, etc. The storage 13 as a storage medium stores an information processing program 12. The CPU 11 reads the information processing program from the storage 13, loads it into the memory 16, and executes the loaded information processing program 12.

[0036] Next, the functional configuration of the information processing device according to the first embodiment will be described. FIG. 3 is a diagram showing the functional configuration of the information processing device according to the first embodiment. As shown in FIG. 3, the information processing device 20 according to the first embodiment includes an acquisition unit 21, a description identification unit 22, and a display control unit 23. Then, the CPU 11 executes an information processing program, so that the CPU 11 functions as the acquisition unit 21, the description identification unit 22, and the display control unit 23. Note that, hereinafter, an information processing device included in the medical treatment WS4 will be described, but is not limited thereto.

[0037] The acquisition unit 21 acquires an image reading report for a patient to be examined from the report DB8 in response to an instruction from a user such as a doctor via the input device 15. The image reading report is an example of a medical document in the present disclosure. Here, the image reading reports to be acquired are a current image reading report R1 for which a diagnosis is to be made and at least one past image reading report Rpi (i=1 to n) created prior to the current image reading report. The image reading reports R1 and Rpi acquired by the acquisition unit 21 are stored in the storage 13. The acquisition unit 21 may acquire, from the image DB6, medical images used to create the current image reading report R1 for the patient.

[0038] The description identifying unit 22 identifies corresponding descriptions included in the image interpretation reports R1 and Rpi by analyzing the image interpretation reports R1 and Rpi acquired by the acquiring unit 21. Specifically, the description identifying unit 22 classifies sentences included in the image interpretation reports R1 and Rpi into sentences for each lesion by analyzing the image interpretation reports R1 and Rpi using a natural language processing technique. The description identifying unit 22 may also identify character strings representing the lesions included in the sentences for each lesion as keywords.

[0039] Natural language processing is a set of technologies that allow computers to process the natural language that humans use on a daily basis. Natural language processing can split sentences into words, analyze syntax, and analyze meaning.

[0040] FIG. 4 is a diagram for explaining the specification of the description. For the sake of explanation, it is assumed that there is only one past radiology report. As shown in FIG. 4, the current radiology report R1 states, "There is a 35 mm nodule in S3b of the right lung. It has grown slightly since the previous report. There is no significant change in the small nodules around this. There is also no significant change in the ground-glass opacity in S6 of the left lung. There is a small nodule at the bottom of the left lung." The past radiology report Rp1 states, "There is a 30 mm solid nodule in S3 of the right lung. It is lobulated and partially accompanied by spicules, which suggests lung cancer. Small nodules are found around this, which are thought to be metastases. Ground-glass opacity is found in S6 of the left lung. There is no significant change from the previous report."

[0041] The description identification unit 22 identifies descriptions related to lesions included in the text of the image interpretation reports R1 and Rpi. In this embodiment, the description identification unit 22 identifies descriptions of lesions by natural language processing. Then, the text described in the image interpretation reports R1 and Rpi is structured by classifying the text according to the identified lesion.

[0042] For example, the description identification unit 22 structures the current interpretation report R1 shown in Figure 4 into four sentences 30 to 33, which are a sentence regarding a nodule, "There is a 35 mm nodule in S3b of the right lung. It has grown slightly since the previous time." (sentence 30), a sentence regarding a small nodule, "There is no significant change in the surrounding small nodules." (sentence 31), a sentence regarding a ground-glass opacity, "There is also no significant change in the ground-glass opacity in S6 of the left lung." (sentence 32), and a sentence regarding a micronodule, "A micronodule was found at the base of the left lung." (sentence 33).

[0043] In addition, the description identification unit 22 structures the past radiology report Rp1 into three sentences 40 to 42: a sentence about a nodule, "A 30 mm solid nodule is found in S3 of the right lung. It is lobulated and has some spicules, suggesting lung cancer" (sentence 40), a sentence about a small nodule, "Small nodules are found around this, which is thought to be metastasis" (sentence 41), and a sentence about ground-glass opacity, "Ground-glass opacity is found in S6 of the left lung. No significant change from the previous time" (sentence 42).

[0044] The description identifying unit 22 identifies corresponding descriptions included in the current interpretation report R1 and the past interpretation report Rpi by associating the descriptions about the same lesion with each other for the four descriptions 30-33 obtained by structuring the current interpretation report R1 and the three descriptions 40-42 obtained by structuring the past interpretation report Rpi. As a result, the description 30 about the nodule in the current interpretation report R1 and the description 40 about the nodule in the past interpretation report Rpi are identified as corresponding descriptions. In addition, the description 31 about the nodule in the current interpretation report R1 and the description 41 about the nodule in the past interpretation report Rpi are identified as corresponding descriptions. In addition, the description 32 about the ground-glass shadow in the current interpretation report R1 and the description 42 about the ground-glass shadow in the past interpretation report Rpi are identified as corresponding descriptions.

[0045] The display control unit 23 displays the current interpretation report R1 and the past interpretation report Rpi acquired by the acquisition unit 21 on the display 14. FIG. 5 is a diagram showing a display screen of the interpretation report. As shown in FIG. 5, the current interpretation report R1 and the past interpretation report Rp1 are displayed on the display screen 50 of the interpretation report. The creation date and time of the current interpretation report R1 is February 28, 2023, and the creation date and time of the past interpretation report Rp1 is March 3, 2022. In addition, each of the current interpretation report R1 and the past interpretation report Rp1 includes the medical images G1 and Gp1 from which the interpretation report was created.

[0046] The user can select a character string in the description of the current image reading report R1 by moving the cursor using the input device 15. For example, as shown in FIG. 6, assume that the user selects "nodule" described in the current image reading report R1. In FIG. 6, the selection of "nodule" is represented by enclosing it in a rectangle. The display control unit 23 displays the sentence 41, which corresponds to the sentence 31 in which "nodule" is described in the current image reading report R1, in the past image reading report Rp1, in a manner different from other sentences other than the sentence 41. Specifically, the sentence 41 is highlighted. The highlighting can be performed by any method, such as adding a color to the background of the sentence 41, adding an underline, changing the character color, or changing the font. The sentence 41 may also be displayed differently from other sentences other than the sentence 41 by lightening the color of the characters of the sentences other than the sentence 41 or filling the sentences other than the sentence 41 in black. In FIG. 6, the sentence 41 is highlighted by enclosing it in a rectangle. When "nodule" written in the current image interpretation report R1 is specified, a sentence 40 in the past image interpretation report Rp1 is highlighted. When "ground glass opacity" written in the current image interpretation report R1 is specified, a sentence 42 in the past image interpretation report Rp1 is highlighted.

[0047] Next, the process performed in the first embodiment will be described. FIG. 7 is a flowchart showing the process performed in the first embodiment. First, the acquisition unit 21 acquires a plurality of medical documents created at different times, i.e., the current interpretation report R1 and the past interpretation reports Rpi, from the report DB 8 (step ST1). Next, the description identification unit 22 identifies corresponding descriptions included in the current interpretation report R1 and the past interpretation report Rpi (step ST2). Then, the display control unit 23 displays the current interpretation report R1 and the past interpretation report Rpi on the display 14 (step ST3).

[0048] Next, monitoring is started as to whether or not a character string has been specified in the current radiology report R1 (step ST4), and if step ST4 is positive, the display control unit 23 displays the text of the description corresponding to the description containing the specified character string in a manner different from other descriptions other than the description corresponding to the description containing the specified character string, i.e., highlights it (step ST5), and returns to step ST4.

[0049] In this way, in the first embodiment, the specification of a character string for the current radiology report R1 is accepted, and the description of the past radiology report Rpi corresponding to the description including the specified character string is displayed differently from other descriptions other than the description corresponding to the description including the specified character string. Therefore, it is easy to compare medical documents such as radiology reports created at different times.

[0050] In the first embodiment, in the medical image Gp1 included in the past image interpretation report Rpi, a partial region including at least a lesion included in a sentence displayed differently may be displayed differently from other regions other than the partial region. Specifically, the partial region may be highlighted. Also, a partial region including at least a lesion corresponding to a selected character string included in the current image interpretation report R1 may be highlighted. For example, as shown in FIG. 8, the partial region including the lesion may be highlighted by surrounding the lesion with a marker 60 in the medical image Gp1 included in the past image interpretation report Rpi. Furthermore, the partial region including the lesion may be highlighted by surrounding the lesion with a marker 61 in the medical image G1 included in the current image interpretation report R1. Note that an arrow or the like may be added instead of the rectangular markers 60 and 61.

[0051] In the first embodiment, the description identifying unit 22 may identify a character string representing a lesion included in the structured sentences 30 to 33 in the current radiology report R1, and may provide a link to the identified character string in a sentence including a corresponding description in the past radiology report Rpi. In this way, when the user clicks a character string representing a lesion included in the current radiology report R1 using the input device 15, the display control unit 23 can display the sentence linked to the clicked character string in the past radiology report Rpi differently from other sentences other than the linked sentence.

[0052] In the first embodiment, the current image interpretation report R1 and the past image interpretation report Rpi are acquired at the same time, but the present invention is not limited to this. The information processing device 20 according to the present embodiment can be applied to the image interpretation WS3, and the image interpretation report for a medical image can be created while referring to the display of the past image interpretation report Rpi in the image interpretation WS3. This will be described below as the second embodiment.

[0053] 9 is a diagram showing an image interpretation report creation screen displayed on the image interpretation WS3 in the second embodiment. As shown in FIG. 9, the image interpretation report creation screen 50A displays a medical image G1 to be interpreted above a past image interpretation report Rp1, and displays a report area 52 to the right of the image interpretation report. The image interpretation doctor of the image interpretation WS3 interprets the medical image G1 and writes an image interpretation report in the report area 52.

[0054] In the second embodiment, each time the conversion of a sentence entered in the report area 52 into Japanese is confirmed, the description identification unit 22 analyzes the interpretation report currently being created and the past interpretation reports Rpi that have been entered in the report area 52 up to that point, and identifies the corresponding descriptions contained in each of the interpretation report R0 currently being created and the past interpretation reports Rpi, as in the first embodiment.

[0055] Here, as shown in FIG. 9, when the conversion of the first sentence "There is a 35 mm nodule in the right lung S3b" is confirmed, and when the second sentence "It has grown slightly larger than the previous time" is confirmed, the description identification unit 22 identifies the corresponding description included in each of the image interpretation report R0 currently being created and the past image interpretation report Rp1. When the first sentence "There is a 35 mm nodule in the right lung S3b" is confirmed and the corresponding description is identified, the display control unit 23 displays the sentence 40 (see FIG. 3) in the past image interpretation report Rpi in a manner different from other sentences other than the sentence 40, that is, highlights it. Also, when the second sentence "It has grown slightly larger than the previous time" is confirmed and the corresponding description is identified, the sentence 40 in the past image interpretation report Rpi continues to be highlighted. Furthermore, as shown in FIG. 9, it is assumed that the conversion is confirmed with "The nodules around this are." In this case as well, the description identifying unit 22 identifies the corresponding description in the past radiology report Rp1, and the display control unit 23 highlights the sentence 41 in the past radiology report Rpi, as shown in FIG.

[0056] In this way, in the second embodiment, the description of the past image interpretation report Rpi corresponding to the description of the image interpretation report R0 being created is displayed differently from other descriptions. Therefore, when creating an image interpretation report, it is easy to refer to medical documents such as past image interpretation reports.

[0057] In the first and second embodiments, the medical image is a CT image, but the present invention is not limited to this. A current medical image reading report R1 and a past medical image reading report Rpi for medical images acquired by different modalities may be used. This will be described below as a third embodiment.

[0058] FIG. 10 is a diagram showing a display screen of an interpretation report in the third embodiment. As shown in FIG. 10, a current interpretation report R1 and a past interpretation report Rp1 are displayed on the display screen 50B of the interpretation report. The creation date and time of the current interpretation report R1 is February 28, 2023, and the creation date and time of the past interpretation report Rp1 is March 3, 2022. In addition, each of the current interpretation report R1 and the past interpretation report Rp1 includes medical images G1 and Gp1 from which the interpretation report was created. Note that the medical image G1 is a CT image, and the medical image Gp1 is an X-ray image.

[0059] The current image interpretation report R1 has the same contents as those in the first embodiment. The past image interpretation report Rp1 has the following description: "There is a mass shadow in the upper right lung field. It was not detected in the previous examination. Further examination is required." These three sentences are referred to as sentences 45 to 47, respectively.

[0060] In the third embodiment, the description identifying unit 22 structures the sentences included in the current interpretation report R1 and the past interpretation report Rpi. Then, the description identifying unit 22 identifies corresponding descriptions by associating sentences about the same lesion with each other for the four sentences 30-33 structured for the current interpretation report R1 and the three sentences 45-47 structured for the past interpretation report Rpi. In the third embodiment, of the three sentences 45-47 included in the past interpretation report Rpi, only sentence 45 includes a description about a lesion. Sentence 45 includes a description about the right lung, and sentence 30 in the current interpretation report R1 includes a description about the right lung. Therefore, the description identifying unit 22 identifies sentence 30 in the current interpretation report R1 and sentence 45 in the past interpretation report Rpi as corresponding descriptions.

[0061] In the third embodiment, it is assumed that "nodule" is selected in the current interpretation report R1 as shown in Fig. 10. The display control unit 23 displays, in the past interpretation report Rp, a sentence 45 including a description corresponding to "nodule" in the current interpretation report R1, differently from other sentences other than sentence 45, that is, highlights it. Note that in the third embodiment, if a character string included in sentences 31 to 33 in the current interpretation report R1 is selected, there is no corresponding description in the past interpretation report Rp1, so it is not highlighted.

[0062] Thus, in the third embodiment, even when displaying an interpretation report for a medical image acquired by a different modality, the description corresponding to the character string selected in the current interpretation report R1 can be displayed differently from other descriptions in the past interpretation report Rpi.

[0063] Next, a fourth embodiment of the present disclosure will be described. In the first to third embodiments, the description identifying unit 22 identifies corresponding descriptions included in each of the radiology reports R1 and Rpi. The fourth embodiment differs from the first to third embodiments in that the description identifying unit 22 further identifies the difference between the corresponding descriptions.

[0064] FIG. 11 is a diagram for explaining the identification of the difference. The descriptions in the current interpretation report R1 and the past interpretation report Rp1 shown in FIG. 11 are the same as those in the first embodiment. In the fourth embodiment, the identification of corresponding descriptions included in each of the interpretation reports R1 and Rp1 is performed in the same manner as in the first embodiment, so a detailed description will be omitted here. In the fourth embodiment, the description identification unit 22 compares descriptions between sentences whose descriptions correspond to each other.

[0065] For example, sentence 30 of the current image interpretation report R1 corresponds to sentence 40 of the past image interpretation report Rp1. The description identification unit 22 compares sentence 30, "There is a 35 mm nodule in the right lung S3b. It has grown slightly since the previous time," with sentence 40, "There is a 30 mm solid nodule in the right lung S3. It is lobulated and partially includes spicules, and lung cancer is suspected," and identifies the description in sentence 40 of the past image interpretation report Rpi that differs from sentence 30 of the current image interpretation report R1, thereby identifying the difference.

[0066] In the fourth embodiment, the description identifying unit 22 identifies differences in descriptions related to, for example, the nature, size, and location of a lesion. Therefore, for the sentence 30 of the current image interpretation report R1, the description identifying unit 22 identifies "right lung S3b" and "slightly enlarged" as differences. Also, for the sentence 40 of the past image interpretation report Rpi, the description identifying unit 22 identifies "right lung S3", "30 mm", "solid type", "lobulated", "partial", "spicule", and "lung cancer" as differences.

[0067] FIG. 12 is a diagram showing a display screen of an interpretation report in the fourth embodiment. In the fourth embodiment, when a user selects a character string included in the description of the current interpretation report R1 on the display screen 50C of the interpretation report, the display control unit 23 displays, that is, highlights, the difference of the description corresponding to the selected character string in the past interpretation report Rpi, differently from the description other than the difference. For example, as shown in FIG. 12, it is assumed that the user selects "nodule" described in the current interpretation report R1. The display control unit 23 highlights the difference identified by the description identification unit 22 in the sentence 40 of the past interpretation report Rp1, which corresponds to the sentence 30 in which "nodule" is described in the current interpretation report R1. As shown in FIG. 12, in the sentence 40, "right lung S3", "30 mm", "solid type", "lobulated", "part", "spicula", and "lung cancer" are highlighted. In FIG. 12, the difference is highlighted by surrounding it with a rectangle, but this is not limited to this.

[0068] As shown in Fig. 13, sentence 40, which corresponds to sentence 30, may be emphasized, and the differences may also be emphasized. In Fig. 13, sentence 40 is emphasized by underlining it, and the differences are emphasized by enclosing them in a rectangle, but this is not limiting.

[0069] In this manner, in the fourth embodiment, the specification of a character string for the current image interpretation report R1 is accepted, the difference in the description of the past image interpretation report Rpi corresponding to the description including the specified character string is identified, and the difference is displayed differently from descriptions other than the difference. Therefore, when comparing the current image interpretation report R1 and the past image interpretation report Rpi, the difference in the corresponding descriptions can be easily recognized.

[0070] In the above embodiments, the current image reading report R1 and one past image reading report Rpi are displayed, but the present invention is not limited to this. If there are multiple past image reading reports Rpi, the corresponding descriptions of the current image reading report R1 and each of the multiple past image reading reports Rpi may be specified. In this case, multiple past image reading reports Rpi may be displayed in addition to the current image reading report R1, and when a character string is specified in the current image reading report R1, a description corresponding to a description including the character string in each of the multiple past image reading reports Rpi may be displayed differently from other descriptions.

[0071] FIG. 14 is a diagram showing a display screen of an interpretation report that displays two past interpretation reports Rp1 and Rp2 in addition to the current interpretation report R1. The descriptions of the current interpretation report R1 and the past interpretation report Rp1 displayed on the display screen 50D are the same as those in the first embodiment. The description of the past interpretation report Rp2 includes three sentences 70-72: "There is a 25 mm nodule in the right lung S3. It is accompanied by spicules. A slight ground glass opacity is observed in the left lung S6." The three sentences 70-72 of the past interpretation report Rp2 correspond in description to sentences 30-32 of the current interpretation report R1, respectively.

[0072] 14, the past interpretation report Rp1 created closer to the current interpretation report R1 is displayed higher than the past interpretation report Rp2. Therefore, the past interpretation report Rp1 created closer to the current interpretation report R1 is displayed with different text, i.e., highlighted, with higher priority than the past interpretation report Rp2.

[0073] Suppose that "nodule" in the current interpretation report R1 is selected as a character string on the display screen 50D of the interpretation report shown in Fig. 14. In this case, the display control unit 23 displays the sentence 40 corresponding to the sentence 30 in the past interpretation report Rp1 differently from the other sentences other than the sentence 40, i.e., highlights it, and displays the sentence 70 corresponding to the sentence 30 in the past interpretation report Rp2 differently from the other sentences other than the sentence 70, i.e., highlights it. This makes it easy to recognize the description corresponding to the description in the current interpretation report R1 even when multiple past interpretation reports Rpi are displayed.

[0074] Note that the text 40 may be displayed, i.e., highlighted, only for the past radiology report Rp1 that was created most recently as the current radiology report R1, differently from the other texts other than the text 40, and text 70 corresponding to text 30 in the past radiology report Rp2 may be highlighted upon instruction from the user. This also gives priority to highlighting the text of the past radiology report Rp1 that was created most recently as the current radiology report R1, over the past radiology report Rp2.

[0075] In addition, multiple past radiology reports Rpi are not limited to being displayed at the same time. As shown in a display screen 50E of Fig. 15, multiple past radiology reports Rpi may be displayed selectably using tabs 75 indicating the creation dates and times of the reports. Even in this case, the past radiology report Rp1 created closer to the current radiology report R1 may be positioned on the left tab so that it is displayed before the past radiology report Rp2.

[0076] In addition, in each of the above embodiments, when a character string is specified in the current image interpretation report R1, the description in the past image interpretation report Rpi that corresponds to the description in the current image interpretation report R1 that includes the character string is displayed differently from other descriptions, but in addition to this, the description in the current image interpretation report R1 that includes the specified character string may be displayed differently from other descriptions, as shown in Fig. 16. That is, as shown in the display screen 50F in Fig. 16, when "nodule" is selected in the current image interpretation report R1, in addition to highlighting the sentence 31 in which "nodule" is described and the sentence 41 that corresponds to the description, the sentence 31 in which "nodule" is described may also be highlighted.

[0077] Also, as shown in the display screen 50G of Fig. 17, in the current image interpretation report R1, character strings related to descriptions corresponding to those in the past image interpretation report Rpi may be displayed differently from other character strings other than the related character strings, that is, highlighted. In Fig. 17, the character strings are highlighted by surrounding them with a dashed rectangle, but this is not limiting. This makes it easier for the user to specify the corresponding description in the current image interpretation report R1.

[0078] In addition, in each of the above embodiments, the current image interpretation report R1 and the past image interpretation report Rpi are displayed simultaneously, but the present invention is not limited to this. First, only the current image interpretation report R1 is displayed, and when the user selects a character string in the current image interpretation report R1, the past image interpretation report Rpi is displayed, and the sentence corresponding to the description in the displayed past image interpretation report Rpi is displayed differently from the other sentences, i.e., is highlighted.

[0079] In addition, in each of the above embodiments, the technology of the present disclosure is applied to a case where an image interpretation report is created using a medical image with the lung as a diagnostic target, but the diagnostic target is not limited to the lung. In addition to the lung, any part of the human body, such as the heart, liver, brain, and limbs, can be the diagnostic target. In this case, a diagnostic guideline corresponding to the part of the diagnostic target is obtained, and a corresponding part in the image interpretation report that corresponds to the item of the diagnostic guideline may be identified.

[0080] In each of the above embodiments, the following various processors can be used as the hardware structure of the processing unit that executes various processes, such as the acquisition unit 21, the description specification unit 22, and the display control unit 23. As described above, the above various processors include a CPU, which is a general-purpose processor that executes software (programs) and functions as various processing units, as well as a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field Programmable Gate Array), a dedicated electric circuit, which is a processor having a circuit configuration designed specifically for executing specific processes, such as an ASIC (Application Specific Integrated Circuit), etc.

[0081] A single processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (e.g., a combination of multiple FPGAs or a combination of a CPU and an FPGA). Also, multiple processing units may be configured with a single processor.

[0082] As an example of configuring multiple processing units with one processor, first, there is a form in which one processor is configured with a combination of one or more CPUs and software, as typified by computers such as client and server, and this processor functions as multiple processing units. Second, there is a form in which a processor is used that realizes the functions of the entire system including multiple processing units with one IC (Integrated Circuit) chip, as typified by System On Chip (SoC), etc. In this way, the various processing units are configured using one or more of the above various processors as a hardware structure.

[0083] Furthermore, more specifically, the hardware structure of these various processors can be an electric circuit that combines circuit elements such as semiconductor elements.

[0084] The following describes the appendix of this disclosure. (Additional note 1) at least one processor; The processor, Acquire multiple medical documents created at different times, Identifying corresponding descriptions in one medical document among the plurality of medical documents and at least one other medical document other than the one medical document; Displaying the one medical document on a display; Accepting a character string designation for the one medical document; An information processing device that displays a description of the at least one other medical document that corresponds to a description including the specified character string in a manner different from other descriptions other than the description that corresponds to the description including the specified character string. (Additional note 2) The information processing device according to claim 1, wherein the processor classifies descriptions included in each of the plurality of medical documents by lesion and identifies the corresponding descriptions for each lesion. (Additional note 3) The processor further identifies differences between corresponding descriptions included in each of the plurality of medical documents; 3. An information processing device as described in claim 1 or 2, which displays, in the at least one other medical document, the difference in a manner different from a description other than the difference, instead of or in addition to a description corresponding to a description including the specified character string. (Additional note 4) the medical document includes a medical image corresponding to the medical document; The information processing device according to any one of claims 1 to 3, wherein the processor displays at least a partial area in the medical image related to the description displayed differently in a manner different from other areas other than the partial area. (Additional note 5) The information processing device according to any one of claims 1 to 4, wherein the processor displays character strings related to the corresponding descriptions in the one medical document in a manner different from other character strings other than the related character strings. (Additional note 6) 6. The information processing device according to any one of claims 1 to 5, wherein the processor displays a description including the character string in the one medical document in a manner different from other descriptions other than the description including the character string. (Additional note 7) 7. The information processing device according to claim 1, wherein the one medical document is a medical document currently being created. (Additional note 8) 8. The information processing device according to claim 1, wherein the plurality of medical documents at least partially include medical documents acquired by different modalities. (Additional note 9) The information processing device according to any one of claims 1 to 8, wherein when displaying the multiple other medical documents, the processor preferentially displays the descriptions in the other medical documents in a different manner, the closer the other medical documents were created to the one medical document. (Additional note 10) The computer acquires multiple medical documents created at different times, Identifying corresponding descriptions in one medical document among the plurality of medical documents and at least one other medical document other than the one medical document; Displaying the one medical document on a display; Accepting a character string designation for the one medical document; An information processing method that displays a description of the at least one other medical document that corresponds to a description including the specified character string in a manner different from other descriptions other than the description that corresponds to the description including the specified character string. (Additional note 11) A procedure for obtaining multiple medical documents created at different times; A step of identifying corresponding descriptions in one medical document among the plurality of medical documents and at least one other medical document other than the one medical document; displaying the one medical document on a display; receiving a character string specification for the one medical document; and a procedure for displaying a description of the at least one other medical document that corresponds to a description including the specified character string in a manner different from other descriptions other than the description that corresponds to the description including the specified character string. [Explanation of symbols]

[0085] 1 Medical Information System 2. Imaging Device 3. Image Reading Workshop 4. Clinical Workshop 5 Image Server 6. Image Database 7 Report Server 8 Report DB 10 Network 11 CPU 12 Information Processing Programs 13. Storage 14 Display 15 Input Devices 16 Memory 17 Network Interface 18 Bus 20 Information processing device 21 Acquisition Department 22 Description specific part 23 Display control section 30~33,40~42,70~72 50,50B~50G display screen 50A Image interpretation report creation screen 52 Report Area 60,61 Marker 75 Tabs G1, Gp1 Medical Images R0 Reading report in preparation R1 Current Reading Report Rpi Past Reading Reports

Claims

1. At least one processor; The processor, Acquire multiple medical documents created at different times, Identifying corresponding descriptions in one medical document among the plurality of medical documents and at least one other medical document other than the one medical document; Displaying the one medical document on a display; Accepting a character string designation for the one medical document; An information processing device that displays a description of the at least one other medical document that corresponds to a description including the specified character string in a manner different from other descriptions other than the description that corresponds to the description including the specified character string.

2. The information processing apparatus according to claim 1 , wherein the processor classifies descriptions included in each of the plurality of medical documents by lesion, and identifies the corresponding descriptions for each of the lesions.

3. The processor further identifies differences between corresponding descriptions included in each of the plurality of medical documents; 2. The information processing device according to claim 1, wherein, in the at least one other medical document, the difference is displayed in a manner different from descriptions other than the difference, instead of or in addition to a description corresponding to a description including the specified character string.

4. the medical document includes a medical image corresponding to the medical document; The information processing apparatus according to claim 1 , wherein the processor displays at least a partial region in the medical image associated with the description displayed differently in a manner different from other regions other than the partial region.

5. The information processing apparatus according to claim 1 , wherein the processor displays character strings related to the corresponding descriptions in the one medical document in a manner different from other character strings other than the related character strings.

6. The information processing apparatus according to claim 1 , wherein the processor displays, in the one medical document, a description including the character string so as to be different from other descriptions other than the description including the character string.

7. The information processing apparatus according to claim 1 , wherein the one medical document is a medical document currently being created.

8. The information processing apparatus according to claim 1 , wherein the plurality of medical documents at least partially include medical documents acquired by different modalities.

9. The information processing apparatus according to claim 1 , wherein, when displaying the other medical documents, the processor preferentially displays the descriptions in the other medical documents in a manner that is closer to the time of creation of the one medical document.

10. The computer acquires multiple medical documents created at different times, Identifying corresponding descriptions in one medical document among the plurality of medical documents and at least one other medical document other than the one medical document; Displaying the one medical document on a display; Accepting a character string designation for the one medical document; An information processing method that displays a description of the at least one other medical document that corresponds to a description including the specified character string in a manner different from other descriptions other than the description that corresponds to the description including the specified character string.

11. A procedure for obtaining multiple medical documents created at different times; A step of identifying corresponding descriptions in one medical document among the plurality of medical documents and at least one other medical document other than the one medical document; displaying the one medical document on a display; receiving a character string specification for the one medical document; and a procedure for displaying a description of the at least one other medical document that corresponds to a description including the specified character string in a manner different from other descriptions other than the description that corresponds to the description including the specified character string.

Citation Information

Patent Citations

  • Medical image processing apparatus, medical image processing method, and medical image processing program

    JP2019153249A