Image diagnostic aid device and operation method of image diagnostic aid device, and program

Abstract

To provide an image diagnostic aid device, an operation method of the image diagnostic aid device, and a program which achieve the comprehension of a medical history by using information on a past treatment portion obtained from a medical image and an interpretation report.SOLUTION: An image diagnostic aid device (22) executes processes of: acquiring a first medical image generated by photographing a subject in the latest checkup (30); acquiring treatment information on treatment of the subject (42, 46); generating treatment progress information on a past treatment portion of the subject on the basis of the treatment information (48); and performing such control that the treatment progress information is made displayed on a screen for displaying the first medical image (34).SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an image diagnosis auxiliary device, and an operating method and program for the image diagnosis auxiliary device. [Background technology]

[0002] When preparing a medical image interpretation report for a patient who has had treatment, The anatomical structure of the subject of the current examination may differ from that of the previously treated subject. The same applies even if

[0003] Patent Document 1 discloses one or more devices capable of estimating the state of a diagnostic target organ of a subject. At least one of the above physical information and endoscopic images of the organs to be diagnosed This invention describes a diagnosis support device that extracts lesions in an organ to be diagnosed using the above method.

[0004] Patent Document 2 describes a medical image diagnosis support device that refers to the dental diagnosis history of a treatment target. The device described in this document transmits image information and tooth position information for the dentist to a display device. The diagnostic history for display is created for the part specified by the operator, and the diagnostic history for display is Display it.

[0005] Patent Document 3 discloses a system for exchanging dental treatment details between dental clinics and advanced medical hospitals. The system described in the document is a dental care support system that uses a network. The terminals at dental clinics and advanced medical hospitals are connected to each other for communication, and advanced medical information is sent from dental clinics to the hospitals. In response to a request for advice from a medical hospital, the medical advice information is sent from the terminal of the advanced medical hospital to the terminal of the dental clinic. Information is sent. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] International Publication No. 2020 / 188682 [Patent Document 2] JP 2009-230609 A [Patent Document 3] JP 2009-125133 A Summary of the Invention [Problem to be solved by the invention]

[0007] However, describing the history of the treatment area in the image interpretation report places a burden on the image interpretation physician. The reason is as follows: If the treatment proceeds well, the treatment area such as a lesion will shrink, disappear, or be removed as a result of the treatment. This makes it difficult to identify the treatment area due to the shrinkage of the treatment area in medical images during and after treatment. If it is difficult to identify the treatment area in the current image, it becomes necessary to refer to past medical images and past image interpretation reports, etc.

[0008] In addition, if the anatomical structure of an organ or the like for which some treatment was previously instructed differs from the anatomical structure for the purpose of the current examination, it is necessary to refer to the medical image depicting the anatomical structure for which treatment was previously instructed, perform the interpretation, and generate the current interpretation report.

[0009] The device described in Patent Document 1, the device described in Patent Document 2, and the system described in Patent Document 3 all use past data such as treatment history to assist in diagnosis, but are not intended to assist in interpretation.

[0010] The present invention has been made in consideration of the above circumstances, and has as its object to provide an image diagnosis auxiliary device, and an operating method and program for the image diagnosis auxiliary device, which realizes understanding of a treatment history using information on the location of past treatment obtained from medical images, radiology reports, etc. [Means for solving the problem]

[0011] An image diagnostic support device according to a first aspect of the present disclosure includes one or more processors and one or more memories for storing instructions to be executed by the one or more processors, wherein the one or more processors acquire a first medical image generated by photographing a subject in a most recent examination, acquire treatment information related to the treatment of the subject, generate treatment progress information related to past treatment locations on the subject based on the treatment information, and perform control to display the treatment progress information on a screen that displays the first medical image.

[0012] According to the image diagnosis auxiliary device according to the first aspect of the present disclosure, treatment progress information regarding a past treatment site is generated and displayed for a first medical image generated in the latest examination, thereby realizing understanding of the treatment progress using information regarding the past treatment site.

[0013] The most recent test may be understood as the current test. The current test may be understood as the current test.

[0014] The first medical image may be a two-dimensional image or a three-dimensional image, or may be a reconstructed image group including a plurality of reconstructed images.

[0015] The one or more processors may acquire a second medical image generated in a previous examination relative to the current examination.

[0016] An image diagnosis auxiliary device according to a second aspect is the image diagnosis auxiliary device according to the first aspect, wherein the one or more processors may acquire, as the treatment information, information on a previously treated part of the subject.

[0017] According to this aspect, treatment progress information can be generated based on past information relating to previously treated parts of the subject.

[0018] An image diagnosis support device according to a third aspect is an image diagnosis support device according to the second aspect, wherein one or more processors acquire text information including a description of the subject's past treatment locations as information relating to the subject's past treatment locations.

[0019] According to this aspect, treatment progress information can be generated based on text information relating to the parts of the subject that have been previously treated.

[0020] An image diagnosis support device according to a fourth aspect is an image diagnosis support device according to any one of the first to third aspects, wherein one or more processors may acquire requested information for the latest examination of the subject as treatment information.

[0021] According to this aspect, treatment progress information can be generated based on current information such as request information in the latest examination of the subject.

[0022] In the image diagnosis support device of the fifth aspect, in the image diagnosis support device of the fourth aspect, one or more processors may acquire text information including a description of the purpose of the latest examination on the subject as request information for the latest examination on the subject.

[0023] According to this aspect, treatment progress information can be generated based on text information that includes a description of the purpose of the most recent examination.

[0024] An image diagnostic support device according to a sixth aspect is an image diagnostic support device according to any one of the first to fifth aspects, wherein the one or more processors may acquire, as treatment information, at least one of the name of an anatomical structure for which treatment was previously indicated, the name of a lesion for which treatment was previously indicated, the location of a lesion for which treatment was previously indicated, and a treatment method performed in the past.

[0025] According to this aspect, treatment progress information can be generated based on the names of anatomical structures for which treatment was previously indicated.

[0026] An image diagnostic support device according to a seventh aspect is an image diagnostic support device according to any one of the first to sixth aspects, wherein the one or more processors are a first diagnostic target image including a first anatomical structure of the diagnostic target in the latest examination, and may display treatment progress information for the first diagnostic target image included in the first medical image.

[0027] According to this aspect, the past medical history represented by the medical treatment progress information can be grasped in the first diagnostic object image.

[0028] An image diagnostic support device according to an eighth aspect is an image diagnostic support device according to the seventh aspect, wherein one or more processors may generate, as treatment progress information, information specifying the position of a reconstructed image including a past treatment site in a group of reconstructed images including a plurality of two-dimensional reconstructed images.

[0029] According to this aspect, the position of the past treatment can be identified in the first diagnostic object image.

[0030] The image diagnostic support device of the 9th aspect is the image diagnostic support device of the 7th aspect, wherein the one or more processors apply a segmentation process of the first anatomical structure or a labeling process of the first anatomical structure to the first medical image to identify past treatment sites in the first diagnostic target image.

[0031] In such an embodiment, a trained learning model that realizes a segmentation process or a trained learning model that realizes a labeling process may be applied.

[0032] An image diagnostic support device according to a 10th aspect is an image diagnostic support device according to any one of the seventh to ninth aspects, wherein one or more processors acquire a second medical image generated by photographing a subject in a past examination, and apply a segmentation process of the first anatomical structure or a labeling process of the first anatomical structure to the second medical image to identify a past treatment location in the second medical image.

[0033] According to this aspect, a previously treated area can be identified from the second medical image generated in the previous examination.

[0034] An image diagnostic support device according to an eleventh aspect is an image diagnostic support device according to any one of the first to sixth aspects, wherein one or more processors generate a first cropped image, which is a first diagnostic target image including a first anatomical structure of the diagnostic target in the latest examination as treatment progress information, and in which an area corresponding to a previously treated site in the first diagnostic target image included in the first medical image is cropped.

[0035] According to this aspect, it is possible to grasp the characteristics of a previously treated area in the first medical image.

[0036] The image diagnostic support device of the 12th aspect is the image diagnostic support device of the 11th aspect, wherein one or more processors analyze a first cropped image, and if no image features relating to the treatment area cannot be recognized in the first cropped image, generate a second cropped image in which an area corresponding to the treatment area is cropped from a previous medical image of the subject, and display the second cropped image in the area corresponding to the previous treatment area in the first diagnostic target image.

[0037] According to this aspect, it is possible to grasp the characteristics of a previously treated area in the first medical image.

[0038] An image diagnostic support device according to a 13th aspect is an image diagnostic support device according to any one of the first to 12th aspects, wherein one or more processors, when a first anatomical structure of an examination subject in a latest examination is different from a second anatomical structure which is a previously treated location of the subject, acquire treatment information for the second anatomical structure, generate treatment progress information for the second anatomical structure based on the treatment information for the second anatomical structure, and display the treatment progress information for the second anatomical structure for a second diagnostic target image which includes the second anatomical structure and is included in the first medical image.

[0039] According to this aspect, even if the anatomical structure of the examination subject in the latest examination differs from the anatomical structure of the examination subject in a past examination, the past medical history can be ascertained from the second diagnostic object image.

[0040] An image diagnostic support device according to a 14th aspect is an image diagnostic support device according to any one of the first to 13th aspects, wherein one or more processors generate a plurality of pieces of treatment progress information and apply different display modes to each of the plurality of pieces of treatment progress information.

[0041] According to this aspect, even if there are multiple medical histories, each of the multiple medical histories can be distinguished from each other.

[0042] An operating method of an image diagnostic auxiliary device according to a fifteenth aspect of the present disclosure is a operating method of an image diagnostic auxiliary device to which a computer is applied, in which the image diagnostic auxiliary device acquires a first medical image generated by photographing a subject in a latest examination, acquires treatment information related to the treatment of the subject, generates treatment progress information related to past treatment locations of the subject based on the treatment information, and controls the display of the treatment progress information on a screen that displays the first medical image.

[0043] According to the operation method of the image diagnosis auxiliary device according to the fifteenth aspect of the present disclosure, it is possible to obtain the same operational effects as those of the image diagnosis auxiliary device according to the first aspect of the present disclosure.

[0044] In the operation method of the image diagnosis auxiliary device according to the 15th aspect, it is possible to appropriately combine the same items as those specified in the second to 14th aspects. In this case, the components performing the processing or function specified in the image diagnosis auxiliary device can be understood as the components of the operation method of the image diagnosis auxiliary device performing the corresponding processing or function.

[0045] A program according to a sixteenth aspect of the present disclosure is a program that enables a computer to realize the functions of acquiring a first medical image generated by photographing a subject in a latest examination, acquiring treatment information related to the treatment of the subject, generating treatment progress information related to past treatment locations on the subject based on the treatment information, and performing control to display the treatment progress information on a screen that displays the first medical image.

[0046] According to the program according to the sixteenth aspect of the present disclosure, it is possible to obtain the same operational effects as those of the image diagnosis auxiliary device according to the first aspect of the present disclosure.

[0047] In the program according to the 16th aspect, it is possible to appropriately combine the same items as those specified in the 2nd to 14th aspects. In this case, the components that perform the processes or functions specified in the image diagnosis auxiliary device can be understood as the components of the program that perform the corresponding processes or functions. Effect of the Invention

[0048] According to the present invention, treatment progress information regarding the past treated area is generated and displayed for the first medical image generated in the latest examination, thereby realizing understanding of the treatment progress using information regarding the past treated area. [Brief description of the drawings]

[0049] [Figure 1] Figure 1 shows the overall configuration of the hospital system. [Diagram 2] FIG. 2 is a functional block diagram showing an electrical configuration of the server device shown in FIG. [Diagram 3] FIG. 3 is a block diagram showing an example of a hardware configuration of the server device shown in FIG. [Figure 4] FIG. 4 is a flowchart showing the procedure of the image diagnosis assistance method according to the embodiment. [Diagram 5] FIG. 5 is a schematic diagram of treatment progress information according to the first specific example. [Figure 6]FIG. 6 is a schematic diagram of treatment progress information according to the second specific example. [Figure 7] FIG. 7 is a schematic diagram of treatment progress information according to the third specific example. [Figure 8] FIG. 8 is a schematic diagram of treatment information acquisition according to the first specific example. [Figure 9] FIG. 9 is a schematic diagram of treatment information acquisition according to the second example. [Figure 10] FIG. 10 is a schematic diagram of treatment information acquisition according to the third example. [Figure 11] FIG. 11 is a schematic diagram of an image diagnosis auxiliary method according to a modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0050] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this specification, the same components are given the same reference numerals, and duplicated descriptions will be omitted as appropriate.

[0051] [Example of hospital system configuration] Fig. 1 is an overall configuration diagram of a hospital system. The various systems constituting the hospital system 10 shown in the figure are equipped with one or more computers, and the one or more computers execute various programs stored in computer-readable media, which are tangible objects, to realize one or more functions of the various systems.

[0052] The hospital system 10 includes various types of inspection devices 12. The inspection devices 12 capture images of subjects to be examined, and generate medical images. In the figure, the inspection devices 12 are exemplified by a CT device 12A, an MRI device 12B, and a PETCT device 12C. Other examples of the inspection devices 12 include an X-ray device, an ultrasound device, and a CR device using a flat X-ray detector.

[0053] In addition, CT is an abbreviation for Computed Tomography, MRI is an abbreviation for Magnetic Resonance Imaging, PET is an abbreviation for Positron Emission Tomography, and CR is an abbreviation for Computed Radiography. Furthermore, the examination apparatus 12 may be referred to as a modality.

[0054] The hospital system 10 includes a radiology information system 14. The radiology information system 14 mainly manages everything from reservations for examinations and treatments that use radiation equipment to examination results. The radiology information system 14 stores medical images generated during examinations, past image interpretation reports, and an image interpretation report generated during the current examination. The radiology information system 14 can be expressed using RIS, which is an abbreviation for Radiology Information Systems.

[0055] The hospital system 10 includes a hospital information system 16. The hospital information system 16 is a general term for various information systems within the hospital. In general, the hospital information system 16 may include an automated reception system 16A, an electronic medical record system 16B, an admission and discharge management system 16C, a medical accounting system 16D, a pharmacy management system 16E, and a medical appointment system 16F.

[0056] All information related to the hospital is stored in the hospital information system 16. For example, the electronic medical record system 16B stores the operation history and treatment history of each patient as an electronic medical record. The hospital information system 16 can be expressed by using the abbreviation HIS for Hospital Information Systems.

[0057] The hospital system 10 includes an image archiving and communication system 18. The image archiving and communication system 18 includes a server device 22 and a display terminal 24. The server device 22 includes a database 23. The display terminal 24 includes a display device 26.

[0058] The image archiving and communication system 18 receives medical images transmitted from the inspection device 12. The received medical images are stored in a database 23. The image archiving and communication system 18 reads out the medical images stored in the database 23. The read out medical images are displayed on a display device 26 of a display terminal 24. DICOM is applied as a standard for storage and communication of medical images managed using the server device 22, the database 23 and the display terminal 24. DICOM is an abbreviation for Digital Imaging and COmmunications in Medicine. The server device 22 may be referred to as a DICOM server.

[0059] The radiologist can view medical images of the diagnosis target using the display terminal 24. The radiologist can also check the contents of orders sent from various medical departments using the display terminal 24. Furthermore, the radiologist can understand the purpose of the examination based on the orders sent from various medical departments. The image archiving and communication system 18 can be expressed by using PACS, which is an abbreviation for Picture Archiving and Communication Systems.

[0060] The hospital system 10 includes a report creation system 20. The report creation system 20 includes a report creation terminal device 21 that is operated by a radiologist to create an image interpretation report. The report creation terminal device 21 may store a program that supports the creation of an image interpretation report and may execute the program that supports the creation of an image interpretation report.

[0061] The testing devices 12 and other components of the hospital system 10 are electrically connected to each other so as to be able to communicate freely through a hospital network. A hospital network LAN is applicable. The hospital network may be wired or wireless.

[0062] The hospital network may be connected to a public line network such as the Internet via a router (not shown). That is, the hospital system 10 may be electrically connected to an external device such as a cloud server via the hospital network and the public line network so as to be able to communicate freely. Note that LAN is an abbreviation for Local Area Network.

[0063] [Server device electrical configuration] Fig. 2 is a functional block diagram showing the server device shown in Fig. 1. The server device 22 shown in Fig. 2 functions as an image diagnosis auxiliary device. The server device 22 includes an image acquisition unit 30, an image processing unit 32, and a display signal output unit .

[0064] The image acquiring unit 30 acquires a current image, which is a medical image of a diagnosis target of the current examination subject, which is a medical image stored in the radiology information system 14. The image acquiring unit 30 also acquires a past image, which is a medical image of a past examination of the current examination subject.

[0065] Here, the current examination is understood to be the latest examination among the multiple examinations in chronological order, the past examination is understood to be one or more past examinations excluding the latest examination among the multiple examinations in chronological order, and the current medical image is understood to be the latest medical image.

[0066] In addition, the current image described in the embodiment is an example of a first medical image, and the past image described in the embodiment is an example of a second medical image.

[0067] The image processing unit 32 performs various types of image processing on the medical image acquired using the image acquisition unit 30. Examples of the various types of image processing include processing corresponding to the display conditions of the display device 26, such as resolution conversion processing and size conversion processing. The display signal output unit 34 transmits a display signal representing the medical image that has been subjected to image processing using the image processing unit 32 to the display device 26 of the display terminal 24.

[0068] The server device 22 includes an image analysis unit 36. The image analysis unit 36 ​​analyzes medical images acquired using the image acquisition unit 30. Examples of medical image analysis include segmentation and labeling of anatomical structures such as organs. Other examples of medical image analysis include segmentation and labeling of abnormal regions for each anatomical structure. Examples of anatomical structures include organs, muscles, tendons, joints, bones, nerves, and blood vessels.

[0069] The image analysis unit 36 ​​may apply a learned learning model. The learning model applied to the image analysis unit 36 ​​is a recognition model that recognizes one or more anatomical structures or abnormal regions for each anatomical structure from one medical image, and may apply a learning model that uses a pair of a medical image and a recognition result of an anatomical structure, etc. as learning data and outputs a recognition result of an anatomical structure, etc. when a medical image is input. Deep learning may be applied to the learning of the learning model applied to the image analysis unit 36.

[0070] A learning model that performs labeling of one or more anatomical structures, etc. from one medical image may be applied to the image analysis unit 36. That is, a learning model that outputs a label of an anatomical structure, etc. when a medical image is input, using a pair of a medical image and a label of an anatomical structure, etc. as learning data, may be applied.

[0071] The server device 22 includes an image interpretation information acquisition unit 40 and an image interpretation information analysis unit 42. The image interpretation information acquisition unit 40 acquires, from among the past image interpretation reports stored in the radiology department information system 14, a past image interpretation report for the current examination subject.

[0072] The image interpretation information analysis unit 42 analyzes the image interpretation report acquired using the image interpretation information acquisition unit 40, and acquires the first treatment information. For example, the image interpretation information analysis unit 42 analyzes text written in the acquired image interpretation report, and extracts the first treatment information such as the creation date and time of the image interpretation report, the name of the organ, the name of the lesion, the location of the lesion, and the treatment method. Note that the image interpretation information acquisition unit 40 and the image interpretation information analysis unit 42 described in the embodiment are examples of components of the treatment information acquisition unit.

[0073] The server device 22 includes a medical record information acquisition unit 44 and a medical record information analysis unit 46. The medical record information acquisition unit 44 acquires the electronic medical record of the current test subject from among the electronic medical records stored in the electronic medical record system 16B included in the hospital information system 16 shown in FIG.

[0074] The medical record information analysis unit 46 analyzes text and the like written in the electronic medical record acquired using the medical record information acquisition unit 44, and extracts second treatment information such as the date and time of past treatment and the contents of treatment. Note that the medical record information acquisition unit 44 and the medical record information analysis unit 46 described in the embodiment are examples of components of the treatment information acquisition unit.

[0075] The server device 22 includes a treatment progress information generating unit 48. The treatment progress information generating unit 48 acquires first treatment information from the image interpretation information analyzing unit 42. Also, the treatment progress information generating unit 48 acquires second treatment information from the medical record information analyzing unit 46. The treatment progress information generating unit 48 generates treatment progress information representing abnormal areas that are extracted in the past image and have disappeared or shrunk in the current image, based on treatment information including the first treatment information and the second treatment information. The treatment progress information generating unit 48 transmits the treatment progress information to the display signal output unit 34.

[0076] The treatment progress information generating unit 48 may acquire at least one of the first treatment information and the second treatment information when generating the treatment progress information, and generate the treatment progress information using the acquired treatment information.

[0077] The display signal output unit 34 generates a display signal representing the treatment progress information, and transmits the display signal representing the treatment progress information to the display device 26. The display device 26 displays the treatment progress information on the screen that displays the current image.

[0078] The server device 22 acquires input information transmitted from an input device 27 provided in the display terminal 24 shown in Fig. 1. The input device 27 may be a keyboard, a mouse, or the like. An operator of the display terminal 24 can transmit desired information to the server device 22 by operating the input device 27.

[0079] Fig. 3 is a block diagram showing an example of a hardware configuration of the server device shown in Fig. 2. The server device 22 includes one or more processors 52 and one or more memories 62. The server device 22 includes a communication interface 56 and an input / output interface 58.

[0080] The processor 52 executes various programs stored in a memory 62 of the computer-readable medium 54 to realize various functions of the server device 22. The processor 52 includes a CPU (Central Processing Unit). The processor 52 may include a GPU (Graphics Processing Unit). The processor 52 is connected to the computer-readable medium 54, a communication interface 56, and an input / output interface 58 via a bus 60.

[0081] The computer-readable medium 54 includes a memory 62 which is a main storage device and a storage 64 which is an auxiliary storage device. The computer-readable medium 54 may be a semiconductor memory, a hard disk drive, a solid-state drive device, or the like. The computer-readable medium 54 may be any combination of a plurality of devices.

[0082] A hard disk device may be referred to as an HDD, which is an abbreviation of the English term Hard Disk Drive, and a solid state drive device may be referred to as an SSD, which is an abbreviation of the English term Solid State Drive.

[0083] The memory 62 of the computer-readable medium 54 stores an image acquisition program 70, an image processing program 72, an image analysis program 74, and a display signal output program 76. The memory 62 also stores an image interpretation information acquisition program 80, an image interpretation information analysis program 82, a medical record information acquisition program 84, a medical record information analysis program 86, and a treatment progress information generation program 88.

[0084] 2, and realizes an image acquisition function. Image processing program 72 is applied to image processing unit 32, and realizes an image processing function using the processing result of image acquisition program 70. Image analysis program 74 is applied to image analysis unit 36, and realizes an image analysis function using the processing result of image acquisition program 70.

[0085] The image interpretation information acquisition program 80 is applied to the image interpretation information acquisition unit 40 and realizes an image interpretation information acquisition function. The image interpretation information analysis program 82 is applied to the image interpretation information analysis unit 42 and realizes an image interpretation information analysis function using the processing results of the image interpretation information acquisition program 80. The image interpretation information analysis function is a first treatment information acquisition function, and is understood as a component of the treatment information acquisition function.

[0086] The medical record information acquisition program 84 is applied to the medical record information acquisition unit 44 and realizes a medical record information acquisition function. The medical record information analysis program 86 is applied to the medical record information analysis unit 46 and realizes a medical record information analysis function using a processing result of the medical record information analysis program 86. The medical record information analysis function is a second treatment information acquisition function and is understood as a component of the treatment information acquisition function.

[0087] The treatment progress information generating program 88 is applied to the treatment progress information generating unit 48. The treatment progress information generating program 88 realizes a treatment progress information generating function by using the processing result of the image analysis program 74, the first treatment information which is the processing result of the image interpretation information analysis program 82, and the second treatment information which is the processing result of the medical record information analysis program 86.

[0088] The display signal output program 76 is applied to the display signal output unit 34. The display signal output program 76 realizes a display signal output function by using the processing result of the image processing program 72. In addition, the display signal output program 76 realizes a display signal output function when displaying treatment progress information by using the processing result of the treatment progress information generation program 88.

[0089] Various programs stored in the computer-readable medium 54 include one or more instructions. Various data, various parameters, etc. are stored in the computer-readable medium 54. Note that the term program is synonymous with the term software.

[0090] The hardware structure of the processor 52 is various processors as shown below. The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) and acts as various functional units, a GPU (Graphics Processing Unit), which is a processor specialized for image processing, a PLD (Programmable Logic Device), which is a processor whose circuit configuration can be changed after manufacture such as an FPGA (Field Programmable Gate Array), and a dedicated electric circuit, which is a processor having a circuit configuration designed specifically for executing specific processing such as an ASIC (Application Specific Integrated Circuit).

[0091] A processing unit may be configured with one of these various processors, or may be configured with two or more processors of the same or different types (for example, multiple FPGAs, or a combination of a CPU and an FPGA, or a combination of a CPU and a GPU). Also, multiple functional units may be configured with one processor. As an example of configuring multiple functional units with one processor, first, as represented by a computer such as a client or a server, there is a form in which one processor is configured with a combination of one or more CPUs and software, and this processor acts as multiple functional units. Second, as represented by a SoC (System On Chip), there is a form in which a processor is used that realizes the functions of the entire system including multiple functional units with one IC (Integrated Circuit) chip. In this way, the various functional units are configured using one or more of the above various processors as a hardware structure.

[0092] Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit that combines circuit elements such as semiconductor elements.

[0093] The memory 62 stores instructions to be executed by the processor 52. The memory 62 includes a RAM (Random Access Memory) and a ROM (Read Only Memory), not shown. The processor 52 uses the RAM as a working area, executes software using various programs and parameters, including image processing programs, including an image acquisition program 70, etc., stored in the ROM, and executes various processes of the server device 22 by using the parameters stored in the ROM, etc.

[0094] The display terminal 24 shown in Fig. 1 may realize the information processing function of the server device 22. That is, the display terminal 24 may include various processing units such as the image acquisition unit 30 shown in Fig. 3, and may realize the functions of the various processing units. Furthermore, the hospital system 10 shown in Fig. 1 may include an information processing device that includes various processing units such as the image acquisition unit 30 shown in Fig. 3, in addition to the server device 22 and the display terminal 24.

[0095] [Procedure of image diagnosis support method according to embodiment] Fig. 4 is a flowchart showing the procedure of the image diagnosis support method according to the embodiment. Each step of the image diagnosis support method shown in Fig. 4 is executed by using various processing units provided in a server device 22 to which a computer is applied. The image diagnosis support method is an example of a method for operating an image diagnosis support device.

[0096] In the image acquisition step S10, the image acquisition section 30 shown in FIG. 2 acquires a current image and a past image. After the image acquisition step S10, the process proceeds to an image processing step S12 and an image analysis step S14. In the image processing step S12, the image processing section 32 performs various image processing on the medical image acquired in the image acquisition step S10, which is to be displayed on the display device 26. After the image processing step S12, the process proceeds to a display signal generation step S26. In the image analysis step S14, the medical image acquired in the image acquisition step S10 is analyzed. After the image analysis step S14, the process proceeds to a treatment progress information generation step S24.

[0097] In the interpretation information acquisition process S16, the interpretation information acquisition unit 40 acquires interpretation information such as an interpretation report of the subject. After the interpretation information acquisition process S16, the process proceeds to the interpretation information analysis process S18. In the interpretation information analysis process S18, the interpretation information analysis unit 42 analyzes the interpretation information acquired in the interpretation information acquisition process S16 and acquires first treatment information. After the interpretation information analysis process S18, the process proceeds to the treatment progress information generation process S24. Note that the interpretation information acquisition process S16 and the interpretation information analysis process S18 are examples of components of the treatment information acquisition process.

[0098] In the medical record information acquisition step S20, the medical record information acquisition unit 44 acquires the electronic medical record of the test subject. After the medical record information acquisition step S20, the process proceeds to a medical record information analysis step S22. In the medical record information analysis step S22, the medical record information analysis unit 46 analyzes the electronic medical record of the test subject acquired in the medical record information acquisition step S20, and acquires second treatment information. After the medical record information analysis step S22, the process proceeds to a treatment progress information generation step S24. The medical record information acquisition step S20 and the medical record information analysis step S22 are examples of components of a treatment information acquisition step.

[0099] In the treatment progress information generating step S24, the treatment progress information generating unit 48 generates treatment progress information using the processing result of the image analysis step S14, the first treatment information acquired in the image interpretation information analyzing step S18, and the second treatment information acquired in the medical record information analyzing step S22. After the treatment progress information generating step S24, the process proceeds to a display signal generating step S26.

[0100] In the display signal generating step S26, the display signal output unit 34 generates a display signal representing the current image using the processing result of the image processing step S12. Also, in the display signal generating step S26, the display signal output unit 34 generates a display signal representing the treatment progress information using the processing result of the treatment progress information generating step S24. After the display signal generating step S26, the process proceeds to the display signal output step S28.

[0101] In the display signal output step S28, the display signal output unit 34 outputs a display signal representing the current image and a display signal representing the treatment progress information generated in the display signal generation step S26 to the display device 26. The display device 26 displays the current image and the treatment progress information.

[0102] [Examples of treatment progress information] FIG. 5 is a schematic diagram of treatment progress information according to a first specific example. The previous image Ipa shown in the figure is an image generated in a previous examination of the subject of the current image Ipr. The organ Or shown in the previous image Ipa is the same as the organ Or shown in the current image Ipr. The organ Or is understood as an example of the first anatomical structure.

[0103] In the past image Ipa, an abnormal region Rpa in the organ Or is extracted. On the other hand, as a result of successful progress of treatment, the abnormal region Rpr in the organ Or has shrunk in the current image Ipr. In this case, it may be difficult to recognize the abnormal region Rpr in the current image Ipr.

[0104] FIG. 5 shows an example in which the abnormal region Rpr of the organ Or is reduced in the current image Ipr, but the same applies to the case in which the abnormal region Rpr disappears, for example, when the abnormal region Rpr is excised.

[0105] Therefore, the treatment area in the current image Ipr, which is the image to be interpreted, is displayed in an easily understandable manner using information obtained from the current image Ipr, information obtained from past image interpretation reports, and information obtained from the electronic medical record. Specifically, treatment progress information is displayed for the current image Ipr.

[0106] 5 is an example of treatment progress information, and has a position and shape that surrounds the abnormal region Rpa in the past image Ipa. That is, the bounding box BB is placed at a position in the current image Ipr that corresponds to the position of the abnormal region Rpa in the past image Ipa, and has a size that corresponds to the size of the abnormal region Rpa in the past image Ipa.

[0107] Specifically, the bounding box BB has a center of gravity in the current image Ipr that coincides with the center of gravity of the abnormal region Rpa in the past image Ipa, and is a square of a size that inscribes the abnormal region Rpa in the past image Ipa.

[0108] Note that the bounding box BB may be in various shapes, such as a triangle, a quadrangle other than a square, such as a rectangle, a polygon such as a pentagon, a circle, an ellipse, or any other shape, etc. In addition, the type, width, and color of the lines constituting the bounding box may be specified arbitrarily.

[0109] The current image Ipr shown in FIG. 5 is an example of a first diagnostic object image included in the first medical image.

[0110] FIG. 6 is a schematic diagram of treatment progress information according to a second specific example. The past image Ipa1 shown in the figure is an example of treatment progress information, and is displayed alongside the current image Ipr. The figure shows an example in which the current image Ipr is reduced on a screen that displays only the current image Ipr, and the past image Ipa1 reduced to the same size as the reduced current image Ipr is displayed. The past image Ipa1, which is treatment progress information, may have a size larger than the current image Ipr, or may have a size smaller than the current image Ipr. The past image Ipa1, which is treatment progress information, may be displayed in a window separate from the current image Ipr.

[0111] The treatment progress information may be a first trimmed image obtained by trimming the same area of ​​the lesion at the position of the lesion for which treatment was previously instructed in the current image Ipr. The first trimmed image, which is the treatment progress information, may be placed at the position of the past image Ipa1 shown in FIG.

[0112] If the characteristics of the treatment area cannot be recognized in the first cropped image, a second cropped image of the area corresponding to the treatment area in the first cropped image can be generated in a past image Ipa before treatment was performed, and the second cropped image can be used as treatment progress information.

[0113] When the past image Ipa1 is applied to the treatment progress information, the treatment progress information may apply a slice position of an organ for which treatment was previously instructed among a slice image group including a plurality of slice images. Note that the slice position of an organ for which treatment was previously instructed described in the embodiment is an example of information specifying the position of a reconstructed image in a reconstructed image group including a plurality of reconstructed images.

[0114] Fig. 7 is a schematic diagram of treatment progress information according to a third specific example. The text box TB shown in the figure is an example of treatment progress information, and includes character information such as a sentence that alerts the user to the presence of an abnormal area Rpa in the previous image Ipa. Symbols and the like may be used in the text box TB. The character information is understood as text data.

[0115] In the text box TB shown in Fig. 7, the type, width, and color of the line applied to the frame surrounding the text information can be specified arbitrarily. In the text box TB shown in the same figure, a mode in which a frame surrounding the text information is not included may be applied.

[0116] When there are multiple pieces of treatment progress information, it is preferable that each piece of treatment progress information is displayed in a manner that distinguishes it from the others. For example, when there are two or more bounding boxes BB shown in FIG. 5, at least one of the types, widths, and colors of the lines constituting each of the two or more bounding boxes BB may be different.

[0117] [Specific examples of obtaining treatment information] Fig. 8 is a schematic diagram of treatment information acquisition according to the first specific example. This figure shows a process of acquiring treatment information from a past image Ipa and a past image Ipa when creating an image interpretation report of a current image Ipr in a current examination. Note that a-month a-day, b-month b-day, and c-month c-day represent any date, with the oldest date being a-month a-day and the newest date being c-month c-day. b-month b-day is a date between a-month a-day and c-month c-day.

[0118] By looking back at past radiology reports, it is possible to ascertain the names of organs for which treatment was previously ordered, the names of lesions for which treatment was previously ordered, the locations of lesions for which treatment was previously ordered, and the treatment methods previously performed. An example of the location of a lesion is the area into which an organ is divided. Examples of treatment methods are the names of surgical procedures, chemotherapy, and radiation therapy.

[0119] For example, in the image interpretation report Rep1 created in the previous examination on the cth day of the cth month, the organ name is liver, the lesion location is the outer zone, and the lesion name is low absorption area. Also, the image interpretation report Rep1 has radiation therapy and surgery as treatment methods.

[0120] Furthermore, in the image interpretation report Rep2 created on b month b day in the examination before last, the organ name is liver, the lesion location is S7, and the lesion name is ischemic nodule. In the image interpretation report Rep3 created on a month a day in the examination before last, the organ name is liver, the lesion location is S7, and the lesion name is ischemic nodule.

[0121] By tracing back the past image Ipa based on the past interpretation report Rep, the positions, shapes, and properties of abnormal regions Rpa1 and Rpa2 in the past image Ipa, which are abnormal regions not present in the current image Ipr, are grasped. Note that the interpretation report Rep is a general term for the interpretation report Rep1, etc. Also, the past image Ipa is a general term for the past image Ipa1, etc.

[0122] 9 is a schematic diagram of the acquisition of treatment information according to the second example. In the figure, a mode of acquiring treatment information using the electronic medical record Ca stored in the hospital information system 16 in addition to the information stored in the radiology department information system 14 is illustrated.

[0123] The electronic medical record Ca contains all information related to the treatment of the subject, and if the subject has a medical history, it is possible to extract information related to the treatment from the electronic medical record Ca. The electronic medical record Ca shown in Figure 9 contains information about radiation therapy on d / d and information about surgery on e / e. Note that d / d and e / e represent arbitrary dates.

[0124] FIG. 10 is a schematic diagram of treatment information acquisition according to a third specific example. This figure illustrates an example in which treatment information is acquired from an examination request Req for the current examination stored in the radiology information system 14. This figure illustrates an example in which the examination purpose, i.e., liver cancer postoperative follow-up, is described in the examination request Req for the current examination. That is, treatment information can be acquired based not only on past information such as past radiological interpretation reports, but also on current information such as the examination purpose included in the examination request Req for the current examination. The examination request Req described in the embodiment is an example of request information.

[0125] [Effects of the image diagnosis support method according to the first embodiment] The image diagnosis support method according to the first embodiment can provide the following advantageous effects.

[0126] [1] For the current image Ipr, treatment progress information such as a bounding box BB shown in Fig. 5 is generated based on the treatment information of the subject of the current image Ipr. The treatment progress information is displayed on the screen on which the current image Ipr is displayed. This makes it possible to grasp the past treatment areas in the current image Ipr even if the past treatment areas have been reduced in size or disappeared in the current image Ipr.

[0127] [2] As the treatment information, past information such as analysis results of past images, first treatment information obtained by analyzing past radiological reports, and second treatment information obtained by analyzing electronic medical records is applied. This allows treatment progress information based on the past information to be generated.

[0128] [3] The treatment information includes the names of organs for which treatment was previously instructed, the names of lesions for which treatment was previously instructed, the positions of lesions for which treatment was previously instructed, and treatment methods previously performed, etc. This generates treatment progress information based on the names of organs for which treatment was previously instructed, etc.

[0129] [4] As the treatment information, the examination purpose etc. included in the current examination request Req is applied. This makes it possible to generate treatment progress information based on the current information.

[0130] [5] As treatment progress information, a bounding box BB representing the past abnormal region Rpa, and a text box TB including a sentence to alert the user that the abnormal region Rpa existed in the past image Ipa1 and the past image Ipa are applied. This makes it possible to grasp the position, shape, and characteristics of the past lesion that has been reduced or disappeared in the current image Ipr.

[0131] [6] As the treatment progress information, a first trimmed image obtained by trimming the same region as the past abnormal region Rpa in the current image Ipr is applied. This makes it possible to grasp the position, shape, properties, etc. of the same region as the past abnormal region Rpa in the current image Ipr.

[0132] [Modification of image diagnosis assistance method] Fig. 11 is a schematic diagram of an image diagnosis assistance method according to a modified example. This figure shows a schematic diagram of a case where the anatomical structure of the current examination target is different from the anatomical structure included in the treatment information. This figure shows a case where the first anatomical structure Or1 of the current examination target is the liver, and the second anatomical structure Or2 included in the treatment information is the pharynx.

[0133] When an abnormal region Rpr was found in the current image Ipr1, which shows the liver and is included in the current image Ipr generated in this examination, checking the past image reading report Rep4 revealed a history of treatment for the pharynx after CCRT for hypopharyngeal cancer.

[0134] In a current image group including a plurality of current images including a current image Ipr1 showing the liver, if a current image Ipr2 showing the pharynx is present, the display is shifted from the current image Ipr1 to the current image Ipr2 and the past image Ipa and the current image Ipr2 are compared.

[0135] That is, the image interpretation information acquisition unit 40 shown in Fig. 2 acquires a past image interpretation report Rep4 as treatment information. The image interpretation information analysis unit 42 analyzes the past image interpretation report Rep4. The treatment progress information generation unit 48 generates a bounding box BB surrounding the pharynx, which is the second anatomical structure Or2, as treatment progress information based on hypopharyngeal cancer, which is treatment information that is the analysis result of the past image interpretation report Rep4. A bounding box BB is generated as treatment progress information for the current image Ipr2 in which the pharynx is shown.

[0136] On the other hand, if the current image Ipr2 showing the pharynx does not exist in the current image group including the current image Ipr1 showing the liver, the acquisition of treatment information, the analysis of treatment information, and the generation of treatment progress information are not performed, and the treatment progress information for the current image Ipr2 showing the pharynx is not displayed. Note that the current image Ipr2 showing the pharynx described in the embodiment is a second diagnostic target image including a second anatomical structure, and is an example of the second diagnostic target image included in the first medical image.

[0137] [Effects of the image diagnosis support method according to the second embodiment] The image diagnosis support method according to the second embodiment can provide the following advantageous effects.

[0138] When the first anatomical structure Or1 of the current examination subject is different from the second anatomical structure Or2 having a past treatment history, if a current image Ipr2 showing the second anatomical structure Or2 having a past treatment history exists in a current image group including the current image Ipr1, treatment progress information for the current image Ipr2 is generated. The treatment progress information for the current image Ipr2 is displayed on the screen on which the current image Ipr2 is displayed. This makes it possible to grasp the position, shape, properties, etc. of the past abnormal region Rpa for the second anatomical structure Or2, which is different from the first anatomical structure Or1 of the current examination subject.

[0139] [Variations in medical images] The slice images applied to the current image Ipr and the past image Ipa may be axial slice images, coronal slice images, or sagittal slice images. The slice thickness of the slice images may be arbitrarily specified.

[0140] The current image Ipr and the past image Ipa may be two-dimensional reconstructed images or three-dimensional reconstructed images. There is no particular limitation on the reconstruction conditions.

[0141] The technical scope of the present invention is not limited to the scope described in the above embodiments. The configurations and the like in each embodiment can be appropriately combined with each other without departing from the spirit of the present invention. [Explanation of symbols]

[0142] 10. Hospital Systems 12 Inspection equipment 14 Radiology Information System 16 Hospital Information Systems 16A Automated Reception System 16B Electronic medical record system 16C Hospital admission and discharge management system 16D Medical accounting system 16E Pharmacy Management System 16F Medical appointment system 18 Image storage and communication system 20 Report Creation System 21 Report creation terminal device 22 Server equipment 23 Database 24 Display terminal 26 Display device 27 Input Devices 30 Image acquisition unit 32 Image processing section 34 Display signal output section 36 Image Analysis Unit 40 Image interpretation information acquisition unit 42 Image interpretation analysis department 44 Medical Record Information Acquisition Department 46 Medical Records Analysis Department 48 Treatment progress information generation unit 52 processors 54 Computer-readable media 56 Communication Interface 58 Input / Output Interface 60 Bus 62 Memory 64 Storage 70 Image Acquisition Program 72 Image Processing Program 74 Image Analysis Programs 76 Display signal generation program 80 Reading information acquisition program 82 Image interpretation analysis program 84 Medical record information acquisition program 86 Medical Record Analysis Program 88 Treatment progress information generation program BB Bounding Box Ipa past images Ipa1 past images Ipa2 past images Ipa3 past images Ipr current image Ipr1 current image Ipr2 current image Or Organ Or1 1st anatomical structure Or2 2nd anatomical structure Rep1 Reading report Rep2 Reading report Rep3 Reading report Rep4 Reading report Rpa Abnormal area in past images Rpa1 Abnormal areas in past images Rpa2 Abnormal areas in past images Rpr Abnormal area in the current image TB Text Box S10 to S28: Each step of the image diagnosis assistance method

Claims

1. one or more processors; one or more memories storing instructions for execution by the one or more processors; Equipped with The one or more processors: Obtaining a first medical image generated by imaging the subject in a latest examination; obtaining treatment information relating to a treatment of the subject; generating treatment progress information regarding a previously treated portion of the subject based on the treatment information; An image diagnosis auxiliary device that performs control to display the treatment progress information on a screen that displays the first medical image.

2. The image diagnosis auxiliary device according to claim 1 , wherein the one or more processors acquire, as the treatment information, information relating to a previously treated part of the subject.

3. The image diagnosis auxiliary device according to claim 2 , wherein the one or more processors acquire, as the information relating to the previously treated part of the subject, text information including a description of the previously treated part of the subject.

4. The image diagnosis auxiliary device according to claim 1 , wherein the one or more processors acquire, as the treatment information, requested information in the latest examination of the subject.

5. The image diagnosis auxiliary device according to claim 4 , wherein the one or more processors acquire, as request information for the latest examination of the subject, text information including a description of a purpose of the latest examination for the subject.

6. The one or more processors:

2. The image diagnosis auxiliary device according to claim 1, wherein at least one of the name of an anatomical structure for which treatment was previously indicated, the name of a lesion for which treatment was previously indicated, the location of a lesion for which treatment was previously indicated, and a treatment method performed in the past is acquired as the treatment information.

7. 2. The image diagnostic support device according to claim 1, wherein the one or more processors are configured to display the treatment progress information for a first diagnostic target image included in the first medical image, the first diagnostic target image including a first anatomical structure of the diagnostic target in the latest examination.

8. The image diagnosis support device according to claim 7 , wherein the one or more processors generate, as the treatment progress information, information specifying a position of the reconstructed image including the past treatment site in a group of reconstructed images including a plurality of two-dimensional reconstructed images.

9. The image diagnostic support device according to claim 7 , wherein the one or more processors apply a segmentation process of the first anatomical structure or a labeling process of the first anatomical structure to the first medical image to identify the previously treated area in the first diagnostic target image.

10. The one or more processors: Obtaining a second medical image generated by imaging the subject in a past examination; The image diagnosis auxiliary device according to claim 7 , wherein the previously treated area in the second medical image is identified by applying a segmentation process of the first anatomical structure or a labeling process of the first anatomical structure to the second medical image.

11. 2. The image diagnostic support device according to claim 1, wherein the one or more processors generate a first cropped image in which a region corresponding to the previously treated area in the first diagnostic object image included in the first medical image is cropped, the first cropped image being a first diagnostic object image including a first anatomical structure of the diagnostic object in the latest examination as the treatment progress information.

12. The one or more processors: Analyzing the first cropped image; generating a second trimmed image in which an area corresponding to the treatment area is trimmed from a past medical image of the subject when a feature in the image related to the treatment area cannot be recognized in the first trimmed image; The image diagnosis auxiliary device according to claim 11 , wherein the second trimmed image is displayed in a region of the first diagnostic object image corresponding to the previously treated site.

13. The one or more processors: When a first anatomical structure of an examination target in the latest examination is different from a second anatomical structure which is a past treatment site of the subject, obtaining the treatment information for the second anatomical structure; generating the treatment progress information for the second anatomical structure based on the treatment information for the second anatomical structure; The image diagnosis support device according to claim 1 , wherein the second diagnostic target image includes the second anatomical structure, and the treatment progress information for the second anatomical structure is displayed for the second diagnostic target image included in the first medical image.

14. The one or more processors: generating a plurality of said treatment progress information; The image diagnosis auxiliary device according to claim 1 , wherein a different display mode is applied to each of the plurality of pieces of treatment progress information.

15. A method for operating an image diagnosis auxiliary device to which a computer is applied, comprising: The image diagnosis auxiliary device includes: Obtaining a first medical image generated by imaging the subject in a latest examination; obtaining treatment information relating to a treatment of the subject; generating treatment progress information regarding a previously treated portion of the subject based on the treatment information; A method for operating an image diagnosis auxiliary device, which controls displaying the treatment progress information on a screen that displays the first medical image.

16. On the computer, A function of acquiring a first medical image generated by photographing a subject in a latest examination; obtaining treatment information relating to a treatment of the subject; A function of generating treatment progress information regarding a past treatment site of the subject based on the treatment information; and A program that realizes a function of controlling the display of the treatment progress information on a screen that displays the first medical image.

Images