Medical image processing apparatus, method of operating the medical image processing apparatus, and program for the medical image processing apparatus

Abstract

Provided are a medical image processing device capable of easily and appropriately selecting a key image, an operation method of the medical image processing device, and a program for the medical image processing device. The medical image processing device comprises a processor which acquires a plurality of medical images including a subject image, analyzes the medical image to add first image information to the medical image, designates the first image information, performs control to display, in a first display area of a display screen, a selected image that is the medical image to which the designated first image information is added, in a display mode for the selected image, among the plurality of medical images, and performs control to display each piece of the designated first image information in a second display area.

Description

Technical Field

[0001] The present invention relates to a medical image processing apparatus, a method of operating the medical image processing apparatus, and a program for the medical image processing apparatus.

Background Art

[0002] In the medical field, images including a subject image acquired for inspection or diagnosis (hereinafter referred to as medical images) are used. The acquired medical images are presented to a doctor. Then, the doctor uses the medical images as one of the materials for judgment and performs diagnosis and the like. Specifically, the medical images include endoscopic images, X-ray images, CT (Computed Tomography) images, or MR (Magnetic Resonan c e) images and the like.

[0003] For example, in an inspection using an endoscopic system, after the inspection is completed, an endoscopist needs to create a report describing the inspection results and findings using the endoscopic images taken by the endoscopic system. However, there has been a problem that it takes time to select the endoscopic images (hereinafter referred to as key images) to be attached to the report, such as when the endoscopist manually selects from a large number of endoscopic images acquired in one inspection.

[0004] Therefore, studies have been made on reducing the burden of key image selection. For example, an information processing apparatus that generates a key image from a taken medical image based on the analysis result of input diagnosis information is known (Patent Document 1). Also, a medical report system that groups and displays medical images having a designated region of interest by designating the region of interest in a medical image is known (Patent Document 2).

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0006] The criteria for key image selection vary for each user of an endoscope system such as a medical facility or an endoscopist, and also vary depending on the purpose of report creation. Reports include, for example, a report for reporting examination results to the doctor in charge of the patient examined by the endoscopist, or a report for notifying the patient of the examination results. Therefore, even when key images are automatically selected, an appropriate selection may not always be made for each individual.

[0007] In addition, the number of endoscope images acquired in a single endoscope examination can be enormous in some cases. If key images are automatically selected without limitation from a large number of endoscope images, the display may be difficult for the user to understand. For example, when the selected key images are displayed on a display while comparing the selected endoscope images with the unselected endoscope images, many endoscope images may be displayed.

[0008] An object of the present invention is to provide a medical image processing apparatus, an operating method of the medical image processing apparatus, and a program for the medical image processing apparatus that can simply and appropriately select key images.

Means for Solving the Problems

[0009] The medical image processing apparatus of the present invention includes a processor. The processor acquires a plurality of medical images including subject images, analyzes the medical images, assigns at least one of a plurality of preset first image information to the medical images, designates at least one of the plurality of first image information, and controls to display, in a display mode for the selected image, a selected image that is a medical image to which the designated first image information is assigned in a first display area of an image display screen, and controls to display each of the designated first image information in a second display area of the image display screen.

[0010] The processor preferably analyzes a medical image, assigns at least one of a plurality of preset second image information to the medical image, and sets a display mode for a selected image based on the second image information.

[0011] Each of the plurality of preset first image information is set after being associated with at least one of a plurality of categories, and the processor preferably makes a designation for each category.

[0012] The processor preferably controls to display the plurality of first image information in the third display area of the image display screen for each category, and makes a designation based on the user's selection of the plurality of first image information displayed in the third display area.

[0013] Each of the plurality of preset second image information is preferably set after being associated with at least one of a plurality of categories.

[0014] The category is preferably at least one of information regarding a part included in the subject image, information regarding the imaging conditions of the medical image, information regarding a lesion included in the subject image, information regarding a region of interest included in the subject image, and information regarding an instrument for treatment included in the subject image.

[0015] The processor preferably sets the maximum number of selected images to be displayed in the first display area, and controls to display the selected images in the number equal to or less than the set maximum number in the first display area.

[0016] The processor preferably performs analysis based on first correspondence information in which a medical image including the first image information and the first image information are pre-associated.

[0017] The processor preferably performs analysis based on second correspondence information in which a medical image including the second image information and the second image information are pre-associated.

[0018] It is preferable that the processor saves the specified setting as a display setting and displays the selected image on the image display screen based on the display setting.

[0019] The display setting is preferably saved for each user.

[0020] The display setting is preferably saved for each user group including a plurality of users.

[0021] The display setting is preferably saved for each purpose of shooting.

[0022] The operation method of the medical image processing apparatus of the present invention includes an image acquisition step of acquiring a plurality of photographed medical images, an image information assignment step of assigning at least one of a plurality of preset first image information to the medical image by analyzing the medical image, a first image information designation step of designating at least one of the plurality of first image information, and a display control step of performing control to display a selected image, which is a medical image to which the designated first image information is assigned, in a display mode for the selected image in a first display area of the image display screen, and performing control to display each of the designated first image information in a second display area of the image display screen.

[0023] The program for a medical image processing apparatus of the present invention is a program for a medical image processing apparatus installed in a medical image processing apparatus, and causes a computer to have an image acquisition function of acquiring a plurality of photographed medical images, an image information assignment function of assigning at least one of a plurality of preset first image information to the medical image by analyzing the medical image, a first image information designation function of designating at least one of the plurality of first image information, and a display control function of performing control to display a selected image, which is a medical image to which the designated first image information is assigned, in a display mode for the selected image in a first display area of the image display screen, and performing control to display each of the designated first image information in a second display area of the image display screen.

Advantages of the Invention

[0024] According to the present invention, the key image can be selected simply and appropriately.

Brief Description of Drawings

[0025]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Mode for Carrying Out the Invention

[0026] In this embodiment, an endoscopic image is used as an example of a medical image. The endoscopic image is an example of a medical image.

[0027] The endoscopic image viewing support system 10 shown in FIG. 1 is a computer system used to support the viewing of endoscopic images 100 (see FIG. 2) obtained by endoscopic examinations, and is connected to the endoscopic system 14 via a network 12. The network 12 is, for example, a LAN (Local Area Network) within a hospital. The endoscopic system 14 includes an endoscope 15, a light source device 16, a processor device 17, a display 18, and a keyboard 19 which is an input device.

[0028] The endoscopic system 14 is used for endoscopic examinations (including various procedures using the endoscope 15). The endoscopic examination is carried out, for example, by an endoscopist who has received a request from the patient's attending doctor, and a plurality of endoscopic images 100 are obtained by carrying out the endoscopic examination. The endoscopic images 100 taken by the endoscopic system 14 are stored in the endoscopic image viewing support system 10.

[0029] The endoscopic image viewing support system 10 includes an endoscopic image viewing support server 20, a client terminal 21, and a server group 22, and these are connected via a network 24 such as a LAN.

[0030] The endoscopic image viewing support server 20 is a medical image processing apparatus of the present invention, which supports a user in selecting a key image from among a plurality of endoscopic images 100, and creates an inspection report 34 (see FIG. 3) using the selected key image. The inspection report 34 is a report in which a doctor such as an endoscopist who has performed an endoscopic examination summarizes medical findings by viewing the endoscopic images 100. The endoscopic image 100 that is the basis of the finding, which is the key image, is attached to the inspection report 34. The inspection report 34 is provided for viewing by the doctor in charge, such as the attending doctor of the patient who has undergone the endoscopic examination, and is used for diagnosing the patient and the like.

[0031] The server group 22 consists of an image server 26 and a report server 28. The image server 26 includes an image database (hereinafter referred to as image DB) 30. The endoscopic images 100 transmitted from the endoscopic system 14 are stored in the image DB 30. The report server 28 includes a report database (hereinafter referred to as report DB) 32. The inspection reports 34 created along with the implementation of the endoscopic examination are stored in the report DB 32. The image DB 30 and the report DB 32 are databases that can be searched by, for example, a patient ID (Identification Data) assigned to each patient, or an inspection ID assigned to each endoscopic examination.

[0032] The client terminal 21 is a terminal for viewing the endoscopic images 100 and the inspection reports 34, etc., and is used by an endoscopist to view the endoscopic images 100 or create the inspection reports 34 after the inspection is completed. Also, the client terminal 21 is used by the attending doctor, who is a doctor in the department that requested the endoscopic examination, to view the endoscopic images 100 and the inspection reports 34.

[0033] The client terminal 21 is, for example, a notebook or desktop personal computer or the like. When the endoscopist creates an inspection report 34 after the inspection, the client terminal 21 is used to access the endoscope image viewing support server 20. Then, the stored endoscope image 100 or inspection report 34 is read out, displayed on the display of the client terminal 21, necessary operations are performed, and the inspection report 34 is completed. The completed inspection report 34 is stored in the report server 28 via the endoscope image viewing support server 20.

[0034] The image DB 30 is provided with a plurality of image folders (not shown). When an endoscopy is performed once, one image folder corresponding to this endoscopy is created. And in each image folder, the endoscope image 100 obtained by the corresponding endoscopy is stored. As described above, in the endoscopy, in addition to video shooting, still image shooting at an arbitrary timing by the freeze switch of the endoscope, automatic shooting performed at a predetermined time interval, test shooting, etc. are also performed, and the images obtained by these shootings are all stored as the endoscope image 100 in the image folder 36.

[0035] As shown in FIG. 2, these endoscope images 100 are stored in the image folder as shooting information 102 in which an inherent image ID, shooting time, and additional information 101 such as illumination light information 101A in the endoscope system 14 used at the time of shooting are associated. The additional information 101 recorded in each endoscope image 100 is used, in some cases, as second image information described later, for the selection of key images or for rearrangement when displaying key images on the display.

[0036] The image folder is created in the image server 26 when storing the endoscope image 100 in units of inspection transmitted from the endoscope system 14. The image folder may be created on the endoscope system 14 side, and the image server 26 may receive it for each image folder. Also, in the image DB 30, if the endoscope images 100 are stored in a form in which a plurality of endoscope images 100 can be read out in units of inspection, such as tagging the endoscope images 100 in units of inspection, the image folder may not be necessary.

[0037] The report DB32 is provided with a plurality of report folders (not shown). The inspection report 34 created for each endoscopic examination is stored in the report folder. For the inspection report 34 as well, similar to the endoscopic image 100, if it is stored in the report DB32 in a form that can be read out for each endoscopic examination, such as tagging the inspection report 34 in units of inspections, it is not necessary to provide a report folder.

[0038] As shown in FIG. 3, the inspection report 34 and the report display screen 103 when displaying the inspection report 34 are composed of a report body 34A, and the above-described inspection identification information, patient identification information, and author information indicating the author. The report body 34A has the findings 104 of the examining doctor of the endoscopic examination and a key image 100S which is the endoscopic image 100 attached to the inspection report 34. The key image 100S is the endoscopic image 100 that serves as the basis for the findings 104 and is attached in association with each endoscopic examination. FIG. 3 shows an example in which two endoscopic images 100 with image IDs A13 and A24 are associated with the first finding 104 (finding No1), and one endoscopic image 100 with image ID A37 is associated with the second finding 104 (finding No2).

[0039] In creating the inspection report 34, the endoscopic image browsing support server 20 automatically selects the endoscopic image 100 that is the key image from among the plurality of endoscopic images 100 obtained for each endoscopic examination based on the user's designation or the like, attaches the selected endoscopic image 100 in accordance with the format of the inspection report 34, and also automatically lays out the inspection identification information and patient identification information and the like from the incidental information 101 associated with the endoscopic image 100.

[0040] The endoscope image viewing support server 20, the client terminal 21, the image server 26 and the report server 28 that make up the server group 22 are configured by installing a control program such as an operating system and an application program such as a client program or a server program on a computer such as a personal computer, a server computer, or a workstation.

[0041] As shown in FIG. 4, the computers that make up each of the servers 20, 26, 28 and the client terminal 21 have the same basic configuration, and each includes a CPU (Central Processing Unit) 40, a memory 42, a storage device 44, a communication I / F (Interface) 46, and an input / output unit 48. These are connected via a data bus 50. The input / output unit 48 consists of a display 52 and an input device 54 such as a keyboard or a mouse.

[0042] The storage device 44 is, for example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive), etc., and stores a control program or an application program (hereinafter referred to as an AP) 56. Also, in the servers 26 and 28 where a DB is constructed, in addition to an HDD or the like for storing programs, as a storage device 44 for the DB, for example, a disk array with multiple HDDs or the like connected in series is provided. Note that the disk array may be built into the server body, or may be provided separately from the server body and connected to the server body through a network such as a LAN. Also, as the storage device 44, cloud storage connected through the Internet may be used.

[0043] Memory 42 is a work memory for the CPU 40 to execute processing, and is composed of a RAM (Random Access Memory). The CPU 40 loads the control program stored in the storage device 44 into the memory 42 and executes processing according to the program, thereby comprehensively controlling each part of the computer. The communication I / F 46 is a network interface that performs transmission control with the network 12.

[0044] On the client terminal 21, a client program is installed as the AP 56. The client program accesses the endoscope image browsing support server 20 and transmits various requests such as a browsing request or an update request for an image display screen such as a display image setting screen 105 (see FIG. 9) or a key image automatic selection screen 106 (see FIG. 11) for selecting a key image, or a function of receiving and displaying an image display screen sent from the endoscope image browsing support server 20 to the client terminal 21. The client program is a program for causing the client terminal 21 to execute the above functions. Note that the client program may be programmed specifically for the endoscope image browsing support system 10, or may include a well-known web browser.

[0045] As shown in FIG. 5, when the client program is started, a start screen 58 having an operation function by a GUI (Graphical User Interface) is displayed on the display 52 of the client terminal 21, and the CPU 40 of the client terminal 21 functions as a GUI control unit 60 and a request issuing unit 62 that issues various requests to the endoscope image browsing support server 20 in cooperation with the memory 42 and the like.

[0046] On the startup screen 58, an inspection ID input field 58A and a decision button 58B are provided. By entering an inspection ID in the inspection ID input field 58A and operating the decision button 58B, one endoscopic examination can be specified from among a plurality of endoscopic examinations. When an endoscopic examination is specified, the information entered in the inspection ID input field 58A is transmitted from the GUI control unit 60 to the request issuing unit 62. The request issuing unit 62 generates a distribution request for an image display screen for selecting an endoscopic image 100 to be attached to a report in the endoscopic image 100 of the specified endoscopic examination, that is, the endoscopic examination corresponding to the inspection ID entered in the inspection ID input field 58A, and issues it to the endoscopic image viewing support server 20. In response to this distribution request, an image display screen in an initial state or according to a previously saved setting is distributed from the endoscopic image viewing support server 20 and displayed on the display 52 of the client terminal 21.

[0047] The image display screen is composed of data described in a markup language such as XML (Extensible Markup Language), and these image display screens themselves also have an operation function by GUI. The GUI control unit 60 receives operation instructions from the input device 54 through the image display screen, such as an input operation from the keyboard or a click operation on an operation button by the mouse pointer 108. The request issuing unit 62 issues an update request for the image display screen and the like according to the operation instruction received by the GUI control unit 60.

[0048] The update request includes various instructions for selecting a key image via the image display screen, switching instructions for the endoscopic image 100 to be displayed, etc., and instructions for updating the display content of the image display screen. When the update request is transmitted to the endoscopic image viewing support server 20, the endoscopic image viewing support server 20 updates the image display screen and distributes the updated image display screen to the client terminal 21. Thereby, the image display screen displayed on the client terminal 21 is updated.

[0049] As shown in FIG. 6, the server program installed as AP56 in the endoscopic image viewing support server 20 is an operation program for causing a computer to function as the endoscopic image viewing support server 20. When the server program is started, the CPU 40 of the endoscopic image viewing support server 20 functions as a reception unit 70, an image acquisition unit 71, an image information adding unit 72, a first image information specifying unit 73, a display control unit 74, and a storage control unit 75 in cooperation with the memory 42 and the like.

[0050] The reception unit 70 receives inputs from various terminals. The reception unit 70 receives a distribution request or an update request for an image display screen input from the client terminal 21, and outputs these requests to the display control unit 74. The distribution request for the image display screen requests the distribution of an image display screen that displays an endoscopic image 100 selected from a plurality of endoscopic images 100 specified by the inspection ID input in the inspection ID input field 58A of the start screen 58. When the reception unit 70 receives a distribution request, it inputs the inspection ID (the inspection ID input in the inspection ID input field 58A) specified by the distribution request to the image acquisition unit 71. Note that the update request includes at least one specification of a plurality of pieces of first image information, specification information for specifying at least one of the second image information, or various settings, which will be described later. The specification information is input to the image information adding unit 72 and the first image information specifying unit 73.

[0051] When the inspection ID is input, the image acquisition unit 71 accesses the image server 26 and acquires all the endoscopic images 100 obtained in the endoscopic examination corresponding to the notified inspection ID from the image DB 30. Specifically, the image acquisition unit 71 searches the image DB 30 using the inspection ID as a search keyword, and reads and acquires the shooting information 102 having the common inspection ID from the image folder 36 of the image DB 30. As described above, the shooting information 102 includes the endoscopic image 100 and the attached information 101 recorded in association with the endoscopic image 100. Thereby, a plurality of endoscopic images 100 in units of inspections obtained in one endoscopic examination and the attached information 101 recorded in association with the endoscopic images 100 are all acquired. The image acquisition unit 71 outputs the acquired shooting information 102 to the image information adding unit 72.

[0052] The image information adding unit 72 adds at least one of a plurality of preset first image information to the endoscopic image 100 by analyzing the endoscopic image 100. Specifically, the addition of the first image information to the endoscopic image 100 is realized by adding the first image information to the attached information 101 included in the shooting information 102, or, when the first image information is already included in the information included in the attached information 101, by adding information indicating that this information is the first image information. Therefore, adding information indicating that any of the information included in the attached information 101 in advance is the first image information is also included in the analysis of the endoscopic image 100. There may be a plurality of first image information to be added.

[0053] As shown in FIG. 7, the image information adding unit 72 includes a first image information adding unit 81 and a second image information adding unit 82. The first image information adding unit 81 includes a first image information list 83, and the second image information adding unit 82 includes a second image information list 84. The second image information will be described later.

[0054] The first image information list 83 is a list in which a plurality of first image information is described and is preset. Each of the plurality of first image information is preferably set after being associated with at least one of a plurality of categories. Therefore, in the first image information list 83, each of the plurality of first image information is described after being associated with at least one of a plurality of categories.

[0055] One of the plurality of categories is, for example, information regarding the part included in the subject image. When setting the category of the part, part names such as, for example, "esophagus", "esophagogastric junction", "greater curvature of the gastric body", "vestibule", "gastric angle", "fornix", or "descending part of the duodenum", which are specific item names included in the category of the part, are preset as the first image information.

[0056] As other categories, information regarding imaging conditions of medical images, information regarding lesions included in the subject image, information regarding regions of interest included in the subject image, or information regarding treatment instruments included in the subject image, etc. can be cited.

[0057] The information regarding imaging conditions is information regarding imaging when acquiring medical images. When setting the category of imaging conditions, for example, the type of illumination light, the distance between the subject and the tip of the endoscope, the exposure, or the type of endoscope used, etc. are set as the first image information. When setting the information regarding lesions included in the subject image in the category, for example, whether the subject image has a lesion, the size of the lesion, or the type of the lesion, etc. are set as the first image information. When setting the information regarding regions of interest included in the subject image in the category, whether the subject image has a region of interest, the size of the region of interest, or biological information such as the oxygen saturation of the region of interest, etc. are set as the first image information. When setting the information regarding treatment instruments included in the subject image in the category, whether the subject image has a treatment instrument, the type of the treatment instrument, or whether it is a specimen collection image, etc. are set as the first image information. Note that when the first image information is the information regarding treatment instruments, the first image information can be set as a "specimen collection image". This is because it is possible to analyze whether it is a scene where a specimen is being collected based on the type of treatment instrument included in the subject image. These first image information are stored in advance and used in the first image information list 83.

[0058] The first image information adding unit 81 analyzes the endoscopic image 100 through image processing, and adds at least one of a plurality of preset first image information to the endoscopic image 100. The plurality of preset first image information is the first image information included in the first image information list 83. Also, it is preferable that the first image information adding unit 81 analyzes the endoscopic image 100 for each category included in the first image information list 83. For example, when the first image information list 83 has a category of information regarding the part included in the subject image, the endoscopic image 100 is analyzed regarding the category of this part, and the first image information included in the category of the part is added to the endoscopic image 100. Also, when the first image information list 83 has a plurality of categories, the endoscopic image 100 is analyzed for each category, or the endoscopic image 100 is analyzed regarding the first image information included in the plurality of categories.

[0059] The first image information adding unit 81 adds the first image information to the endoscopic image 100 by writing the first image information into the attached information 101 of the endoscopic image 100. If for some reason the preset first image information cannot be added to the endoscopic image 100, for example, "unknown" is added as the first image information so that the user or the like can recognize this fact. Therefore, "unknown" or the like is written in the column of the first image information of the attached information 101 of this endoscopic image 100.

[0060] Analysis by image processing of the endoscopic image 100 can adopt various image processing methods for discriminating or recognizing the first image information. Among them, it is preferable to prepare an endoscopic image determined to include the first image information and perform the analysis based on the correspondence information in which this endoscopic image and the first image information are associated in advance. The correspondence information is preferably a learned model in machine learning technology. Therefore, for example, when the category of the first image information is a part, a learned model obtained by performing learning multiple times using learning data that associates an endoscopic image taken with a specific part as the subject and a part name, for example, "esophagus", is used to analyze the endoscopic image 100 in which the part included in the subject image is unknown, and the part name included in the subject image can be obtained as the analysis result. Specifically, when the part shown in the endoscopic image 100, that is, the part included in the subject image is the "esophagus", by analyzing using the above-mentioned learned model, an analysis result of "esophagus" can be obtained as the first image information.

[0061] The first image information specifying unit 73 specifies at least one of the plurality of first image information. By specifying the first image information, among the plurality of endoscopic images 100, the shooting information 102 having the specified first image information in the attached information 101 and the shooting information 102 not having the specified first image information in the attached information 101 can be classified. For example, the plurality of first image information are specific plurality of part names when the first image information is the category of the part. Therefore, for example, by specifying the part name to be attached to the inspection report 34 from the plurality of part names, the endoscopic image 100 having this part name in the shooting information 102 can be extracted.

[0062] As described above, the designation of the first image information is performed, for example, by the user selecting the first image information via a display image setting screen 105 or the like input from the client terminal 21. Specifically, when the first image information is a part name, the user selects the first image information by inputting at least one part name that is the first image information, such as "esophagus", into the client terminal 21. The input information is received by the first image information designating unit 73 as designation information, and the first image information designating unit 73 classifies the first image information included in the imaging information 102 into those having "esophagus" and those not having it. Then, it is written in the additional information 101 of the endoscope image 100 having "esophagus" in the first image information that this endoscope image 100 is the designated first image information.

[0063] The display control unit 74 includes a display mode setting unit 91, a screen data generation unit 92, and an output control unit 93. The endoscope image 100 is directly input from the image acquisition unit 71 to the screen data generation unit 92.

[0064] Also, the display control unit 74 uses, as a selected image, the endoscope image 100 to which the designated first image information is assigned among the plurality of endoscope images 100 input via the first image information designating unit 73. Then, control is performed to display the selected image in a display mode for the selected image based on the setting of the display mode setting unit 91 in the first display area of the image display screen. Also, control is performed to display each of the designated first image information in the second display area of the image display screen. The display mode for the selected image can be set in advance. Also, the display mode for the selected image may be set by the display mode setting unit 91 based on second image information described later.

[0065] The image display screen includes a first display area and a second display area, and the selected image is controlled to be displayed in the first display area in a display mode for the selected image. Also, each of the plurality of first image information is controlled to be displayed in the second display area. The selected image and each of the plurality of first image information are displayed, for example, within the key image automatic selection screen 106. The key image automatic selection screen 106 corresponds to the image display screen. Therefore, the first display area and the second display area can be the display areas within the key image automatic selection screen 106. For example, the key image automatic selection screen 106 is divided into two, with one being the first display area and the other being the second display area. Note that the key image automatic selection screen 106 is displayed on the display 52.

[0066] For the selected image, control is performed to display it in the first display area of the key image automatic selection screen 106 in a display mode for the selected image. The display mode for the selected image includes the mode of the position of where to display the selected image in the first display area and / or the mode of the display method such as emphasizing and displaying a specific selected image in comparison with other selected images. Regarding the mode of the position, there is one or a plurality of selected images. In the case of a plurality, since the area of the first display area is limited, further selection of the selected images to be displayed or priority is assigned, and the display position is controlled for display. The display mode for the selected image can be set in advance. Regarding the mode of the display method, various highlighting displays and the like can be mentioned.

[0067] For each of the specified first image information, control is performed to display it in the second display area of the image display screen. For example, when the first image information is the category of the part, all the part names of the specified first image information are respectively displayed in the second display area. Thereby, it is possible to immediately grasp which first image information the selected key image is based on. Therefore, when attempting to create the inspection report 34 attached with the desired endoscopic image 100, it is also possible to immediately grasp how to re-specify the first image information in order to adjust the insufficient endoscopic image 100 or the excessive endoscopic image 100.

[0068] The screen data generation unit 92 generates and updates a key image automatic selection screen 106 for displaying each of the endoscopic image 100, which is a selected image input to the screen data generation unit 92, or the designated first image information, based on the set display mode for the selected image. The screen data generation unit 92 appropriately uses the imaging information 102 including the endoscopic image 100 and the attached information 101, and the first image information, etc., according to the screen requested by the client terminal 21. When generating and updating the key image automatic selection screen 106, the screen data generation unit 92 creates the key image automatic selection screen 106 using the display mode for the selected image, or the endoscopic image 100 which is the selected image, and the attached information 101 recorded in association with these endoscopic images 100.

[0069] The generated and updated key image automatic selection screen 106 is input to the output control unit 93. The output control unit 93 distributes the input key image automatic selection screen 106 to the client terminal 21 which is the request source. At the client terminal 21, the key image automatic selection screen 106 distributed from the output control unit 93 is displayed on the display 52. The user can grasp whether there is an appropriate amount of the endoscopic image 100 to be attached to the inspection report 34 by the key image automatic selection screen 106 displayed on the display 52.

[0070] Using the flowchart shown in FIG. 8 and the explanatory diagrams shown in FIGS. 9 to 14, the flow of key image automatic selection will be specifically described, including the acquisition of the endoscopic image 100 in the endoscopic image browsing support server 20, the provision of the first image information, the designation of the first image information, and the display of the selected image and the first image information on the display.

[0071] In this embodiment, in the key image automatic selection, the display screens of the display image setting screen 105 (see FIG. 9) and the key image automatic selection screen 106 (see FIG. 10) are displayed on the display 52. The display image setting screen 105 is a screen for setting the endoscopic image to be displayed on the key image automatic selection screen 106, and the display image setting screen 105 and the key image automatic selection screen 106 have a similar layout.

[0072] First, when receiving a distribution request from the client terminal 21 as described above, the image acquisition unit 71 searches the image DB 30 and reads and acquires from the image DB 30 the imaging information 102 of the inspection unit obtained in one endoscopic examination, that is, a plurality of endoscopic images 100, and the additional information 101 recorded in association with the endoscopic image 100 (S11).

[0073] Next, for each of the plurality of endoscopic images 100 of the acquired inspection unit, the image information adding unit 72 performs analysis on the first image information (S12). The first image information can be selected from a plurality of categories as described above, but is preset according to the user's selection or the like.

[0074] As shown in FIG. 9, the user presets the first image information using the display image setting screen 105. The display image setting screen 105 includes a category setting button (not shown). The user operates the category setting button to set at least one of the categories. In the present embodiment, the category of the part is set. A plurality of part names are preset as the first image information for each part category. Therefore, when the part category is selected, a plurality of part names are set as the first image information, and the image information adding unit 72 performs analysis on the endoscopic image 100 such that the part name, which is the first image information, becomes the analysis result.

[0075] In this way, the plurality of preset first image information is displayed in the non-selection area 105b of the display image setting screen 105, which is one of the display screens, for each category. The non-selection area 105b corresponds to the third display area.

[0076] A plurality of first image information blocks 105c indicating the part names included in the part category are displayed in the non-selection area 105b. One first image information block 105c indicates one first image information. Since the first image information block 105c displays the first image information, the part name is displayed in the present embodiment. However, when a category other than the part is set, the first image information including the set category is displayed.

[0077] By analyzing the endoscopic image 100 by the image information adding unit 72, the first image information of the set category is added to the endoscopic image 100 (S13). In the present embodiment, since the category of the site is set, the image information adding unit 72 analyzes each of the acquired plurality of endoscopic images 100, and adds the site name described in the first image information block 105c to each of the endoscopic images 100. In the figure, for the sake of avoiding complication of the figure, reference signs may be attached only to a part of the figure.

[0078] At least one of the plurality of first image information set as described above is specified (S14). The specification is performed by the user, but in some cases, such as when performing the same specification as the previous time, it is performed by someone other than the user. Thus, it is preferable to specify the first image information based on the user's selection of the plurality of first image information displayed in the non-selection area 105b. In the present embodiment, the first image information is specified using the first image information block 105c indicating the site name, which is displayed in the non-selection area 105b of the display image setting screen 105.

[0079] When the user specifies the first image information, the first image information block 105c in the non-selection area 105b is specified and dragged by the pointer 108, and moved to be included in the selection area 105a. The first image information block 105c included in the selection area 105a is the first image information specified by the user. In the selection area 105a, the specified first image information is highlighted and displayed. In the embodiment shown in FIG. 9, the first image information of the "esophagogastric junction" is one of the plurality of specified first image information. By repeating such an operation by the user, a plurality of first image information is specified.

[0080] As shown in FIG. 10, as a result of the specification by the user, in the display image setting screen 105, the selection area 105a includes five types of first image information blocks 105c, and the first image information specified by the user is five types of site names.

[0081] In the above manner, the first image information is specified. In FIG. 10, in the non-selection area 105b, the first image information block 105c that has not been specified is displayed. The first image information specifying unit 73 specifies the first image information based on the user's specification. Therefore, the first image information specifying unit 73 uses the part name indicated in the first image information block 105c moved to the selection area 105a as the specified first image information. Since the part name is given to the plurality of acquired endoscopic images 100 by the image information adding unit 72, the endoscopic image 100 having the part name that is the specified first image information is selected from the plurality of acquired endoscopic images 100 and set as the selected image. In this way, it is preferable that the first image information specifying unit 73 specifies the first image information based on the plurality of first image information displayed in the selection area 105a.

[0082] Here, by switching the category of the first image information, it is possible to specify the first image information other than the category of the part. As shown in FIG. 11, on the display image setting screen 105, similar to the case of the category of the part, the category is switched to the category of information regarding the treatment tool by a category setting button (not shown).

[0083] In the non-selection area 105b, two first image information blocks 105c, namely, "specimen collection image" and "non-specimen collection image", are displayed as the category of information regarding the treatment tool included in the subject image. Also, two first image information blocks 105c, namely, "lesion image" and "non-lesion image", are displayed as the category of information regarding the lesion included in the subject image. In this way, it may be controlled to display the first image information blocks 105c of a plurality of categories in the non-selection area 105b according to the area of the display area or the like. Similar to the case of the above-described category of the part, the user moves the first image information block 105c from the non-selection area 105b to the selection area 105a to specify the first image information of each category.

[0084] In the present embodiment, from the categories of information regarding the treatment instrument, "specimen collection image" is designated as the first image information, and from the categories of information regarding the lesion, "lesion image" is designated as the first image information. Similar to the case of the category of information regarding the site, the image information providing unit 72 performs analysis for providing the first image information of "specimen collection image" to the endoscopic image 100 including a scene where a specimen is being collected in the subject image. Further, analysis for providing the first image information of "lesion image" to the endoscopic image 100 including a lesion in the subject image is performed. The method of analysis can be the same as in the case of the category of the site. By analyzing the endoscopic image 100 by the image information providing unit 72, the first image information of the set category is provided to the endoscopic image 100, and the endoscopic image 100 having the designated first image information becomes the selected image.

[0085] As described above, when each of the preset first image information is set in association with at least one of a plurality of categories, it is preferable to specify the first image information for each category. This is because by setting the categories, it becomes possible to easily and flexibly select the endoscopic image 100 according to the user's wishes when creating the inspection report.

[0086] Note that the schema display 105h on the display image setting screen 105 and the schema display 106h on the key image automatic selection screen 106 are fixedly displayed in advance as information for reference of the posting site in the inspection report 34.

[0087] As shown in FIG. 12, on the display image setting screen 105, the selection area 105a includes seven types of first image information blocks 105c, and the first image information designated by the user is five types of sites, specimen collection images, and lesion images. The user confirms that all the first image information desired as the key image is included in the display of the selection area 105a and ends the movement of the first image information block 105c.

[0088] The display control unit 74 displays the selection image and the first image information on the display 52 by displaying the key image automatic selection screen 106 (S15). As shown in FIG. 13, the selection image 106c is automatically displayed in the selection image display area 106b of the key image automatic selection screen 106 in a display mode for the selection image. The selection image display area 106b corresponds to the first display area.

[0089] In the present embodiment, the display mode for the selection image is preset content and is highlighted display. Therefore, in the selection image display area 106b, the selection image 106c is highlighted and displayed. Among the endoscopic images 100 acquired in the inspection, the non-selection image 106d that does not become the selection image 106c is displayed so as not to be conspicuous, for example, by lightening the color, and the selection image 106c is highlighted. Since the area of the selection image display area 106b is limited, depending on the setting of the size for displaying a single endoscopic image 100, etc., it may not be possible to display all the selection images 106c on one screen. In this case, the hidden selection image 106c can be displayed by moving and scrolling the screen of the selection image display area 106b by moving the scroll bar 106e. Thus, it is preferable that the display mode for the selection image highlights and displays the selection image 106c.

[0090] Note that in the present embodiment, in the selection image display area 106b, the non-selection image 106d is also displayed and all the inspection images are set to be displayed, but it can also be set to display only the selection image 106c.

[0091] Also, on the key image automatic selection screen 106, each of a plurality of pieces of first image information is displayed in the selection category display area 106a. The selection category display area 106a corresponds to the second display area. Since the first image information is a part name or the like, a plurality of designated first image information blocks 105c are arranged and displayed together with the part name or the like in the selection category display area 106a. The first image information block 105c displays a part name or the like and a representative image of the endoscope image 100 to which the part name or the like is assigned. Therefore, it is possible to grasp at a glance the designated part name or the like and the endoscope image 100 to which the part name or the like is assigned.

[0092] Also, since the key image automatic selection screen 106 has the same layout as the display image setting screen 105, the first image information block 105c selected in the selection area 105a on the display image setting screen 105 is also displayed in the same manner in the selection category display area 106a. Therefore, it is possible to easily grasp which image has been selected as the key image based on the selected part name.

[0093] As shown in FIG. 14, when viewing the key image automatic selection screen 106 and the key image, which is the selected image 106c, is different from the user's expectation, by clicking the pop-up button 106g of the first image information block 106f shown in the selected category display area 106a, the first image information included in the same category as the first image information block 106f is listed and displayed by the first image information list 106i, and the first image information can be specified again from among them. In the first image information list 106i, the specified first image information and the unspecified first image information included in the same category are displayed separately. Also, the first image information block 106f that has been clicked on the pop-up button 106g is highlighted and displayed. The first image information clicked on the first image information list 106i can be swapped with the first image information that has been displayed up to that point. Therefore, in the case of FIG. 14, "descending part of the duodenum" can be swapped with the clicked first image information. Alternatively, a switching button (not shown) to the display image setting screen 105 set in the key image automatic selection screen 106 may be clicked to specify the first image information again. By repeating these operations, a more optimal key image selection can be made.

[0094] The user checks the part name in the selected category display area 106a and all the selected images 106c displayed by scrolling the selected image display area 106b, completes the key image selection operation, and clicks a completion button (not shown) set within the key image automatic selection screen 106 to create a report. Alternatively, pressing a report creation button (not shown) also completes the key image selection operation and creates a report. When the key image selection operation is completed, various settings for the key image selection used in this report creation are saved. The control of saving various settings and specifications, saving the endoscopic image 100, and saving the inspection report 34 is performed by the save control unit 75.

[0095] According to the endoscopic image browsing support server 20, which is a medical image processing apparatus configured as described above, by specifying the category of the endoscopic image 100, which is the first image information, by the user, the key images desired by the user can be automatically selected from a large number of endoscopic images 100. Therefore, the selection of key images is simple. Also, since these specifications are made on the display screen of the display 52, the key images can be selected more simply and understandably. Further, since these specifications are made by arbitrarily selecting the first image information, it is possible to flexibly conform to various key image selection criteria of the user, and appropriate key image selection for individual users is possible. Also, when selecting key images, it is not necessary for the user to check a large number of captured endoscopic images 100, so the work efficiency of key image selection is improved.

[0096] Also, since the specified first image information and the endoscopic image 100 selected as the key image can be confirmed, for example, by the key image automatic selection screen 106 or the like, it is possible to easily confirm what the first image information specified as the key image is, and which endoscopic image 100 was selected by that specification. After confirmation, it is also easy to re-specify the first image information again, and by making the specification multiple times, it is possible to more automatically select appropriate key images for the user. Therefore, the endoscopic image browsing support server 20 can simply and appropriately select key images.

[0097] Note that the display mode setting unit 91 preferably assigns at least one of a plurality of preset second image information to the medical image and sets the display mode for the selected image based on the second image information. By setting the display mode for the selected image based on the second image information, the user can flexibly select key images by combining the specification of the first image information and the second image information. Thereby, the user can more simply and appropriately select key images.

[0098] The second image information is the same as the first image information and is attached to the endoscopic image 100 in the same manner as the first image information. Similar to the first image information, the second image information can be information regarding the part included in the subject image, information regarding the imaging conditions of the medical image, information regarding the lesion included in the subject image, information regarding the region of interest included in the subject image, or information regarding the treatment tool included in the subject image.

[0099] The image information providing unit 72 includes a second image information providing unit 82, and the second image information providing unit 82 includes a second image information list 84 (see FIG. 7). The second image information list 84 included in the second image information providing unit 82 is the same as the first image information list 83 and is a list in which the second image information is described.

[0100] When providing the second image information, the image information providing unit 72 analyzes the endoscopic image 100 and provides at least one of a plurality of preset second image information to the endoscopic image 100. Specifically, the provision of the second image information to the endoscopic image 100 is achieved by adding the second image information to the supplementary information 101 included in the imaging information 102, or when the second image information is already included in the information included in the supplementary information 101, by adding information indicating that this information is the second image information. A plurality of second image information may be provided. Also, as described above, it is preferable that the second image information is also set after being associated with at least one of a plurality of categories, similar to the first image information.

[0101] Which second image information to set can be set by the user. For example, it can be set by specifying on the display 52 via the display image setting screen 105. Note that since the second image information is an item for selecting and / or rearranging the endoscopic image 100 when displaying the selected image on the display 52, a plurality of them can be selected and combined for use. As categories of the second image information, shooting conditions such as illumination light information 101A when the endoscopic image 100 is shot, the presence or absence of lesions when the endoscopic image 100 is analyzed by image processing, the presence or absence of regions of interest when the endoscopic image 100 is analyzed by image processing, or the presence or absence of treatment tools when the endoscopic image 100 is analyzed by image processing can preferably be used.

[0102] Note that among the accessory information 101 included in the shooting information 102 (see FIG. 2), the illumination light information 101A indicating one of the shooting conditions indicates the type of illumination light when the endoscopic image 100 is shot. In the present embodiment, the endoscopic system 14 has, as shooting modes, a normal mode in which white light (WLI, White Light) is used as the illumination light to capture the subject in a natural color tone, and a special light mode such as BLI (Blue light (laser) Imaging) in which special light including narrow-band light is used as the illumination light to obtain an endoscopic image 100 in which a specific structure or the like is emphasized. Therefore, the illumination light information 101A describes the type name of the illumination light such as "WLI" indicating white light or "BLI" indicating one type of special light.

[0103] Similar to the case of the first image information, in the provision of the second image information, for the analysis by image processing of the endoscopic image 100, it is preferable to prepare an endoscopic image 100 found to have the second image information and perform the analysis based on the correspondence information in which this endoscopic image 100 and the second image information are associated in advance. Regarding the correspondence information, it is the same as in the case of the first image information, and it is preferably a learned model in machine learning technology. Therefore, for example, when the second image information is the presence or absence of a lesion, using a learned model obtained by performing learning multiple times with learning data associating an endoscopic image of a subject including the lesion and the information on the presence or absence of the lesion, such as "lesion present", by analyzing an endoscopic image 100 whose subject image is unknown whether it includes a lesion, whether the subject image has a lesion can be obtained as an analysis result. The presence or absence of a region of interest or the presence or absence of a treatment tool can be obtained in the same way as an analysis result.

[0104] Note that when using machine learning technology, not only a learned model that outputs only the presence or absence of a lesion as an analysis result but also a learned model that analyzes what the subject shown in the endoscopic image 100 is may be used. If there is one that matches a plurality of preset second image information from the analysis result of such a learned model, this may be used as the second image information.

[0105] When setting the first display mode based on the second image information, it can be done as follows. As shown in FIG. 15, the second image information is set, for example, by the priority image designation area 105d of the display image setting screen 105. As the second image information, the presence or absence of lesions and the presence or absence of treatment instruments, and the imaging conditions are adopted. For the presence or absence of lesions and the presence or absence of treatment instruments, the user inputs into the input box 105e within the priority image designation area 105d that the lesion image has the first priority, the specimen collection image has the second priority, and the normal image has the third priority. For the case of the lesion image, the "lesion image priority image", which is the image to be prioritized, is selected by checking the input box 105e for those with the imaging condition of BLI. Therefore, when arranging and displaying the selected key images on the display 52 based on the second image information, the first display mode setting unit 91 sets, as the first display mode, arranging the lesion image, the specimen collection image, and the normal image in this order, and selecting the lesion image taken by BLI. When the setting on the display image setting screen 105 is completed, the user clicks a switching button (not shown) to the key image automatic selection screen included in the display image setting screen 105 to switch to the key image automatic selection screen 106.

[0106] Note that it is preferable to provide a display number setting unit 94 that sets the maximum number of selection images 106c to be displayed on the key image automatic selection screen 106, and the display control unit 74 performs control to display on the key image automatic selection screen 106 the selection images 106c in a number equal to or less than the maximum number set by the display number setting unit 94. As shown in FIG. 16, in this case, the endoscope image browsing support server 20 includes the display number setting unit 94. The display number setting unit 94 sets the maximum number of selection images to be displayed in the selection image display area 106b.

[0107] As shown in FIG. 15, the setting of the maximum number of selected images to be displayed in the selected image display area 106b of the key image automatic selection screen 106 is performed based on the user's settings. The user's settings are set, for example, by inputting numbers in the display number setting area 105f of the display image setting screen 105. The maximum number of selected images is set by inputting, for example, "10" into the input box displayed as "Maximum number of key images: total" in the display number setting area 105f. Thereby, the maximum number of selected images displayed in the selected image display mode is 10 starting from the one with the higher preset priority. In this case, if the number of selected images displayed in the selected image display mode is 10 or less before the display number is set, the display number is not restricted.

[0108] Also, it is preferable that the display control unit 74 performs control to display on the second display screen the selected images in a number less than or equal to the maximum number for each first image information set by the display number setting unit 94. The setting of the maximum number for each first image information is performed based on the user's settings in the same manner as described above, and is set by inputting, for example, "3" into the box displayed as "for each category" in the display number setting area 105f. Thereby, the maximum number of selected images displayed in the selected image display mode is 3 starting from the one with the higher priority for each part which is the first image information. Similar to the above, if the number of selected images displayed in the selected image display mode is 3 or less before the display number is set, the display number is not restricted. received input

[0109] ​As shown in FIG. 17, a display setting storage unit 95 is provided that stores, as display settings, the specifications and settings made by at least one of the first image information specifying unit 73, the display mode setting unit 91, and the display number setting unit 94. The display control unit 74 preferably displays the endoscope image 100 on the second display screen based on the display settings. As shown in FIG. 17, the storage control unit 75 includes the display setting storage unit 95. As described above, key image automatic selection is performed based on the specifications and settings of the first image information specifying unit 73, the display mode setting unit 91, and the display number setting unit 94. With these combinations, for each individual user, detailed key image automatic selection settings can be made. Therefore, if these settings are saved as display settings, when it is desired to perform key image automatic selection with the same settings next time, the saved display settings can be retrieved and loaded to perform key image automatic selection with the same settings. Thus, the saved display settings for key image automatic selection can be loaded by a simple method, saving unnecessary effort.

[0110] As shown in FIG. 18, for example, in the display settings 96, the specification of the first image information specifying unit 73 is "esophagogastric junction, descending part of the duodenum, greater curvature of the gastric body, gastric angle, and fornix", the setting of the display mode setting unit 91 is that "priority image" is "1 lesion image, 2 specimen collection images, 3 normal images", and "lesion image priority image" is "BLI", and the setting of the display number setting unit 94 is that for "maximum number of key images", it is "10 in total" and "3 for each category". These specifications and settings are summarized and saved as the first display settings.

[0111] Note that it is preferable to save the display settings for each user. By saving the display settings for each user, it is not necessary to set the detailed settings for each user every time an examination is performed, which is preferable.

[0112] Also, it is preferable to save the display settings for each user group including a plurality of users. A user group including a plurality of users is, for example, each department in a medical facility or the medical facility. Therefore, the display settings for key image automatic setting can be saved for each department or medical facility.

[0113] Also, the display settings are preferably saved for each purpose of imaging. Examples of the purpose of imaging include screening examinations, detailed examinations of polyps, or treatments using treatment instruments. For example, in a screening examination, by calling the display settings for the screening examination, a key image setting screen can be displayed in which the optimal key images for the screening examination are automatically displayed without taking much time.

[0114] In the above embodiment, the hardware structure of the processing unit that executes various processes such as the reception unit 70, the image acquisition unit 71, the image information adding unit 72, the first image information specifying unit 73, the display control unit 74, and the storage control unit 75 included in the endoscope image browsing support server 20, which is a medical image processing apparatus, is various processors as shown below. The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (program) and functions as various processing units, a programmable logic device (PLD), which is a processor such as an FPGA (Field Programmable Gate Array) whose circuit configuration can be changed after manufacture, and a dedicated electric circuit, which is a processor having a circuit configuration designed specifically for executing various processes.

[0115] One processing unit may be composed of one of these various processors, or may be composed of a combination of two or more processors of the same type or different types (for example, a plurality of FPGAs, or a combination of a CPU and an FPGA). Also, a plurality of processing units may be composed of one processor. As an example of configuring a plurality of processing units with one processor, first, as represented by a computer such as a client or a server, one processor is configured by a combination of one or more CPUs and software, and this processor functions as a plurality of processing units. Second, as represented by a System On Chip (SoC), etc., there is a form in which a processor that realizes the functions of the entire system including a plurality of processing units with one IC (Integrated Circuit) chip is used. Thus, various processing units are configured by using one or more of the above various processors as a hardware structure.

[0116] Furthermore, the hardware structure of these various processors is, more specifically, an electrical circuit (circuitry) in the form of a combination of circuit elements such as semiconductor elements.

[0117] Note that the present invention can also be used in a system or device that acquires medical images (including videos) other than endoscopic images, in addition to an endoscopic system, a processor device, and other related devices that acquire endoscopic images. For example, the present invention can be applied to an ultrasonic inspection device, an X-ray imaging device (including a CT (Computed Tomography) inspection device and a mammography device, etc.), an MRI (magnetic resonance imaging) device, etc.

Explanation of Reference Numerals

[0118] 10 Endoscopic Image Viewing Support System 12, 24 Network 14 Endoscopic System 15 Endoscope 16 Light Source Device 17 Processor Device 18 Display 19 Keyboard 20 Endoscopic Image Viewing Support Server 20D Display 21 Client Terminal 22 Server Group 26 Image Server 28 Report Server 30 Image Database 32 Report Database 34 Inspection Report 34A Report Body 40 CPU 42 Memory 44 Storage Device 46 Communication I / F 48 Input / Output Section 50 Data Bus 52 Display 54 Input Device 56 Application Program 58 Startup Screen 58A ID Input Field 58B Decision Button 60 GUI Control Section 62 Request Issuing Section 70 Reception Section 71 Image Acquisition Section 72 Image Information Adding Section 73 First Image Information Designation Section 74 Display Control Section 75 Saving Control Section 81 First Image Information Adding Section 82 Second Image Information Adding Section 83 First Image Information List 84 Second Image Information List 91 Display Mode Setting Section 92 Screen Data Generation Section 93 Output Control Section 94 Display Number Setting Section 95 Display Setting Saving Section 96 Display Setting 100 Endoscopic Image 100S Key Image 101 Supplementary Information 101A Lighting light information 102 Shooting information 103 Report display screen 104 Findings 105 Display image setting screen 105a Selection area 105b Non-selection area 105c, 106f First image information block 105d Priority image designation area 105e Input box 105f Display number setting area 105h, 106h Schema display 106 Key image automatic selection screen 106a Selection category display area 106b Selection image display area 106c Selection image 106d Non-selection image 106e Scroll bar 106g Pop-up button 106i First image information list 108 Pointer S11~S15 Steps

Claims

1. comprising a processor, wherein the processor acquires a plurality of medical images including a subject image, by analyzing the medical images, assigns at least one of a plurality of preset first image information to the medical images, designates at least one of the plurality of first image information, performs control to display, in a first display area of an image display screen, a selected image, which is one of the plurality of medical images to which the designated first image information is assigned, in a display mode for the selected image, and performs control to display each of the designated first image information in a second display area of the image display screen. A medical image processing apparatus.

2. wherein the processor, by analyzing the medical images, assigns at least one of a plurality of preset second image information to the medical images, The medical image processing apparatus according to claim 1, wherein the display mode for the selected image is set based on the second image information.

3. Each of the plurality of preset second image information is set after being associated with at least one of a plurality of categories. The medical image processing apparatus according to claim 2.

4. Each of the plurality of preset first image information is set after being associated with at least one of a plurality of categories, The processor performs the designation for each category. The medical image processing apparatus according to claim 1.

5. The category is at least one of information regarding a part included in the subject image, information regarding imaging conditions of the medical image, information regarding a lesion included in the subject image, information regarding a region of interest included in the subject image, and information regarding an instrument for treatment included in the subject image. The medical image processing apparatus according to claim 3 or 4.

6. The processor performs control to display the plurality of first image information in a third display area of the image display screen for each category, The medical image processing apparatus according to claim 4 or 5, wherein the designation is performed based on a user's selection for the plurality of first image information displayed in the third display area.

7. The processor sets a maximum number of the selected images to be displayed in the first display area, The medical image processing apparatus according to any one of claims 1 to 6, which performs control to display the selected images in a number equal to or less than the set maximum number in the first display area.

8. The processor performs the analysis based on first correspondence information in which the medical image including the first image information and the first image information are associated with each other in advance, according to any one of claims 1 to 7 of the medical image processing apparatus.

9. By analyzing the medical image, the processor assigns at least one of a plurality of preset second image information to the medical image. The processor performs the analysis based on second correspondence information in which the medical image including the second image information and the second image information are associated with each other in advance, according to any one of claims 5 to 8 of the medical image processing apparatus.

10. Save the designation made by the processor as a display setting. Based on the display setting, display the selected image on the image display screen, according to any one of claims 1 to 9 of the medical image processing apparatus.

11. The medical image processing apparatus according to claim 10, wherein the display setting is saved for each user.

12. The medical image processing apparatus according to claim 11, wherein the display setting is saved for each user group including a plurality of the users.

13. The medical image is a captured one. The medical image processing apparatus according to claim 10, wherein the display setting is saved for each purpose of the capture.

14. An image acquisition step of acquiring a plurality of captured medical images. An image information assignment step of assigning at least one of a plurality of preset first image information to the medical image by analyzing the medical image. A first image information designation step of designating at least one of the plurality of first image information. A display control step of performing control to display, in a display mode for a selected image, the selected image, which is the medical image to which the designated first image information is assigned, in a first display area of an image display screen, and performing control to display each of the designated first image information in a second display area of the image display screen. A method of operating a medical image processing apparatus.

15. A medical image processing apparatus program installed in a medical image processing apparatus, On a computer, An image acquisition function of acquiring a plurality of captured medical images. An image information assignment function of assigning at least one of a plurality of preset first image information to the medical image by analyzing the medical image. A first image information designation function of designating at least one of the plurality of first image information. A program for a medical image processing apparatus for realizing a display control function that performs control to display a selected image, which is a medical image to which the specified first image information is attached among the plurality of medical images, in a display mode for the selected image in a first display area of an image display screen, and also performs control to display each of the specified first image information in a second display area of the image display screen.

Images