Medical image processing apparatus, method of operating a medical image processing apparatus, and non-transitory computer readable medium

Abstract

The present application provides a medical image processing device, a medical image processing device operation method, and a medical image processing device program, which can simply and appropriately select a key image. The medical image processing device includes a processor that performs the following processing: acquires a plurality of medical images including an object image, assigns first image information to the medical images by analyzing the medical images, performs designation of the first image information, performs control to display a medical image to which the designated first image information is assigned among the plurality of medical images, i.e., a selection image, in a first display area of a display screen in a selection image display manner, and performs control to display the designated first image information in a second display area.

Description

TECHNICAL FIELD

[0001] The present application relates to a medical image processing apparatus, a working method of a medical image processing apparatus, and a program for a medical image processing apparatus. BACKGROUND

[0002] In the medical field, an image (hereinafter, referred to as a medical image) including an image of an object acquired for examination or diagnosis, or the like is used. The acquired medical image is presented to a doctor. Also, the doctor uses the medical image as one of judgment materials to perform diagnosis, or the like. Specifically, the medical image includes an endoscope image, an X-ray image, a CT (Computed Tomography) image, or an MR (Magnetic resonance) image, or the like.

[0003] For example, in an examination using an endoscope system, after the examination ends, an endoscope doctor needs to use an endoscope image photographed by the endoscope system to perform production of a report in which an examination result and a diagnosis opinion, or the like are described. However, in a case where the endoscope doctor manually selects, or the like, from a large number of endoscope images acquired by one examination, there is a problem that it takes time to select an endoscope image (hereinafter, referred to as a key image) to be attached to the report.

[0004] Therefore, research has been made to reduce the burden of key image selection. For example, there is known an information processing apparatus that generates a key image from a photographed medical image in accordance with an analysis result of input diagnosis information (Patent Literature 1). Also, there is known a medical report system that displays medical images having a specified attention region in groups by specifying an attention region in a medical image (Patent Literature 2).

[0005] PRIOR ART DOCUMENTS

[0006] PATENT LITERATURE

[0007] Patent Literature 1: Japanese Patent Application Laid-Open No. 2015-211862

[0008] Patent Literature 2: Japanese Patent Application Laid-Open No. 2009-86765 SUMMARY

[0009] PROBLEMS TO BE SOLVED BY THE INVENTION

[0010] A criterion for key image selection differs according to each user of an endoscope system such as a medical facility or an endoscope doctor, and also differs according to a purpose of producing a report. The report includes, for example, a report for a doctor of a patient on whom an examination is performed by an endoscope doctor to report an examination result, or a report for a patient to notify an examination result, or the like. Therefore, even in a case where a key image is automatically selected, appropriate selection is not necessarily performed for each image.

[0011] Also, the number of endoscope images acquired in one endoscope examination becomes large depending on the situation. In a case where key images are automatically selected without restriction from the large number of endoscope images, it is possible that a display that the user cannot understand is made. For example, in a case where the selected key images are displayed on a display while the user compares the selected endoscope images and the non-selected endoscope images, it is possible that a large number of endoscope images are displayed.

[0012] An object of the present application is to provide a medical image processing apparatus, a work method of a medical image processing apparatus, and a non-transitory computer readable medium, which can simply and appropriately perform selection of key images.

[0013] Means for solving technical problems

[0014] The medical image processing apparatus of the present application includes a processor that performs processing of acquiring a plurality of medical images including subject images, assigning at least one of a plurality of first image information that is set in advance to the medical images by analyzing the medical images, performing designation of at least one of the plurality of first image information, performing control to display the medical images to which the first image information designated is assigned as selection images in a selection image display manner in a first display area of an image display screen, and performing control to display the first image information designated in a second display area of the image display screen.

[0015] It is preferable that the processor assign at least one of a plurality of second image information that is set in advance to the medical images by analyzing the medical images, and set the display manner for the selection images in accordance with the second image information.

[0016] It is preferable that the plurality of first image information that is set in advance be set on a basis of being associated with at least one of a plurality of categories, and the processor perform the designation for each category.

[0017] It is preferable that the processor perform control to display the plurality of first image information for each category in a third display area of the image display screen, and perform the designation in accordance with a selection of the plurality of first image information displayed in the third display area by the user.

[0018] It is preferable that the plurality of second image information that is set in advance be set on a basis of being associated with at least one of a plurality of categories.

[0019] It is preferable that the category be at least one of information related to a site included in the subject image, information related to a photographing condition of the medical image, information related to a lesion included in the subject image, information related to an attention region included in the subject image, and information related to a treatment device included in the subject image.

[0020] The processor preferably sets the maximum number of selected images to be displayed in the first display area, and controls the display of the selected images in the first display area in an amount that is less than or equal to the set maximum number.

[0021] The processor preferably analyzes based on first correspondence information that previously establishes a correspondence between medical images having first image information and the first image information.

[0022] The processor preferably analyzes based on second correspondence information that previously establishes a correspondence between medical images having second image information and the second image information.

[0023] The display setting in which the processor performs the designation is preferably saved, and the selected images are displayed in the image display screen based on the display setting.

[0024] The display setting is preferably saved for each user.

[0025] The display setting is preferably saved for each user group that includes a plurality of users.

[0026] The display setting is preferably saved for each purpose of photography.

[0027] The operation method of the medical image processing apparatus of the present application includes: an image acquisition step of acquiring a plurality of photographed medical images; an image information assignment step of assigning at least one of a plurality of first image information that is set in advance to the medical images by analyzing the medical images; a first image information designation step of designating at least one of the plurality of first image information; and a display control step of controlling the display of selected images, which are the medical images to which the designated first image information is assigned among the plurality of medical images, in a first display area of an image display screen in a selected image display mode, and controlling the display of the designated first image information in a second display area of the image display screen.

[0028] The non-transitory computer readable medium of the present application is a non-transitory computer readable medium that stores a program for causing a computer to function as an image processing apparatus and executable by the computer, the program executable by the computer being for causing the computer to realize the following functions: an image acquisition function of acquiring a plurality of photographed medical images; an image information assignment function of assigning at least one of a plurality of first image information that is set in advance to the medical images by analyzing the medical images; a first image information designation function of designating at least one of the plurality of first image information; and a display control function of controlling the display of selected images, which are the medical images to which the designated first image information is assigned among the plurality of medical images, in a first display area of an image display screen in a selected image display mode, and controlling the display of the designated first image information in a second display area of the image display screen.

[0029] Inventive Effects

[0030] According to the present application, selection of key images can be performed simply and appropriately. BRIEF DESCRIPTION OF DRAWINGS

[0031] Figure 1 is a diagram showing an outline of the structure of an endoscope image browsing assistance system.

[0032] Figure 2 is a diagram showing the contents of photographic information.

[0033] Figure 3 is a diagram showing the contents of a check report and a report display screen.

[0034] Figure 4 is a block diagram showing the electrical structure of a computer for an endoscope image browsing assistance server or the like.

[0035] Figure 5 is a diagram showing a functional outline of a client terminal.

[0036] Figure 6 is a diagram showing a functional outline of an endoscope image browsing assistance server.

[0037] Figure 7 is a block diagram showing a functional outline of an image information assigning section.

[0038] Figure 8 is a flowchart showing the processing steps of key image automatic selection.

[0039] Figure 9 is an image diagram showing a display image setting screen for moving a first image information block.

[0040] Figure 10 is an image diagram showing a display image setting screen for moving a plurality of first image information blocks.

[0041] Figure 11 is an image diagram showing a display image setting screen for moving a first image information block of another category.

[0042] Figure 12 is an image diagram showing a display image setting screen for moving a first image information block of another category.

[0043] Figure 13 is an image diagram showing a key image automatic selection screen.

[0044] Figure 14 is an image diagram showing a key image automatic selection screen for displaying a first image information list.

[0045] Figure 15 This is an image representing the display image settings screen where the number of images to be displayed is set.

[0046] Figure 16 This is an explanatory diagram showing the functional overview of the endoscopic image browsing auxiliary server, including the display number setting unit.

[0047] Figure 17 This is a block diagram that represents a functional overview of the storage control unit.

[0048] Figure 18 This is an explanatory diagram showing an example of the display settings. Detailed Implementation

[0049] In this embodiment, endoscopic images are used as an example of medical images. Endoscopic images are an example of medical images.

[0050] Figure 1 The endoscopic image browsing assistance system 10 shown is used to assist in browsing endoscopic images 100 obtained through endoscopic examination (reference). Figure 2 The computer system is connected to the endoscope system 14 via network 12. Network 12 is, for example, a LAN (Local Area Network) within a hospital. The endoscope system 14 includes an endoscope 15, a light source device 16, a processor device 17, a display 18, and a keyboard 19 as an input device.

[0051] Endoscopic system 14 is used for endoscopic examinations (including various procedures using endoscope 15). Endoscopic examinations are performed, for example, by an endoscopist commissioned by the patient's attending physician, and multiple endoscopic images 100 are obtained during the endoscopic examination. The endoscopic images 100 captured by endoscopic system 14 are stored in endoscopic image viewing assistance system 10.

[0052] The endoscopic image browsing assistance system 10 includes an endoscopic image browsing assistance server 20, a client terminal 21, and a server group 22, which are connected via a network 24 such as a LAN.

[0053] The endoscopic image browsing assistance server 20 is a medical image processing device of the present invention, which assists the user in selecting key images from multiple endoscopic images 100, and uses the selected key images to generate an examination report 34 (see reference). Figure 3 The examination report 34 is a report in which the endoscopist or other physician who performed the endoscopy reviews the endoscopic images 100 and summarizes their medical opinions. The examination report 34 includes key images of the endoscopic images 100, which serve as the basis for the diagnostic opinion. The examination report 34 is provided to the attending physician or other physicians of the patient who underwent the endoscopy for review and for the patient's diagnosis.

[0054] The server group 22 is composed of an image server 26 and a report server 28. The image server 26 is provided with an image database (hereinafter, referred to as image DB) 30. The endoscope images 100 transmitted from the endoscope system 14 are stored in the image DB 30. The report server 28 is provided with a report database (hereinafter, referred to as report DB) 32. The examination report 34 made in association with the implementation of the endoscopic examination is stored in the report DB 32. The image DB 30 and the report DB 32 are, for example, databases capable of searching according to a patient ID (Identification Data) given to each patient, or an examination ID given each time the endoscopic examination is performed, and the like.

[0055] The client terminal 21 is a terminal for browsing the endoscope images 100 and the examination report 34, and the like, and is used for the endoscope doctor to browse the endoscope images 100 after the examination is completed, or to make the examination report 34. Also, the client terminal 21 is used for the attending doctor who is the doctor of the medical care department that commissioned the endoscopic examination to browse the endoscope images 100 and the examination report 34.

[0056] The client terminal 21 is, for example, a notebook personal computer or a desktop personal computer, or the like. In the case where the endoscope doctor makes the examination report 34 after the examination is completed, the endoscope doctor accesses the endoscope image browsing assistance server 20 using the client terminal 21. Also, the saved endoscope images 100 or the examination report 34 are read out, displayed on the display of the client terminal 21, and necessary work is performed, and the examination report 34 is completed. The completed examination report 34 is saved in the report server 28 via the endoscope image browsing assistance server 20.

[0057] A plurality of image folders (not shown) are provided in the image DB 30. When one endoscopic examination is performed, one image folder corresponding to the endoscopic examination is created. Also, in each image folder, the endoscope images 100 acquired by the corresponding endoscopic examination are stored. As described above, in the endoscopic examination, in addition to the video photographing, the photographing of still images at an arbitrary timing based on the freeze switch of the endoscope, the automatic photographing performed at a predetermined time interval, and the like, test photographing and the like are performed, and all the images obtained by these photographings are stored as the endoscope images 100 in the image folder 36.

[0058] As Figure 2As shown, these endoscopic images 100 are stored in an image folder as photographic information 102, which is recorded in association with ancillary information 101 such as the inherent image ID, the time of photographing, and the illumination information 101A in the endoscope system 14 used during photographing. The ancillary information 101 recorded in each endoscopic image 100 may be used as second image information (described later) for selecting key images or for rearranging when displaying key images on a monitor, depending on the circumstances.

[0059] In image server 26, image folders are created when saving endoscopic images 100 of the examination unit sent from endoscopy system 14. Image folders can also be created on the endoscopy system 14 side, with each image folder received by image server 26. Furthermore, in image DB 30, if multiple endoscopic images 100 can be read by the examination unit by attaching tags to them, image folders are not required.

[0060] Multiple report folders (not shown) are set up in report DB32. The examination report 34, which is generated each time an endoscopy is performed, is stored in the report folder. Regarding the examination report 34, similar to the endoscopy image 100, if the examination report 34 is stored in report DB32 in a way that can be read each time an endoscopy is performed, such as by attaching labels to the examination unit, then the report folder may not need to be set up.

[0061] like Figure 3 As shown, the examination report 34 and the report display screen 103 when displaying the examination report 34 consist of a report body 34A, as well as the aforementioned examination identification information, patient identification information, and producer information indicating the producer. The report body 34A includes the diagnostic opinion 104 of the examining physician and key images 100S of the endoscopic images 100 attached to the examination report 34. The key images 100S are the endoscopic images 100 that form the basis of the diagnostic opinion 104 and are attached corresponding to each endoscopic examination. Figure 3 An example is shown where two endoscopic images 100 with image IDs A13 and A24 are associated with the first diagnostic opinion 104 (diagnostic opinion No. 1), and one endoscopic image 100 with image ID A37 is associated with the second diagnostic opinion 104 (diagnostic opinion No. 2).

[0062] In the preparation of the examination report 34, the endoscope image browsing auxiliary server 20 automatically selects the endoscope images 100 as key images from multiple endoscope images 100 obtained from the endoscope examination unit according to the user's specifications, and attaches the selected endoscope images 100 according to the format of the examination report 34. Furthermore, it automatically lays out the examination identification information and patient identification information according to the attached information 101 associated with the endoscope images 100.

[0063] The endoscopic image browsing auxiliary server 20 and client terminal 21, as well as the image server 26 and report server 28 constituting the server group 22, are based on a computer such as a personal computer, server computer or workstation, and are equipped with control programs such as operating systems and application programs such as client programs or server programs.

[0064] like Figure 4 As shown, the computers constituting servers 20, 26, 28 and client terminal 21 have the same basic structure, each equipped with a CPU (Central Processing Unit) 40, a memory 42, a storage device 44, a communication I / F (Interface) 46, and an input / output unit 48. They are connected via a data bus 50. The input / output unit 48 consists of a display 52 and input devices 54 such as a keyboard or mouse.

[0065] Storage device 44 is, for example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and storage control program or application (hereinafter referred to as AP) 56. Furthermore, in servers 26 and 28 that construct the database, in addition to the HDD for storing the program, the database storage device 44 also includes, for example, a disk array with multiple HDDs mounted together. The disk array can be built into the server main unit or set up separately from the server main unit and connected to the server main unit via a network such as a LAN. Moreover, cloud storage devices connected via the Internet can also be used as storage device 44.

[0066] Memory 42 is the working memory used by CPU 40 for processing, and it consists of RAM (Random Access Memory). CPU 40 loads the control program stored in storage device 44 into memory 42 and executes the program accordingly, thereby centrally controlling various parts of the computer. Communication I / F 46 is the network interface for transmission control with network 12.

[0067] In client terminal 21, a client program is installed as AP56. The client program enables client terminal 21 to perform the following functions: access the endoscope image browsing auxiliary server 20, and send the display image setting screen 105 for selecting key images (see reference). Figure 9 (or key image automatic selection screen 106 (reference)) Figure 11 The client program can handle various requests, such as browsing or updating requests for images displayed on the endoscope image browsing auxiliary server 20; or it can receive and display images sent from the endoscope image browsing auxiliary server 20 to the client terminal 21. Furthermore, the client program can be a program specifically programmed for the endoscope image browsing auxiliary system 10, or it can be a program that includes a well-known web browser.

[0068] like Figure 5 As shown, when the client program is started, a startup screen 58 with GUI (Graphical User Interface) operation functions is displayed on the monitor 52 of the client terminal 21. The CPU 40 and memory 42 of the client terminal 21 work together as the GUI control unit 60 and the request issuing unit 62, which issues various requests to the endoscope image browsing auxiliary server 20.

[0069] The startup screen 58 includes an examination ID input field 58A and an OK button 58B. By entering an examination ID in the examination ID input field 58A and pressing the OK button 58B, one endoscopic examination can be specified from multiple endoscopic examinations. When an endoscopic examination is specified, the information entered into the examination ID input field 58A is sent from the GUI control unit 60 to the request issuance unit 62. The request issuance unit 62 generates a transmission request for selecting an image display screen for the endoscopic image 100 attached to the report from the endoscopic image 100 of the specified endoscopic examination, i.e., the endoscopic examination corresponding to the examination ID entered into the examination ID input field 58A, and issues it to the endoscopic image browsing auxiliary server 20. In response to this transmission request, an image display screen of the initial state or based on pre-saved settings is transmitted from the endoscopic image browsing auxiliary server 20 and displayed on the display 52 of the client terminal 21.

[0070] The image display screen is composed of data recorded using a markup language such as XML (Extensible Markup Language), and these image display screens themselves also have GUI-based operation functions. The GUI control unit 60 accepts operation instructions from the input device 54 via the image display screen, such as input operations from the keyboard or click operations based on the operation buttons of the mouse pointer 108. The request issuance unit 62 issues update requests for the image display screen based on the operation instructions received by the GUI control unit 60.

[0071] The update request includes instructions for selecting key images via the image display screen, switching instructions for the displayed endoscope image 100, and other instructions for updating the content of the image display screen. When the update request is sent to the endoscope image browsing assistance server 20, the endoscope image browsing assistance server 20 updates the image display screen and transmits the updated image display screen to the client terminal 21. This updates the image display screen shown on the client terminal 21.

[0072] like Figure 6 As shown, the server program installed in the endoscope image browsing auxiliary server 20 as AP56 is a working program used to enable the computer to function as the endoscope image browsing auxiliary server 20. When the server program is started, the CPU 40 and memory 42 of the endoscope image browsing auxiliary server 20 cooperate to function as the receiving unit 70, image acquisition unit 71, image information assignment unit 72, first image information assignment unit 73, display control unit 74, and storage control unit 75.

[0073] The receiving unit 70 receives input from various terminals. The receiving unit 70 receives image display screen transmission requests or update requests input from the client terminal 21 and outputs these requests to the display control unit 74. The image display screen transmission request requests the transmission of an image display screen that displays an endoscope image 100 selected from a plurality of endoscope images 100 specified by the inspection ID in the inspection ID input field 58A input to the startup screen 58. When a transmission request is received, the receiving unit 70 inputs the inspection ID specified by the transmission request (the inspection ID input to the inspection ID input field 58A) to the image acquisition unit 71. Additionally, the update request includes specification information or various settings for specifying at least one of a plurality of first image information, at least one of a plurality of second image information, as described later. The specification information is input to the image information assignment unit 72 and the first image information specification unit 73.

[0074] When an examination ID is entered, the image acquisition unit 71 accesses the image server 26 and retrieves all endoscopic images 100 obtained through the endoscopic examination corresponding to the notified examination ID from the image database 30. Specifically, the image acquisition unit 71 uses the examination ID as a search keyword to search the image database 30, reads and retrieves the common photographic information 102 for the examination ID from the image folder 36 of the image database 30. As described above, the photographic information 102 includes the endoscopic images 100 and the accompanying information 101 recorded in association with the endoscopic images 100. Thus, multiple endoscopic images 100 of all examination units obtained through a single endoscopic examination and the accompanying information 101 recorded in association with the endoscopic images 100 are retrieved. The image acquisition unit 71 outputs the retrieved photographic information 102 to the image information assignment unit 72.

[0075] The image information assignment unit 72 analyzes the endoscopic image 100 and assigns at least one of a plurality of pre-set first image information to the endoscopic image 100. Specifically, the first image information is assigned to the endoscopic image 100 by adding the first image information to the accompanying information 101 included in the imaging information 102, or by assigning information that is the first image information if the first image information already exists in the information included in the accompanying information 101. Therefore, information that is the first image information pre-added to any of the information included in the accompanying information 101 is also included in the analysis of the endoscopic image 100. Multiple first image information can also be assigned.

[0076] like Figure 7 As shown, the image information assignment unit 72 includes a first image information assignment unit 81 and a second image information assignment unit 82. The first image information assignment unit 81 includes a first image information list 83, and the second image information assignment unit 82 includes a second image information list 84. The second image information will be described later.

[0077] The first image information list 83 is a list containing multiple first image information items, which is preset. Preferably, the multiple first image information items are set based on establishing an association with at least one of the multiple categories. Therefore, in the first image information list 83, the multiple first image information items are recorded based on establishing an association with at least one of the multiple categories.

[0078] One of the multiple categories is information related to the parts contained in the subject image. When a part category is set, part names such as "esophagus", "esophagogastric junction", "greater curvature of the gastric body", "vestibule", "gastric angle", "fornix", or "descending duodenum" are preset as the first image information.

[0079] Further, as other categories, information on a photographic condition of a medical image, information on a lesion included in a subject image, information on a region of interest included in a subject image, or information on a treatment tool included in a subject image, and the like can be cited.

[0080] The information on a photographic condition refers to information on photography at the time of acquisition of a medical image, and in the case where a category of a photographic condition is set, for example, a kind of illumination light, a distance of a subject from a distal end of an endoscope, exposure, or a kind of an endoscope used, and the like are set as the first image information. In the case where information on a lesion included in a subject image is set as a category, for example, whether or not a subject image has a lesion, a size of a lesion, or a kind of a lesion, and the like are set as the first image information. In the case where information on a region of interest included in a subject image is set as a category, whether or not a subject image has a region of interest, a size of a region of interest, or vital information such as an oxygen saturation of a region of interest, and the like are set as the first image information. In the case where information on a treatment tool included in a subject image is set as a category, whether or not a subject image has a treatment tool, a kind of a treatment tool, or whether or not it is a subject acquisition image, and the like are set as the first image information. Further, in the case where the first image information is information on a treatment tool, the first image information can be a "subject acquisition image". This is because, depending on the kind of a treatment tool included in a subject image, analysis of whether or not it is a scene of acquisition of a subject can be performed. These first image information are pre-stored and used in the first image information list 83.

[0081] The first image information assigning section 81 assigns at least one of a plurality of first image information pre-set by image processing analysis of the endoscope image 100 to the endoscope image 100. The plurality of first image information pre-set is first image information included in the first image information list 83. Further, the first image information assigning section 81 preferably analyzes the endoscope image 100 by each category included in the first image information list 83. For example, in the case where the first image information list 83 has a category of information on a site included in a subject image, the endoscope image 100 is analyzed with respect to the site category, and first image information included in the site category is assigned to the endoscope image 100. Further, in the case where the first image information list 83 has a plurality of categories, the endoscope image 100 is analyzed by each category, or the endoscope image 100 is analyzed with respect to first image information included in a plurality of categories.

[0082] The first image information-imparting section 81 imparts the first image information to the endoscope image 100 by writing the first image information into the attached information 101 of the endoscope image 100. In a case where the first image information that is set in advance cannot be imparted to the endoscope image 100 due to some reason, "unknown" is imparted as the first image information, for example, so that a user or the like can recognize the situation. Thus, "unknown" or the like is written in the first image information field of the attached information 101 of the endoscope image 100.

[0083] The analysis based on the image processing of the endoscope image 100 can employ a method of various image processing that discriminates or recognizes the first image information. Among them, it is preferable to prepare an endoscope image that is determined to have the first image information, and to analyze based on correspondence information that has established a correspondence between the endoscope image and the first image information in advance. The correspondence information is preferably a learned model in machine learning technology. Thus, for example, in a case where the category of the first image information is a site, a learned model that has been learned a plurality of times based on learning data that has established a correspondence between an endoscope image that has captured a specific site as a subject and a site name such as "esophagus" is used to analyze the endoscope image 100 that contains a site unknown in the subject image, whereby a site name contained in the subject image is obtained as an analysis result. Specifically, in a case where the site that is reflected in the endoscope image 100, that is, the site contained in the subject image is "esophagus", by analyzing using the learned model described above, an analysis result of "esophagus" can be obtained as the first image information.

[0084] The first image information specifying section 73 performs specification of at least one of a plurality of first image information. By specifying the first image information, it is possible to classify the photographing information 102 having the specified first image information in the attached information 101 and the photographing information 102 not having the specified first image information in the attached information 101 among a plurality of endoscope images 100. For example, the plurality of first image information refers to a plurality of specific site names when the first image information is a site category. Thus, for example, by specifying a site name attached in the examination report 34 from among the plurality of site names, it is possible to extract an endoscope image 100 having the site name in the photographing information 102.

[0085] As described above, the designation of the first image information is performed by, for example, a user selecting the first image information via the display image setting screen 105 or the like input from the client terminal 21. Specifically, in a case where the first image information is a site name, the user selects the first image information by inputting "esophagus" or the like as at least one of the site names of the first image information to the client terminal 21. The first image information designation section 73 receives the input information as the designation information, and classifies information in which "esophagus" exists in the first image information included in the photographic information 102 and information other than this. Also, in the accompanying information 101 of the endoscope image 100 in which "esophagus" exists in the first image information, the endoscope image 100 to which the designated first image information is assigned is written.

[0086] The display control section 74 has a display mode setting section 91, a screen data generation section 92, and an output control section 93. The endoscope image 100 is directly input from the image acquisition section 71 to the screen data generation section 92.

[0087] Also, the display control section 74 takes the endoscope image 100 to which the designated first image information is assigned among the plurality of endoscope images 100 input via the first image information designation section 73 as a selection image. Also, control is performed to display the selection image in the first display area of the image display screen in a selection image display mode based on the setting of the display mode setting section 91. Also, control is performed to display the designated first image information in the second display area of the image display screen, respectively. The selection image display mode can be set in advance. Also, the selection image display mode can be set by the display mode setting section 91 according to the second image information described later.

[0088] The image display screen includes the first display area and the second display area, and control is performed to cause the selection image to be displayed in the first display area in the selection image display mode. Also, control is performed to cause the plurality of first image information to be displayed in the second display area, respectively. For example, the selection image and the plurality of first image information are displayed in the key image automatic selection screen 106, respectively. The key image automatic selection screen 106 corresponds to the image display screen. Therefore, the first display area and the second display area can function as display areas within the key image automatic selection screen 106. For example, the key image automatic selection screen 106 is divided into two, one of which is taken as the first display area and the other is taken as the second display area. In addition, the key image automatic selection screen 106 is displayed on the display 52.

[0089] For the selection image, control is performed to display in the first display area of the key image automatic selection screen 106 in a selection image display manner. The selection image display manner includes a position manner of displaying the selection image in which position of the first display area and / or a display method manner of emphasizing display of a specific selection image in comparison with other selection images. With regard to the position manner, the selection image is one or plural, and in the case of plural, since the area of the first display area is limited, the selection image to be displayed is further selected, or a priority order is given, and the display position is controlled to perform display. The selection image display manner can be set in advance. With regard to the display method manner, various kinds of emphasized display and the like can be cited.

[0090] For each of the specified first image information, control is performed to display in the second display area of the image display screen. For example, in the case where the first image information is a site category, all of the site names of the specified first image information are displayed in the second display area, respectively. Thereby, it is possible to grasp at a glance which key image the selected key image is based on the first image information. Therefore, in the case where it is intended to make the examination report 34 to which the desired endoscope image 100 is attached, it is possible to immediately grasp that how to newly specify the first image information in order to adjust the insufficient endoscope image 100 or the excessive endoscope image 100.

[0091] The screen data generation section 92 performs generation and update of the key image automatic selection screen 106 which displays the endoscope image 100 or the specified first image information as the selection image input to the screen data generation section 92, in accordance with the selection image display manner set. The screen data generation section 92 appropriately uses the photographic information 102 including the endoscope image 100 and the accompanying information 101 and the first image information and the like in accordance with the screen requested by the client terminal 21. The screen data generation section 92 creates the key image automatic selection screen 106 using the selection image display manner, or the endoscope image 100 as the selection image, and the accompanying information 101 recorded in association with these endoscope images 100, in the case of performing generation and update of the key image automatic selection screen 106.

[0092] The generated and updated key image automatic selection screen 106 is input to the output control section 93. The output control section 93 transmits the input key image automatic selection screen 106 to the client terminal 21 of the request source. In the client terminal 21, the key image automatic selection screen 106 transmitted from the output control section 93 is displayed on the display 52. The user can grasp whether the endoscope image 100 to be attached in the examination report 34 is excessive or insufficient, through the key image automatic selection screen 106 displayed on the display 52.

[0093] UsingFigure 8 The flowchart shown, and Figures 9 to 14 The illustrated diagram illustrates the process of automatic selection of key images. Specifically, it explains the acquisition of endoscope image 100 in endoscope image browsing auxiliary server 20, the assignment of first image information, the specification of first image information, and the selection of images and the display of first image information on the monitor.

[0094] In this embodiment, during the automatic selection of key images, the image setting screen 105 (reference) will be displayed. Figure 9 ) and key image automatic selection screen 106 (reference) Figure 10 The display screen is shown on the monitor 52. The display image setting screen 105 is the screen for setting the endoscope image, etc., to be displayed in the key image automatic selection screen 106. The display image setting screen 105 and the key image automatic selection screen 106 have the same layout.

[0095] First, upon receiving a transmission request from the client terminal 21 as described above, the image acquisition unit 71 searches the image DB30, reads from the image DB30, and acquires the photographic information 102 of the examination unit obtained through one endoscopic examination, namely multiple endoscopic images 100 and accompanying information 101 recorded in association with the endoscopic images 100 (S11).

[0096] Next, the image information assignment unit 72 takes each of the acquired endoscopic images 100 from the examination unit as an object and performs analysis related to the first image information (S12). As described above, the first image information can be selected from multiple categories, but it is preset by user selection, etc.

[0097] like Figure 9 As shown, the user presets first image information using the display image setting screen 105. The display image setting screen 105 has a category setting button (not shown). The user operates the category setting button to set at least one of the categories. In this embodiment, a part category is set. In the part category, multiple part names are preset as the first image information. Therefore, when a part category is selected, multiple part names are set as the first image information, and the image information assignment unit 72 analyzes the endoscope image 100 using the part names of the first image information as the analysis results.

[0098] Thus, multiple pre-defined first image information items are displayed in the non-selection area 105b of the display image setting screen 105, which is one of the display screens, according to each category. The non-selection area 105b corresponds to the third display area.

[0099] In the non-selection area 105b, a plurality of first image information blocks 105c representing names of sites included in the site category are displayed. One first image information block 105c represents one first image information. The first image information block 105c displays the first image information, and thus in the present embodiment, the name of the site is displayed, but in a case where a category other than the site is set, the first image information included in the set category is displayed.

[0100] The first image information of the set category is assigned to the endoscope image 100 by the analysis of the endoscope image 100 by the image information assigning section 72 (S13). In the present embodiment, since the site category is set, the image information assigning section 72 assigns the name of the site described in the first image information block 105c to the endoscope image 100 by analyzing a plurality of acquired endoscope images 100 respectively. In the drawing, only a part of the symbols are sometimes labeled in order to avoid the drawing from becoming complicated.

[0101] The designation of at least one of the plurality of first image information set as described above is performed (S14). The designation is performed by the user, but depending on the situation, the same designation as the last time or the like is performed by a person other than the user. Thus, it is preferable that the designation of the first image information is performed in accordance with the selection of the plurality of first image information displayed in the non-selection area 105b by the user. In the present embodiment, the designation of the first image information is performed using the first image information block 105c representing the name of the site displayed in the non-selection area 105b of the display image setting screen 105.

[0102] In a case where the user designates the first image information, the first image information block 105c of the non-selection area 105b is designated and dragged by the pointer 108 to be moved in a manner to be included in the selection area 105a. The first image information block 105c included in the selection area 105a is the first image information designated by the user. In the selection area 105a, the designated first image information is emphasized and displayed. In the non-selection area 105b, the first image information not designated by the user is displayed. Figure 9 In the embodiment shown, the first image information of "esophagus stomach junction" is one of the plurality of first image information designated. The user designates a plurality of first image information by repeating such an operation.

[0103] As shown in Figure 10 the result of the designation by the user, five kinds of first image information blocks 105c are included in the selection area 105a in the display image setting screen 105, and the first image information designated by the user becomes five kinds of names of sites.

[0104] As described above, the designation of the first image information is performed. In addition, in Figure 10In the non-selection area 105b, the first image information block 105c not designated is displayed. The first image information designating section 73 designates the first image information according to the designation by the user. Therefore, the first image information designating section 73 designates the site name shown in the first image information block 105c moved to the selection area 105a as the designated first image information. Since the site name is assigned to the plurality of endoscopic images 100 acquired by the image information assigning section 72, the endoscopic image 100 having the site name as the designated first image information is selected from the plurality of endoscopic images 100 acquired as the selection image. Thus, it is preferable that the first image information designating section 73 designates the first image information according to the plurality of first image information displayed in the selection area 105a.

[0105] Further, here, by switching the category of the first image information, the first image information other than the site category can be designated. As shown in Figure 11 In the display image setting screen 105, as in the case of the site category, the category is switched to the category of the information on the treatment tool by the category setting button (not shown).

[0106] In the non-selection area 105b, as the category of the information on the treatment tool included in the subject image, the two first image information blocks 105c of "subject acquisition image" and "non-subject acquisition image" are displayed. Also, as the category of the information on the lesion included in the subject image, the two first image information blocks 105c of "lesion image" and "non-lesion image" are displayed. Thus, it is also possible to control to display the first image information blocks 105c of a plurality of categories in the non-selection area 105b according to the area of the display area or the like. As in the case of the site category described above, the user designates the first image information of each category by moving the first image information block 105c from the non-selection area 105b to the selection area 105a.

[0107] In the present embodiment, "subject acquisition image" is designated as the first image information from among the category of the information on the treatment tool, and "lesion image" is designated as the first image information from among the category of the information on the lesion. As in the case of the category of the information on the site, the image information assigning section 72 performs analysis on the subject image for assigning the first image information "subject acquisition image" to the endoscopic image 100 including the scene where the subject is acquired. Also, the image information assigning section 72 performs analysis on the subject image for assigning the first image information "lesion image" to the endoscopic image 100 including the lesion. As for the method of analysis, it can be the same as in the case of the site category. By the analysis of the endoscopic image 100 by the image information assigning section 72, the first image information of the category set is assigned to the endoscopic image 100, and the endoscopic image 100 having the designated first image information is selected as the selection image.

[0108] As described above, in the case where the first image information is set on the basis of the association with at least one of the plurality of categories in advance, the designation of the first image information is preferably performed for each category. This is because, by setting the categories, the endoscope image 100 that meets the user's desire can be easily and flexibly selected at the time of making the inspection report.

[0109] Further, the schematic diagram display 105h in the display image setting screen 105 and the schematic diagram display 106h in the key image automatic selection screen 106 are fixedly displayed in advance as information that becomes a reference for the revealed portion in the inspection report 34.

[0110] As Figure 12 indicated in the display image setting screen 105, seven first image information blocks 105c are included in the selection area 105a, and the first image information designated by the user becomes five portions, a subject acquisition image, and a lesion image. The user confirms that all the first image information that the user wants to be the key image is included by the display of the selection area 105a, and ends the movement of the first image information block 105c.

[0111] The display control section 74 displays the selection image and the first image information on the display 52 by displaying the key image automatic selection screen 106 (S15). As Figure 13 indicated in the key image automatic selection screen 106, the selection image 106c is automatically displayed in the selection image display area 106b by the display mode for the selection image. The selection image display area 106b corresponds to the first display area.

[0112] In the present embodiment, the display mode for the selection image is the content set in advance, and is emphasized display. Therefore, in the selection image display area 106b, the selection image 106c is emphasized. The non-selection image 106d that is not the selection image 106c among the endoscope images 100 acquired in the inspection is displayed unobtrusively by making the color pale, and the like, so that the selection image 106c is emphasized. Since the screen area of the selection image display area 106b is limited, all the selection images 106c cannot be displayed in one screen depending on the setting of the size of the display of one endoscope image 100, and the like. In this case, by moving the scroll bar 106e to scroll the screen of the selection image display area 106b, the hidden selection image 106c can be displayed. Thus, the display mode for the selection image is preferably emphasized display of the selection image 106c.

[0113] Further, in the present embodiment, it is set that the non-selection image 106d is also displayed in the selection image display area 106b, and all the inspection images are displayed, but it can also be set that only the selection image 106c is displayed.

[0114] Furthermore, in the key image automatic selection screen 106, multiple first image information items are displayed in the selection category display area 106a. The selection category display area 106a corresponds to the second display area. Since the first image information is a body part name, etc., multiple designated first image information blocks 105c are arranged and displayed together with the body part name, etc., in the selection category display area 106a. The first image information block 105c displays the body part name, etc., and a representative image of the endoscopic image 100 assigned that body part name, etc. Therefore, the designated body part name, etc., and the endoscopic image 100 assigned that body part name, etc., can be grasped at a glance.

[0115] Furthermore, since the key image automatic selection screen 106 has the same layout as the display image setting screen 105, the first image information block 105c selected in the selection area 105a of the display image setting screen 105 is also displayed in the selection category display area 106a in the same manner. Therefore, based on the selected part name, it is easy to determine which image has been selected as the key image.

[0116] In addition, such as Figure 14 As shown, when viewing the key image auto-selection screen 106, if the key image used as the selection image 106c differs from the user's desired image, clicking the pop-up button 106g on the first image information block 106f displayed in the selection category display area 106a will display the first image information contained in the same category as the first image information block 106f in a first image information overview 106i, allowing the user to re-designate the first image information. In the first image information overview 106i, the designated first image information and undesignated first image information contained in the same category are displayed separately. Furthermore, the first image information block 106f for which the pop-up button 106g was clicked is highlighted. The first image information clicked on the first image information overview 106i can replace the previously displayed first image information. Therefore, in Figure 14 In this case, the "descending branch of the duodenum" can be replaced with the clicked first image information. Alternatively, you can click the toggle button (not shown) used to switch to the display image setting screen 105 set in the key image automatic selection screen 106, and specify the first image information again. By repeating these operations, better key image selection can be achieved.

[0117] The user confirms the site name of the selection category display area 106a and all of the selection images 106c displayed by scrolling the selection image display area 106b, completes the job of selecting the key image, and performs report creation by clicking a completion button (not shown) provided in the key image automatic selection screen 106. Alternatively, the job of selecting the key image is completed and report creation is performed by pressing a report creation button (not shown). When the job of selecting the key image is completed, the various settings of the selection of the key image used in the present report creation are saved. The saving of the various settings and the designation, the saving of the endoscope images 100, and the saving of the examination report 34 are controlled by the saving control section 75.

[0118] According to the medical image processing apparatus, i.e., the endoscope image browsing assistance server 20, configured as described above, by the user designating the category of the endoscope images 100 as the first image information, the user's desired key image can be automatically selected from a large number of endoscope images 100, so the selection of the key image is simple. Also, since these designations are made in the display screen of the display 52, the selection of the key image can be made more simply and easily understood. Also, since these designations are made by arbitrarily selecting the first image information, various key image selection criteria of the user can be flexibly combined, and the selection of the key image that suits each user can be made. Also, when selecting the key image, the user does not need to confirm a large number of captured endoscope images 100, so the job efficiency of the selection of the key image is improved.

[0119] Also, since the designated first image information and the endoscope images 100 selected as the key image can be confirmed by, for example, the key image automatic selection screen 106, etc., it is easy to confirm what the first image information designated as the key image is and what kind of endoscope images 100 are selected by the designation. After the confirmation, it is also easy to newly designate the first image information again, and by making a plurality of designations, a key image that is more suitable for the user can be automatically selected. Thus, the endoscope image browsing assistance server 20 can simply and appropriately make the selection of the key image.

[0120] Further, the display mode setting section 91 preferably assigns at least one of a plurality of second image information that is set in advance to the medical image and sets the display mode for the selection image in accordance with the second image information. By setting the display mode for the selection image in accordance with the second image information, the user can combine the designation of the first image information and the second image information and flexibly make the selection of the key image. Thus, the user can further simply and appropriately make the selection of the key image.

[0121] The second image information is the same as the first image information, and is given to the endoscope image 100 in the same manner as the first image information. The second image information, like the first image information, can be information related to a site included in the subject image, information related to a photographing condition of the medical image, information related to a lesion included in the subject image, information related to a region of interest included in the subject image, or information related to a treatment instrument included in the subject image.

[0122] The image information giving section 72 has a second image information giving section 82, and the second image information giving section 82 has a second image information list 84 (refer to FIG. 8). The second image information list 84 included in the second image information giving section 82 is the same as the first image information list 83, and is a list in which second image information is recorded. Figure 7 ) The second image information list 84 included in the second image information giving section 82 is the same as the first image information list 83, and is a list in which second image information is recorded.

[0123] In a case where the second image information is given, the image information giving section 72 gives at least one of a plurality of second image information that is set in advance to the endoscope image 100 by analyzing the endoscope image 100. Specifically, the second image information is given to the endoscope image 100 by appending the second image information to the additional information 101 included in the photographing information 102, or in a case where the second image information already exists in the information included in the additional information 101, by appending information that the information is the second image information. The second image information that is given can also be plural. Also, as described above, the second image information, like the first image information, is preferably set on the basis of association with at least one of a plurality of categories.

[0124] Which second image information is set can be set by the user, for example, by designation on the display 52 via the display image setting screen 105. In addition, the second image information is a project for selecting and / or rearranging the endoscope image 100 when the selection image is displayed on the display 52, and thus a plurality of second image information can also be selected and used in combination. As a category of the second image information, a photographing condition such as the illumination light information 101A at the time of photographing the endoscope image 100, the presence or absence of a lesion at the time of analyzing the endoscope image 100 by image processing, the presence or absence of a region of interest at the time of analyzing the endoscope image 100 by image processing, or the presence or absence of a treatment instrument at the time of analyzing the endoscope image 100 by image processing can be preferably used.

[0125] In addition, in the photographing information 102 (refer to FIG. 6), the first image information list 83 and the second image information list 84 can be included in the additional information 101. Figure 2The illumination light information 101A, which is one of the pieces of accompanying information 101, indicates the kind of illumination light when the endoscope image 100 is captured. In the present embodiment, the endoscope system 14 has, as the photographing mode, a normal mode in which white light (WLI, White Light) is used as the illumination light to capture the subject in a natural color tone, and a special light mode such as BLI (Blue light (laser) Imaging) in which special light including narrow-band light is used as the illumination light to obtain an endoscope image 100 in which a specific structure or the like is emphasized. Therefore, the kind of illumination light, such as "WLI" indicating white light or "BLI" indicating one kind of special light, is described in the illumination light information 101A.

[0126] As in the case of the first image information, in the case of giving the second image information, the analysis based on the image processing of the endoscope image 100 preferably prepares the endoscope image 100 in which the second image information is identified, and analyzes it in accordance with the correspondence information in which the endoscope image 100 is previously associated with the second image information. As for the correspondence information, as in the case of the first image information, it is preferably a completed model of learning in the machine learning technique. Therefore, for example, in the case where the second image information is the presence or absence of a lesion, the endoscope image 100 in which it is unknown whether the subject image contains a lesion is analyzed using the completed model of learning that has been subjected to learning a plurality of times based on learning data in which an endoscope image capturing a subject containing a lesion is associated with information "with a lesion" indicating the presence or absence of a lesion. The presence or absence of the region of interest or the presence or absence of the treatment tool is also obtained as an analysis result in the same manner.

[0127] In addition, in the case of using the machine learning technique, not only a completed model of learning that outputs only the presence or absence of a lesion as an analysis result can be used, but also a completed model of learning that analyzes what the subject of the endoscope image 100 is can be used. According to the analysis result of such a completed model of learning, if there is information that matches a plurality of pieces of second image information that are previously set, that information can also be used as the second image information.

[0128] In the case where the first display mode is set in accordance with the second image information, it can be performed as follows. As in the case of the first image information, the presence or absence of a lesion is analyzed using the completed model of learning that has been subjected to learning a plurality of times based on learning data in which an endoscope image capturing a subject containing a lesion is associated with information "with a lesion" indicating the presence or absence of a lesion. The presence or absence of a lesion is obtained as an analysis result. Figure 15As shown, the second image information is set, for example, through the priority image designation area 105d of the image setting screen 105. The presence or absence of a lesion, the presence or absence of treatment equipment, and the imaging conditions are used as the second image information. Regarding the presence or absence of a lesion and treatment equipment, the user inputs the lesion image as the first priority, the subject acquisition image as the second priority, and the normal image as the third priority in the input box 105e within the priority image designation area 105d. The image prioritized in the case of a lesion image is called the "lesion image priority image," and the image with imaging conditions set to BLI is selected by selecting the input box 105e. Therefore, when the first display mode setting unit 91 displays the selected key images on the display 52 according to the second image information, it arranges them in the order of lesion image, subject acquisition image, and normal image, and sets the display mode to the lesion image captured by BLI. After the user has completed the settings in the display image settings screen 105, click the switch button (not shown) to switch to the key image automatic selection screen contained in the display image settings screen 105, and switch to the key image automatic selection screen 106.

[0129] Furthermore, it is preferable to have a display number setting unit 94 that sets the maximum number of selected images 106c to be displayed in the key image auto-selection screen 106, and the display control unit 74 controls the number of selected images 106c displayed in the key image auto-selection screen 106 to be less than or equal to the maximum number set by the display number setting unit 94. Figure 16 As shown, in this case, the endoscope image browsing assistance server 20 includes a display number setting unit 94. The display number setting unit 94 sets the maximum number of selected images to be displayed in the selected image display area 106b.

[0130] like Figure 15 As shown, the maximum number of images to be displayed in the selection image display area 106b of the key image auto-selection screen 106 is set according to the user's settings. The user sets this setting, for example, by entering a number in the display image setting area 105f of the display image setting screen 105. For example, the maximum number of images to be displayed is set by entering "10" in the input box displayed as "Maximum number of key images: Total" in the display image setting area 105f. Therefore, the maximum number of images to be displayed in the selection image display mode starts at 10, beginning with the number of images with the highest preset priority. Furthermore, in this case, if the number of images to be displayed in the selection image display mode is 10 or less before setting the display number, the display number is not limited.

[0131] Further, the display control section 74 preferably performs control to display the selection images of which the number of sheets is set by the display sheet number setting section 94 in the second display screen, the number of sheets being equal to or less than the maximum number of sheets per first image information. The setting of the maximum number of sheets per first image information is performed in accordance with the setting by the user, as described above, by inputting, for example, "3" in the input box of the display of the "by each category" in the display sheet number setting region 105f. Thus, the maximum number of sheets of the selection images displayed in the selection image display mode is three sheets from the top of the priority order per site of the first image information. Further, as described above, before the display sheet number is set, in the case where the number of sheets of the selection images displayed in the selection image display mode is three sheets or less, the display sheet number is not limited.

[0132] Further, as shown in Figure 17 , it is preferable to have a display setting saving section 95 that saves the designation and setting by at least one of the first image information designating section 73, the display mode setting section 91, and the display sheet number setting section 94 as a display setting, and the display control section 74 displays the endoscope image 100 in the second display screen in accordance with the display setting. As shown in Figure 17 , the saving control section 75 has the display setting saving section 95. As described above, the designation and setting by the first image information designating section 73, the display mode setting section 91, and the display sheet number setting section 94 implement the automatic selection of the key image. By these combinations, the setting of the automatic selection of the key image can be performed in detail for each user, and thus if the setting is saved as a display setting, in the case where the automatic selection of the key image is to be performed by the same setting next time, the automatic selection of the key image can be performed by the same setting by searching for and reading the saved display setting. Thus, the saved display setting of the automatic selection of the key image can be read by a simple method, and the unnecessary time-consuming work can be saved.

[0133] As shown in Figure 18 , the designation of the first image information designating section 73 is "esophagus stomach junction, descending duodenum, greater curvature of the gastric body, gastric angle and fornix", the setting of the display mode setting section 91 is "priority image" is "1 lesion image, 2 subject acquisition image, 3 normal image", and "lesion image priority image" is "BLI", and the setting of the display sheet number setting section 94 is "maximum key image number" is "whole 10" sheets and "by each category 3" sheets, in the display setting 96. These designations and settings are summarized as the first display setting and saved.

[0134] Further, it is preferable that the display setting be saved for each user. By saving the display setting for each user, it is not necessary to set the detailed setting for each user every time of examination, and thus it is preferable.

[0135] Also, the display setting is preferably saved for each user group including a plurality of users.

[0136] The user group including a plurality of users is, for example, each medical treatment department in a medical facility or the medical facility. Thus, the display setting of the key image automatic setting can be saved for each medical treatment department or medical facility.

[0137] Also, the display setting is preferably saved for each purpose of photography. The purpose of photography can be, for example, screening examination, detailed examination of polyp, or treatment using a treatment instrument. For example, in the screening examination, by calling the display setting in the screening examination, the key image setting screen in which the best key image is automatically displayed in the screening examination can be displayed without time.

[0138] In the above-described embodiments, the hardware structure of the processing units (processing units) such as the reception unit 70, the image acquisition unit 71, the image information assignment unit 72, the first image information designation unit 73, the display control unit 74, and the saving control unit 75 included in the endoscope image browsing assistance server 20 as the medical image processing apparatus, which perform various processes, is various processors as follows. The various processors include a general-purpose processor, that is, a CPU (Central Processing Unit), an FPGA (Field Programmable Gate Array), a programmable logic device (PLD) in which the circuit structure can be changed after manufacture, and a dedicated circuit having a circuit structure specially designed to perform various processes.

[0139] One processing unit can be constituted by one of these various processors, or can be constituted by a combination of two or more processors of the same kind or different kinds (for example, a combination of a plurality of FPGAs or CPUs and FPGAs). Also, a plurality of processing units can be constituted by one processor. As an example in which a plurality of processing units is constituted by one processor, first, there is a manner in which one processor is constituted by a combination of one or more CPUs and software, as typified by a computer such as a client or a server, and functions as a plurality of processing units. Second, there is a manner in which a processor that functions as a system as a whole including a plurality of processing units is implemented by one IC (Integrated Circuit) chip, as typified by a system on chip (SoC) or the like. Thus, the various processing units are constituted using one or more of the above-described various processors as the hardware structure.

[0140] Moreover, more specifically, the hardware structure of these various processors is a circuitry in a form in which circuit elements such as semiconductor elements are combined.

[0141] In addition, the present application can be utilized not only in an endoscope system, a processor device, other related devices, and the like that acquire an endoscope image and the like, but also in a system or a device and the like that acquires a medical image (including a video) other than an endoscope image. For example, the present application can be applied to an ultrasonic examination device, an X-ray image photographing device (including a CT (Computed Tomography) examination device, a mammography device, and the like), an MRI (magnetic resonance imaging) device, and the like.

[0142] Symbol explanation

[0143] 10 - endoscope image browsing assistance system, 12, 24 - network, 14 - endoscope system, 15 - endoscope, 16 - light source device, 17 - processor device, 18 - display, 19 - keyboard, 20 - endoscope image browsing assistance server, 20D - display, 21 - client terminal, 22 - server group, 26 - image server, 28 - report server, 30 - image database, 32 - report database, 34 - examination report, 34A - report body, 40 - CPU, 42 - memory, 44 - storage device, 46 - communication I / F, 48 - input / output section, 50 - data bus, 52 - display, 54 - input device, 56 - application program, 58 - start-up screen, 58A - ID input field, 58B - determination button, 60 - GUI control section, 62 - request issuance section, 70 - reception section, 71 - image acquisition section, 72 - image information assignment section, 73 - 1st image information designation section, 74 - display control section, 75 - saving control section, 81 - 1st image information assignment section, 82 - 2nd image information assignment section, 83 - 1st image information list, 84 - 2nd image information list, 91 - display mode setting section, 92 - screen data generation section, 93 - output control section, 94 - display number setting section, 95 - display setting saving section, 96 - display setting, 100 - endoscope image, 100S - key image, 101 - accompanying information, 101A - illumination light information, 102 - photographing information, 103 - report display screen, 104 - diagnosis opinion, 105 - display image setting screen, 105a - selection area, 105b - non-selection area, 105c, 106f - 1st image information block, 105d - priority image designation area, 105e - input box, 105f - display number setting area, 105h, 106h - schematic diagram display, 106 - key image automatic selection screen, 106a - selection category display area, 106b - selection image display area, 106c - selection image, 106d - non-selection image, 106e - scroll bar, 106g - pop-up button, 106i - 1st image information list, 108 - pointer, S11-S15 - steps.

Claims

1. A medical image processing device, comprising a processor, The processor performs the following processing: Acquire multiple medical images containing images of the subject. By analyzing the medical image, at least one of a plurality of pre-defined first image information is assigned to the medical image. Specify at least one of the multiple first image information items. In response to specifying at least one of the plurality of first image information, the medical image assigned the specified first image information is set as the selected image, and control is performed to display the selected image (i.e., the medical image assigned the specified first image information) in a first display area of ​​the image display screen, and control is performed to display the specified first image information in a second display area of ​​the image display screen respectively. The pre-defined first image information is set based on establishing an association with at least one of the multiple categories. The category is at least one of the following: information relating to the body part contained in the subject image, information relating to the photographic conditions of the medical image, information relating to the lesion contained in the subject image, information relating to the area of ​​interest contained in the subject image, and information relating to the treatment device contained in the subject image.

2. The medical image processing apparatus according to claim 1, wherein, The processor analyzes the medical image and assigns at least one of a plurality of pre-defined second image information to the medical image. The display method for the selected image is set based on the second image information.

3. The medical image processing apparatus according to claim 2, wherein, The pre-defined plurality of second image information are set based on establishing an association with at least one of the plurality of categories.

4. The medical image processing apparatus according to claim 1, wherein, The processors are specified according to each of the categories.

5. The medical image processing apparatus according to claim 1, wherein, The processor controls the display of multiple pieces of the first image information in the third display area of ​​the image display screen according to each of the categories. The designation is made based on the user's selection of multiple pieces of the first image information displayed in the third display area.

6. The medical image processing apparatus according to any one of claims 1 to 5, wherein, The processor is set to the maximum number of selected images displayed in the first display area. Controls are performed to display the selected images, up to and including the set maximum number of images, in the first display area.

7. The medical image processing apparatus according to any one of claims 1 to 5, wherein, The processor performs the analysis based on the first correspondence information, which establishes a correspondence between the medical image containing the first image information and the first image information in advance.

8. The medical image processing apparatus according to any one of claims 2 to 5, wherein, The processor analyzes the medical image and assigns at least one of a plurality of pre-defined second image information to the medical image. The processor performs the analysis based on second correspondence information, which establishes a pre-defined correspondence between the medical image containing the second image information and the second image information.

9. The medical image processing apparatus according to any one of claims 1 to 5, wherein, The specifications made by the processor are saved as display settings. According to the display settings, the selected image is displayed on the image display screen.

10. The medical image processing apparatus according to claim 9, wherein, The display settings are saved for each user.

11. The medical image processing apparatus according to claim 10, wherein, The display settings are saved for each user group that includes multiple users.

12. The medical image processing apparatus according to claim 9, wherein, The medical images were obtained through photography. The display settings are saved according to the purpose of each photograph.

13. A method of operating a medical image processing device, comprising: The image acquisition step involves acquiring multiple medical images containing images of the subject. The image information assignment step involves analyzing the medical image and assigning at least one of a plurality of pre-defined first image information to the medical image. The first image information specification step involves specifying at least one of the multiple first image information items; and In response to specifying at least one of the plurality of first image information, the medical image assigned the specified first image information is designated as the selected image among the plurality of medical images. Control is performed to display the selected image (i.e., the medical image assigned the specified first image information) in a first display area of ​​the image display screen. Control is also performed to display the specified first image information in second display areas of the image display screen. The pre-defined first image information is set based on establishing an association with at least one of the multiple categories. The category is at least one of the following: information relating to the body part contained in the subject image, information relating to the photographic conditions of the medical image, information relating to the lesion contained in the subject image, information relating to the area of ​​interest contained in the subject image, and information relating to the treatment device contained in the subject image.

14. A non-transitory computer-readable medium storing a program that enables a computer to function as a medical image processing device and is executable by the computer, the computer-executable program causing the computer to perform the following functions: Image acquisition function: acquire multiple medical images containing images of the subject; The image information assignment function analyzes the medical image and assigns at least one of a plurality of pre-defined first image information to the medical image; The first image information specification function specifies at least one of a plurality of the first image information; and The display control function, in response to specifying at least one of the plurality of first image information, sets the medical image assigned the specified first image information as the selected image, controls the display of the selected image (i.e., the medical image assigned the specified first image information) in a first display area of ​​the image display screen, and controls the display of the specified first image information in a second display area of ​​the image display screen. The pre-defined first image information is set based on establishing an association with at least one of the multiple categories. The category is at least one of the following: information relating to the body part contained in the subject image, information relating to the photographic conditions of the medical image, information relating to the lesion contained in the subject image, information relating to the area of ​​interest contained in the subject image, and information relating to the treatment device contained in the subject image.

Images