Program, display device, display system, and display method

Abstract

To prevent a lesion to be observed from being overlooked when a lesion candidate region in a medical image and its display information are out of an image display region of a screen and are not displayed on the screen being viewed.SOLUTION: When there exists a lesion candidate region not displayed in an enlarged image that enlarges a predetermined range of a medical image or an annotation of the legion candidate region acquired by computer processing for the medical image and the annotation added to the medical image, a control unit of an information processing device causes a display unit to display any one of the number of lesion candidate regions or the annotations existing out of the predetermined range of the medical image and within the medical image, a direction with the enlarged image as a reference, and the position with the enlarged image as a reference.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] The present invention relates to a program, a display device, a display system, and a display method.

Background Art

[0002] In recent years, a diagnostic support (CAD: Computer Aided Detection / Diagnosis) system has been put into practical use, which analyzes medical images using a computer, presents a lesion candidate region detected by the image analysis to a doctor, and asks for the doctor's judgment.

[0003] For example, Patent Document 1 describes a diagnostic support system that marks a lesion candidate region detected by a diagnostic support program (CAD) and displays it on a medical image.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in a system that displays display information such as marks and annotations indicating a lesion candidate region on a medical image as in Patent Document 1, when the medical image is enlarged, the lesion candidate region and the display information may go out of the image display area of the screen and may not be displayed on the screen being viewed. Therefore, a doctor may not notice from the beginning or may forget to check that the lesion candidate region and its display information are displayed outside the image display area of the screen, and may overlook the lesion to be seen.

[0006] Especially recently, from the perspective of business improvement, image analysis by AI (Artificial Intelligence) There is an increasing number of cases where a diagnosis is made by comparing the results with the results of radiological readings by doctors. The above problems have become apparent due to the increasing opportunities for AI to enter into image diagnosis.

[0007] The present invention has been made in view of the problems in the above prior art, and aims to prevent overlooking a lesion to be seen by preventing the lesion candidate region in a medical image and its display information from going out of the image display region on the screen and not being displayed on the screen being viewed.

Means for Solving the Problems

[0008] In order to solve the above problems, the program according to the present invention causes a computer to have an acquisition function for acquiring first information indicating a first lesion candidate region in a medical image, and a display function for displaying, on a display unit, the medical image with first display information attached based on the first information, and is a program for causing when the display function displays, on the display unit, an enlarged image obtained by enlarging a predetermined range of the medical image with the first display information attached, if all of the first lesion candidate region or the first display information existing in the medical image are not displayed within the enlarged image, to display, on the display unit, any one of the number of the first lesion candidate region or the first display information existing outside the predetermined range of the medical image and within the medical image, the direction based on the enlarged image, and the position based on the enlarged image.

[0009] The display device according to the present invention comprises an acquisition means for acquiring first information indicating a first lesion candidate region in a medical image, and a display control means for displaying, on a display unit, the medical image with first display information attached based on the first information, and is a display device comprising When the display control means causes the display unit to display an enlarged image obtained by enlarging a predetermined range of the medical image with the first display information attached thereto, when all of the first lesion candidate regions or the first display information existing in the medical image are not displayed within the enlarged image, any one of the number of the first lesion candidate regions or the first display information existing outside the predetermined range of the medical image and within the medical image, the direction based on the enlarged image, and the position based on the enlarged image is displayed on the display unit.

[0010] A display system according to the present invention includes acquisition means for acquiring first information indicating a first lesion candidate region in a medical image, display control means for causing the display unit to display the medical image with the first display information attached thereto based on the first information, and is a display system comprising: When the display control means causes the display unit to display an enlarged image obtained by enlarging a predetermined range of the medical image with the first display information attached thereto, when all of the first lesion candidate regions or the first display information existing in the medical image are not displayed within the enlarged image, any one of the number of the first lesion candidate regions or the first display information existing outside the predetermined range of the medical image and within the medical image, the direction based on the enlarged image, and the position based on the enlarged image is displayed on the display unit.

[0011] A display method according to the present invention includes an acquisition step of acquiring first information indicating a first lesion candidate region in a medical image, a display step of causing the display unit to display the medical image with the first display information attached thereto based on the first information, and is a display method comprising: When the display step causes the display unit to display an enlarged image obtained by enlarging a predetermined range of the medical image with the first display information attached thereto, When all of the first lesion candidate regions or the first display information present in the medical image are not displayed within the magnified image, any one of the number of the first lesion candidate regions or the first display information that exists outside a predetermined range of the medical image and within the medical image, the direction based on the magnified image, and the position based on the magnified image is displayed on the display unit.

Advantages of the Invention

[0012] According to the present invention, it is possible to prevent overlooking a lesion to be seen because a lesion candidate region or its display information in a medical image deviates from the image display region of the screen and is not displayed on the viewing screen.

Brief Description of the Drawings

[0013]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

[0014] Hereinafter, an embodiment of a program, a display device, a display system, and a display method according to the present invention will be described. However, the scope of the invention is not limited to the illustrated examples.

[0015] <First Embodiment> [Configuration of Medical Image Display System] FIG. 1 shows the system configuration of a medical image display system 100 as the display system of the present invention. As shown in FIG. 1, the medical image display system 100 includes a medical image management server 10, modalities 20, 20, ···, and an information processing device 30. Each device constituting the medical image display system 100 can perform data communication via a communication network N. Each device constituting the medical image display system 100 conforms to standards such as HL7 (Health Level Seven) and DICOM (Digital Image and Communications in Medicine), and communication between each device is performed in accordance with HL7 and DICOM. Note that the number of information processing devices 30 is not particularly limited.

[0016] The modality 20 performs imaging of a patient (subject) and generates image data of a medical image. As the modality 20, for example, CR (Computed Radiography), DR (Digital Radiography), CT (Computed Tomography), MRI (Magnetic Resonance Imaging), US (Ultra Sonography), NM (Nuclear Medicine), ES (Endoscope), etc. are used. In addition, the modality 20 attaches image attribute information related to the medical image to the medical image. The image attribute information includes a patient ID, patient name, date of birth, gender, imaging date and time, image ID, modality, part, direction, etc. The image data of the medical image generated by the modality 20 is transmitted to the medical image management server 10.

[0017] The medical image management server 10 stores and manages the image data of the medical image generated in the modality 20. Examples of the medical image management server 10 include a PACS (Picture Archiving and Communication System).

[0018] The information processing device 30 is a computer device such as a PC (Personal Computer) or a tablet. The information processing device 30 is a display device that displays medical images and their analysis results when a user such as a doctor reads the medical images.

[0019] [Configuration of Medical Image Management Server] Fig. 2 shows the functional configuration of the medical image management server 10. The medical image management server 10 includes a control unit 11, a communication unit 12, an image analysis unit 13, a storage unit 14, etc., and each unit is connected by a bus 15.

[0020] The control unit 11 is composed of a CPU (Central Processing Unit), a RAM (Random Access Memory), etc., and comprehensively controls the processing operations of each unit of the medical image management server 10. Specifically, the CPU reads out various processing programs stored in the storage unit 14 and expands them in the RAM, and performs various processes in cooperation with the programs.

[0021] The communication unit 12 is composed of a network interface, etc., and transmits and receives data to and from external devices connected via the communication network N. For example, the communication unit 12 receives medical images obtained by photographing a patient with the modality 20. In addition, the communication unit 12 transmits the medical images and analysis results requested by the information processing device 30 to the information processing device 30.

[0022] The image analysis unit 13 performs computer processing on medical images obtained by photographing a patient and generates data of the analysis results. Here, as the computer processing, for example, image diagnosis and image analysis including detection of lesion candidate regions using CAD (Computer Aided Diagnosis) or AI (Artificial Intelligence) are used. The data of the analysis results is composed of, for example, DICOM's GSPS (Grayscale Softcopy Presentation State) data, overlay data, etc. The data of the analysis results includes an analysis result ID for identifying the analysis results, information on each detected lesion candidate region (position information, type of lesion, display information (for example, annotation)). The image analysis unit 13 is realized by software processing through the cooperation of the program stored in the storage unit 14 and the CPU of the control unit 11.

[0023] The storage unit 14 is composed of an HDD (Hard Disk Drive), a non-volatile semiconductor memory, etc., and stores various processing programs, parameters and files necessary for the execution of the program, etc.

[0024] In addition, the storage unit 14 stores a user management table 141 and a data management table 142. The storage unit 14 also has a medical image storage area 143, an analysis result storage area 144, and a reading result storage area 145.

[0025] The user management table 141 is a table for managing users (medical staff such as doctors) who use the medical image display system 100. In the user management table 141, for each user, a user ID, password, name, affiliation, email address, phone number, etc. are associated and stored. The user ID is the identification information of the user. The password is used for authentication when the user accesses the medical image management server 10 from the information processing device 30. The name is the name of the user. The affiliation is information such as the medical facility and department to which the user belongs. The email address is the email address of the user. The phone number is the phone number of the user.

[0026] The data management table 142 is a table for managing data within the medical image management server 10. Fig. 3 shows an example of the data configuration of the data management table 142. In the data management table 142, for each medical image stored in the medical image storage area 143, an image ID, patient ID, shooting date and time, modality, part, direction, analysis result ID, reading result ID, etc. are associated and stored. The image ID is the identification information of the medical image. The patient ID is the identification information of the patient who is the subject of the medical image shooting. The shooting date and time is the date and time when the medical image was shot. The modality is the modality in which the medical image was shot. The part is the part that is the subject of the medical image shooting. The direction is the shooting direction of the medical image. The analysis result ID is the identification information of the analysis result obtained by the image analysis unit 13 analyzing the medical image. The reading result ID is the identification information for identifying the reading result by the user (doctor) for the medical image.

[0027] The medical image storage area 143 stores the image data of the medical image received from the modality 20. The analysis result storage area 144 stores the data of the analysis result obtained by computer processing on the medical image. As described above, the analysis result data includes the analysis result ID for identifying the analysis result, information on each detected lesion candidate area (position information, type of lesion, display information (e.g., annotation)). In the reading result storage area 145, data on the reading results of medical images by a doctor (a reading doctor) who is a user is stored. The reading results include a reading result ID, information on the lesion candidate areas input by the user (position information, type of lesion, display information (e.g., annotation information)).

[0028] When the control unit 11 receives a medical image from the modality 20 via the communication unit 12, it stores the medical image in the storage unit 14 and causes the image analysis unit 13 to analyze the medical image.

[0029] When the control unit 11 receives an acquisition request for a medical image and its analysis result from the information processing device 30 via the communication unit 12, it reads out the medical image and its analysis result from the storage unit 14 and provides the read medical image and analysis result to the information processing device 30 via the communication unit 12.

[0030] [Configuration of the Information Processing Device] Fig. 4 shows the functional configuration of the information processing device 30. The information processing device 30 includes a control unit 31, an operation unit 32, a display unit 33, a communication unit 34, a storage unit 35, etc., and each unit is connected by a bus 36.

[0031] The control unit 31 is composed of a CPU, a RAM, etc., and comprehensively controls the processing operations of each unit of the information processing device 30. Specifically, the CPU of the control unit 31 reads out various processing programs including the reading support processing program 351 stored in the storage unit 35 and expands them in the RAM, and performs various processes in cooperation with the expanded programs.

[0032] For example, when the CPU of the control unit 31 has a medical image to be read specified by the operation unit 32, it obtains, in cooperation with the reading support processing program 351 stored in the storage unit 35, the specified medical image and first information indicating a first lesion candidate region obtained by computer processing on the medical image from the medical image management server 10. Then, it displays on the display unit 33 a medical image with the first display information attached thereto. That is, the control unit 31 functions as the acquisition means and the display control means of the present invention. Here, the first lesion candidate region is a certain lesion candidate region among the lesion candidate regions obtained by computer processing on the medical image. The first information is the position information of the first lesion candidate region. The first display information is display information such as an annotation attached to the first lesion candidate region of the medical image.

[0033] Further, when the control unit 31 causes the display unit 33 to display a medical image with the first display information attached thereto, if the first lesion candidate region or the first display information is not displayed within the image display region 331b (see FIG. 8) of the display unit 33, it causes the display unit 33 to display information indicating the existence of the first lesion candidate region or the first display information. The information indicating the existence of the first lesion candidate region or the first display information includes, for example, information indicating that the first lesion candidate region or the first display information is not displayed within the image display region 331b. The information indicating the existence of the first lesion candidate region or the first display information is, for example, displayed in the display region (screen region) of the display unit 33. The display region includes the image display region 331b which is the region for displaying the medical image. Also included are the window frame 331a, the background display region 331c, and the tool display region 331d which will be described later.

[0034] The operation unit 32 includes a keyboard having cursor keys, character / numeric input keys, various function keys, etc., and a pointing device such as a mouse, and outputs an operation signal input by a key operation or a mouse operation on the keyboard to the control unit 31. Further, when the operation unit 32 is constituted by a touch panel laminated on the display unit 33, it outputs an operation signal corresponding to the position of a touch operation by a user's finger or the like to the control unit 31.

[0035] The display unit 33 includes a monitor such as an LCD (Liquid Crystal Display), and displays various screens according to an instruction of a display signal input from the control unit 31.

[0036] The communication unit 34 is constituted by a network interface or the like, and performs data transmission and reception with an external device connected via a communication network N.

[0037] The storage unit 35 is constituted by an HDD, a non-volatile semiconductor memory, etc., and stores various processing programs, parameters, files, etc. necessary for the execution of the programs. For example, a reading support processing program 351 is stored in the storage unit 35. The reading support processing program 351 includes a program for executing an analysis result display process A (see FIG. 7) described later.

[0038] [Operation in the medical image display system] Next, the operation in the medical image display system 100 will be described. First, the medical image analysis process executed by the medical image management server 10 will be described. FIG. 5 is a flowchart showing the medical image analysis process executed by the medical image management server 10. This process is realized by software processing in cooperation with the CPU of the control unit 11 and the program stored in the storage unit 14.

[0039] In the medical image management server 10, when receiving a medical image obtained by photographing a patient from the modality 20 via the communication unit 12 (step S1), the control unit 11 stores the received medical image in the medical image storage area 143 of the storage unit 14 (step S2). Further, the control unit 11 associates the image ID, patient ID, photographing date and time, modality, part, direction, etc. included in the image attribute information of the received medical image, and stores them in the data management table 142 (see FIG. 3) of the storage unit 14.

[0040] Next, the control unit 11 causes the image analysis unit 13 to analyze the received medical image (step S3). The image analysis unit 13 performs computer processing on the medical image by AI (Artificial Intelligence) or the like to obtain a lesion candidate area, and generates data of an analysis result including information on the obtained lesion candidate area.

[0041] Next, the control unit 11 stores the analysis result obtained by the image analysis unit 13 in the storage unit 14 in association with the medical image (step S4), and ends the medical image analysis process. Specifically, the control unit 11 stores the analysis result in the analysis result storage area 144 of the storage unit 14, and stores the analysis result ID of the analysis result in the record corresponding to the medical image to be analyzed in the data management table 142 of the storage unit 14.

[0042] Next, the process executed by the information processing apparatus 30 will be described. The following process executed by the control unit 31 of the information processing apparatus 30 is realized by software processing in cooperation with the CPU of the control unit 31 and the reading support processing program 351 stored in the storage unit 35.

[0043] In the information processing apparatus 30, when an image ID or the like of a medical image to be read is specified by an operation from the user operation unit 32, the control unit 31 acquires the medical image including the specified image ID and the analysis result of the medical image. For example, when the image ID, etc. of the medical image to be read is specified by an operation from the user operation unit 32, the control unit 31 transmits a request to acquire the medical image including the specified image ID and the analysis result of the medical image to the medical image management server 10 via the communication unit 34. The control unit 11 of the medical image management server 10 reads out the medical image corresponding to the image ID included in the acquisition request from the medical image storage area 143, and transmits the medical image to the information processing device 30 via the communication unit 12. Further, the control unit 11 refers to the data management table 142 of the storage unit 14, specifies the "analysis result ID" from the record corresponding to the "image ID" of the medical image for which the acquisition request has been made, reads out the analysis result corresponding to this "analysis result ID" from the analysis result storage area 144, and transmits the analysis result to the information processing device 30 via the communication unit 12. When the "reading result ID" is stored in the record corresponding to the "image ID" of the medical image for which the acquisition request has been made, the control unit 11 reads out the reading result corresponding to this "reading result ID" from the reading result storage area 145, and transmits the reading result to the information processing device 30 via the communication unit 12. In the information processing device 30, when the medical image to be read and its analysis result are acquired from the medical image management server 10 via the communication unit 34, the control unit 31 stores the acquired medical image and analysis result in the storage unit 35 or the primary storage area of the RAM. The medical image stored in this temporary storage area is the medical image to be read, and the information on the lesion candidate area included in the analysis result stored in the temporary storage area is the information on the lesion candidate area to be confirmed by the user.

[0044] Next, the control unit 31 displays the reading screen 331 on which the acquired medical image is displayed on the display unit 33. FIG. 6 is a diagram showing an example of the reading screen 331. As shown in FIG. 6, the reading screen 331 is provided with a window frame 331a, an image display area 331b, a background display area 331c, a tool display area 331d, an analysis result display button 331e, an end button 331f, etc. The window frame 331a is the frame of a window having an image display area 331b. The image display area 331b is an area for displaying a medical image to be read. The background display area 331c is a background area that serves as a background for the image display area 331b. The tool display area 331d is an area where operation icons are displayed. The analysis result display button 331e is a button for instructing to display display information (annotation) on a lesion candidate area obtained by computer processing on the medical image displayed in the image display area 331b. The end button 331f is a button for instructing the end of reading.

[0045] Also, when a reading result corresponding to the medical image to be read is transmitted from the medical image management server 10, a reading result button (not shown in the figure) is displayed on the reading screen 331. The reading result button is a button for instructing to display display information (annotation) on the lesion candidate area detected by reading. Also, when the medical image in the image display area 331b is being operated, an active frame 331g indicating that it is being operated is displayed.

[0046] On the reading screen 331, the reading doctor, who is the user, observes the medical image displayed in the image display area 331b. Then, when a lesion candidate area is detected by reading, the user designates the lesion candidate area by the operation unit 32 and inputs information on the lesion candidate area (position information of the lesion candidate area, type of lesion, display information (annotation)) as a reading result. For example, when the user designates (e.g., right-clicks) the position of an area that seems to be a lesion on the medical image displayed in the image display area 331b using the operation unit 32, the control unit 31 displays menu items (e.g., right-click menu) including the type of the lesion in the vicinity of the designated position. When the type of the lesion in the designated area is selected from among the menu items by the operation unit 32, the control unit 31 attaches display information (annotation) indicating that the designated area of the medical image is the lesion candidate area detected by the user, and temporarily stores the reading result (position information of the lesion detection area, type of the lesion, display information (annotation)) by the user in the storage unit 35 or the RAM.

[0047] Also, on the reading screen 331, the user presses the analysis result display button 331e with the operation unit 32 to display the display information (annotation) of the lesion candidate area obtained by computer processing such as AI for the medical image to be read on the medical image displayed in the image display area 331b and checks the analysis result. Also, when there is already a reading result by a primary reader or the like, the user can press a reading result button (not shown) with the operation unit 32 to display the display information (annotation) of the lesion candidate area obtained by reading on the medical image displayed in the image display area 331b and check the reading result.

[0048] Here, when a certain reader (e.g., secondary reader) reads a medical image in which a lesion candidate area has been detected by another reader (e.g., primary reader), since it is reading by the same human, the viewpoints for detecting the lesion candidate area are similar, and the possibility of overlooking the lesion candidate area detected by the other reader is low. Therefore, there was little need to check the lesion candidate area detected by the other reader. On the other hand, in analysis by computer processing such as AI, since it is possible to detect a lesion candidate area that a human doctor may not notice, if the reader does not check the analysis result, the reader is highly likely to overlook the lesion. Therefore, the reader needs to be aware of the existence of the annotation indicating the analysis result by computer processing.

[0049] In addition, in the case where there are cases where overlooking is likely to occur during reading by a radiologist, not only can annotations be added to the suspected lesion area, but points to be noted in the reading findings can also be described or sent as a reminder. Therefore, even if the suspected lesion area detected by the primary radiologist or its annotation is displayed outside the image display area, it is less likely to be overlooked. On the other hand, in analysis by computer processing such as AI, since no sending as a reminder is made, if the suspected lesion area or its annotation is displayed outside the image display area, overlooking is likely to occur.

[0050] In addition, the annotations added by computer processing such as AI do not consider the visibility when annotating medical images, and it is easy for doctors to overlook them. For example, there has been a situation where AI attaches an annotation of the same color to a white area on a medical image, and even if it moves outside the image display area, it is difficult for the radiologist to notice and overlooking is likely to occur.

[0051] As described above, when an annotation is added to a suspected lesion area obtained by computer processing such as AI for a medical image, if the suspected lesion area or the annotation is displayed outside the image display area and the radiologist forgets to check it, a problem occurs from the perspective of preventing overlooking.

[0052] Therefore, in the information processing apparatus 30 of the present embodiment, when the analysis result display button 331e is pressed by the operation unit 32, the analysis result display process A shown in FIG. 7 is executed. As a result, although the analysis result by computer processing (for example, annotation by AI) is displayed attached to the medical image, even in the case where the annotation indicating the analysis result is not displayed within the image display area 331b by magnifying or moving the medical image displayed in the image display area 331b, it is possible to prevent the doctor from overlooking the lesion to be seen.

[0053] FIG. 7 is a flowchart showing the flow of the analysis result display process A. This process is realized by software processing in cooperation with the CPU of the control unit 31 and the reading support processing program 351 stored in the storage unit 35.

[0054] In the analysis result display process A, first, the control unit 31 acquires position information indicating the position of the lesion candidate region in the medical image from the analysis result of the medical image displayed in the image display area 331b (step S11).

[0055] Next, the control unit 31 causes the entire medical image with an annotation attached to the position of the lesion candidate region to be displayed in the image display area 331b of the reading screen 331 based on the acquired position information (step S12). FIG. 8 is a diagram showing an example of the reading screen 331 in which the medical image with an annotation attached to the position of the lesion candidate region is displayed in the image display area 331b in step S12. On the medical image displayed in the image display area 331b, three lesion candidate regions obtained by computer processing are displayed, and annotations A1, A2, and A3 are attached thereto, respectively.

[0056] Next, the control unit 31 determines whether or not an enlargement of the medical image displayed in the image display area 331b is instructed (step S13). For example, when the "magnifying glass" icon in the tool display area 331d is pressed by the operation unit 32, the control unit 31 determines that an enlargement of the medical image displayed in the image display area 331b is instructed.

[0057] If it is determined that the enlargement of the medical image displayed in the image display area 331b is not instructed (step S13; NO), the control unit 31 proceeds to step S21.

[0058] If it is determined that the enlargement of the medical image displayed in the image display area 331b is instructed (step S13; YES), the control unit 31 enlarges and displays the medical image displayed in the image display area 331b (step S14).

[0059] Next, the control unit 31 determines whether there is a lesion candidate region or an annotation that is not displayed within the image display region 331b among the lesion candidate regions or annotations displayed in step S12 (step S15). If it is determined that there is a lesion candidate region or an annotation that is not displayed within the image display region 331b among the lesion candidate regions or annotations displayed in step S12 (step S15; YES), the control unit 31 causes the display unit 33 to display information indicating the existence of the lesion candidate region or annotation that is not displayed in the image display region 331b (step S16), and proceeds to step S17. For example, when the first lesion candidate region or the first display information (annotation indicating the position of the first lesion candidate region) is not displayed within the image display region 331b, the control unit 31 causes the display unit 33 to display information indicating the existence of the first lesion candidate region or the first display information.

[0060] In step S16, the control unit 31 causes the display unit 33 to display, as information indicating the existence of a lesion candidate region or an annotation that is not displayed in the image display region 331b, for example, display information in which the window frame 331a is changed, display information in which the background display region 331c is changed, or display information in which the tool display region 331d is changed. For example, as shown in FIG. 9, the control unit 31 causes the display unit 33 to display, as information indicating the existence of a lesion candidate region or an annotation that is not displayed in the image display region 331b, display information in which the color of the window frame 331a is changed, display information in which the color of the background display region 331c is changed, or display information in which the color of the tool display region 331d is changed. In FIG. 9, the colors of all of the window frame 331a, the background display region 331c, and the tool display region 331d are changed, but at least one or more colors may be changed. For example, when the first lesion candidate region or the first display information is not displayed within the image display region 331b, the control unit 31 displays, as information indicating the existence of the first lesion candidate region or the first display information, display information in which the window frame 331a (for example, color) is changed, display information in which the background display region 331c (for example, color) is changed, or display information in which the tool display region 331d (for example, color) is changed on the display unit 33.

[0061] When changing the color of the window frame 331a, the background display region 331c, or the tool display region 331d, the control unit 31 may gradually change the color to be displayed according to the number of lesion candidate regions or annotations existing outside the image display region 331b. For example, it may be blue when the number of lesion candidate regions or annotations existing outside the image display region 331b is within a predetermined threshold, and red when it exceeds the predetermined threshold. Also, the color may be partially changed only in the direction in which there is a lesion candidate region or an annotation outside the image display region 331b. For example, when there is a lesion candidate region or an annotation on the left side of the region displayed in the image display region 331b, it may be possible to change the color only in the left side portion of the window frame 331a, the background display region 331c, or the tool display region 331d. Thereby, it becomes possible for the user to easily recognize in which direction there is a lesion candidate region or an annotation that is not displayed in the image display region 331b.

[0062] Also, in step S16, as information indicating the existence of a lesion candidate region or annotation not displayed in the image display area 331b, the control unit 31 may display, for example, as shown in FIG. 10, marks M (for example, arrow marks M1 to M3 in FIG. 10) indicating the direction in which the lesion candidate region or annotation exists on the display unit 33. For example, when the first lesion candidate region or the first display information is not displayed within the image display area 331b, the control unit 31 may display, as information indicating the existence of the first lesion candidate region or the first display information, a mark M indicating the direction in which the first lesion candidate region or the first display information exists on the display unit 33. Thereby, the user can easily recognize in which direction the lesion candidate region or annotation not displayed in the image display area 331b exists.

[0063] Also, in step S16, as information indicating the existence of a lesion candidate region or annotation not displayed in the image display area 331b, the control unit 31 may display, for example, as shown in FIG. 11, display information in which the active frame 331g is changed on the display unit 33. For example, it may be to display display information in which the color of the active frame 331g is changed on the display unit 33. When changing the active frame 331g, among the four corners of the active frame 331g, it is also possible to change the corner in the direction in which the lesion candidate region or annotation not displayed within the image display area 331b exists. Thereby, the user can easily recognize in which direction the lesion candidate region or annotation not displayed in the image display area 331b exists. Also, according to the number of lesion candidate regions or annotations existing outside the image display area 331b, the displayed color may be changed step by step. For example, when the first lesion candidate region or the first display information is not displayed within the image display area 331b, the control unit 31 may display, as information indicating the existence of the first lesion candidate region or the first display information, display information in which the active frame 331g is changed on the display unit 33. For example, among the four corners of the active frame 331g, it is also possible to change the color of the corner in the direction in which the first lesion candidate region or the first display information exists.

[0064] Also, in step S16, as information indicating the existence of a lesion candidate region or annotation not displayed in the image display area 331b, for example, as shown in FIG. 12, the control unit 31 may cause the display unit 33 to display information (reduced image 331i) obtained by reducing a medical image with an attached annotation. For example, when the first lesion candidate region or the first display information is not displayed within the image display area 331b, the display unit 33 may display information (reduced image 331i) obtained by reducing a medical image with the first display information attached. Thereby, it becomes possible for the user to easily recognize where in the medical image a lesion candidate region or annotation exists. Also, the control unit 31 may perform display control of the medical image enlarged and displayed in the image display area 331b based on an operation on the reduced image area where the reduced image 331i is displayed. For example, the control unit 31 may display a frame 331j indicating the range of the region enlarged and displayed within the image display area 331b in the medical image within the reduced image area, and in response to an operation of moving the frame 331j, enlarge and display the region displayed within the frame 331j in the image display area 331b. Thereby, it becomes possible to efficiently display the lesion candidate region or annotation that the user should confirm.

[0065] Also, in step S16, as information indicating the existence of a lesion candidate region or annotation not displayed in the image display area 331b, for example, as indicated by reference numeral 331k in FIG. 13, the control unit 31 may display the number of all lesion candidate regions obtained by computer processing on the displayed medical image and the number of lesion candidate regions displayed within the image display area 331b. Alternatively, as information indicating the existence of a lesion candidate region or annotation not displayed in the image display area 331b, the control unit 31 may display the number of all lesion candidate regions obtained by computer processing on the displayed medical image and the number of lesion candidate regions not displayed within the image display area 331b.

[0066] On the other hand, in step S15, when it is determined that there is no lesion candidate region or annotation that is not displayed within the image display area 331b (step S15; NO), the control unit 31 proceeds to step S17.

[0067] In step S17, the control unit 31 determines whether a predetermined operation (for example, a movement operation of the frame 331j or a drag operation on the image display area 331b, etc.) for moving the region of the medical image to be displayed within the image display area 331b has been performed by the operation unit 32 (step S17). When it is determined that a predetermined operation for moving the region of the medical image to be displayed in the image display area 331b has been performed by the operation unit 32 (step S17; YES), the control unit 31 moves the region of the medical image to be displayed within the image display area 331b according to the operation (step S18), and returns to step S15.

[0068] When it is determined that a predetermined operation for moving the region of the medical image to be displayed in the image display area 331b has not been performed by the operation unit 32 (step S17; NO), the control unit 31 determines whether the operation unit 32 has instructed to cancel the magnification of the medical image (step S19). For example, when the magnifying glass in the tool display area 331d is pressed again, the control unit 31 determines that an instruction to cancel the magnification of the medical image has been given.

[0069] When it is determined that an instruction to cancel the magnification of the medical image has not been given (step S19; NO), the control unit 31 returns to step S17. When it is determined that an instruction to cancel the magnification of the medical image has been given (step S19; YES), the control unit 31 cancels the magnification of the medical image (returns to the original size) and causes it to be displayed in the image display area 331b (step S20), and proceeds to step S21.

[0070] In step S21, the control unit 31 determines whether an instruction to end the display of the analysis result has been given (step S21). For example, when the analysis result display button 331e is pressed again, the control unit 31 determines that the display of the analysis result is instructed to end. When it is determined that the end of the display of the analysis result is not instructed (step S21; NO), the control unit 31 returns to step S13. When it is determined that the end of the display of the analysis result is instructed (step S21; YES), the control unit 31 ends the analysis result display process A.

[0071] As described above, in the analysis result display process A, among the lesion candidate regions obtained by computer processing on the medical image or the annotations attached to the medical image, if there is a lesion candidate region or an annotation that is not displayed within the image display region 331b of the display unit 33, the control unit 31 causes the display unit 33 to display information indicating the existence of the lesion candidate region or annotation that is not displayed in the image display region 331b. Therefore, it is possible to prevent the user from overlooking the lesion to be viewed because the lesion candidate region in the medical image and its annotation as display information are out of the image display region on the screen and are not displayed on the screen being viewed.

[0072] <Second Embodiment> Hereinafter, a second embodiment of the present invention will be described. The configuration of the medical image display system 100 in the second embodiment and the configuration of each device constituting the medical image display system 100 are the same as those described in the first embodiment, so the description is incorporated by reference. Also, the operation of the medical image management server 10 is the same as that described in the first embodiment, so the description is incorporated by reference. Hereinafter, the operation of the information processing device 30 will be described.

[0073] In the second embodiment, for example, the CPU of the control unit 31 executes the following operations in cooperation with the reading support processing program 351 stored in the storage unit 35. The control unit 31 acquires first information indicating a first lesion candidate region obtained by computer processing in the medical image management server 1, and causes the display unit 33 to display a medical image with the first display information attached based on the first information. That is, the control unit 31 functions as the acquisition means and the display control means of the present invention. Note that the first lesion candidate region, the first information, and the first display information are as described in the first embodiment.

[0074] In addition, when the control unit 31 causes the display unit 33 to display a medical image with the first display information attached, if the first lesion candidate region or the first display information is not displayed within the image display region 331b of the display unit 33, the control unit 31 causes the first lesion candidate region or the first display information to be displayed on the display unit 33 based on a predetermined instruction input. After displaying the first lesion candidate region or the first display information on the display unit 33 based on a predetermined instruction input, the control unit 31 switches from the first lesion candidate region or the first display information displayed within the image display region 331b of the display unit 33 to a second display information based on a second lesion candidate region not displayed in the image display region 331b or second information indicating the second lesion candidate region, and causes the display unit 33 to display the switched information. The second lesion candidate region is a lesion candidate region different from the first lesion candidate region. The second information is the position information of the second lesion candidate region. The second display information is, for example, an annotation indicating the second lesion candidate region.

[0075] The control unit 31 realizes the above operation in the second embodiment, for example, by executing the analysis result display process B shown in FIG. 14 when the analysis result display button 331e is pressed by the operation unit 32 on the reading screen 331 shown in FIG. 6. As a result, although the analysis result by computer processing (for example, annotation by AI) is displayed on the medical image, even in a case where the annotation indicating the analysis result is not displayed within the image display region 331b due to zooming in or out or moving of the medical image displayed in the image display region 331b, it is possible to prevent the doctor from overlooking the lesion to be seen.

[0076] Note that, as described in the first embodiment, in the information processing apparatus 30, when a medical image to be read is designated by the user, the control unit 31 acquires the medical image to be read and its analysis result from the medical image management server 10 via the communication unit 34. The control unit 31 stores the acquired medical image and analysis result in the storage unit 35 or the primary storage area of the RAM (first storage means). The medical image stored in this temporary storage area is the medical image to be read. The information on the lesion candidate area included in the analysis result stored in the temporary storage area is the information on the lesion candidate area to be confirmed by the user. The control unit 31 controls the display of the reading screen 331 and the display of the annotation of the lesion candidate area based on the medical image and analysis result stored in the temporary storage area.

[0077] FIG. 14 is a flowchart showing the flow of the analysis result display process B. This process is realized by software processing in cooperation with the CPU of the control unit 31 and the reading support process program 351 stored in the storage unit 35. Hereinafter, the analysis result display process B will be described.

[0078] In the analysis result display process B, first, the control unit 31 acquires position information indicating the position of the lesion candidate area in the medical image from the analysis result of the displayed medical image (step S31).

[0079] Next, the control unit 31 causes the medical image with an annotation attached to the position of the lesion candidate area to be displayed in the image display area 331b of the reading screen 331 based on the acquired position information (step S32).

[0080] Next, the control unit 31 determines whether or not an enlargement of the medical image displayed in the image display area 331b is instructed (step S33). For example, when the "magnifying glass" icon in the tool display area 331d is pressed by the operation unit 32, the control unit 31 determines that an enlargement of the medical image displayed in the image display area 331b is instructed.

[0081] When it is determined that the magnification of the medical image displayed in the image display area 331b is not instructed (step S33; NO), the control unit 31 proceeds to step S43.

[0082] When it is determined that the magnification of the medical image displayed in the image display area 331b is instructed (step S33; YES), the control unit 31 enlarges and displays the medical image displayed in the image display area 331b (step S34).

[0083] Next, the control unit 31 determines whether there is a lesion candidate region or an annotation that is not displayed in the image display area 331b among the lesion candidate regions or annotations displayed in step S32 (step S35).

[0084] When it is determined that there is no lesion candidate region or annotation that is not displayed in the image display area 331b among the lesion candidate regions or annotations displayed in step S32 (step S35; NO), the control unit 31 determines whether the release of the magnification of the medical image is instructed by the operation unit 32 (step S41). For example, when the magnifying glass in the tool display area 331d is pressed again, the control unit 31 determines that the release of the magnification of the medical image is instructed. When it is determined that the release of the magnification of the medical image is instructed by the operation unit 32 (step S41; YES), the control unit 31 proceeds to step S42. When it is determined that the release of the magnification of the medical image is not instructed by the operation unit 32 (step S41; NO), the control unit 31 proceeds to step S43.

[0085] On the other hand, when it is determined that there is a lesion candidate region or an annotation that is not displayed in the image display area 331b among the lesion candidate regions or annotations displayed in step S32 (step S35; YES), the control unit 31 sets 1 to the variable n and sequentially assigns numbers from 1 to the non-displayed lesion candidate regions or annotations (step S36).

[0086] Next, the control unit 31 waits for a predetermined instruction input to be performed by the operation unit 32 (step S37). The predetermined instruction input is, for example, the pressing of a preset key (for example, a predetermined key such as a right arrow key or an up arrow key).

[0087] When it is determined that a predetermined instruction input has been performed (step S37; YES), the control unit 31 changes the area of the medical image to be displayed in the image display area 331b and causes the nth lesion candidate area or annotation that is not displayed to be displayed (step S38). For example, the control unit 31 changes the area of the medical image to be displayed in the image display area 331b so that the nth lesion candidate area or annotation that is not displayed is displayed at the center of the image display area 331b. Since the annotation is displayed attached to the lesion candidate area of the medical image, generally, both the nth lesion candidate area and the annotation are displayed in step S38.

[0088] Next, the control unit 31 determines whether the display of all the lesion candidate areas or annotations to be confirmed by the user has ended (step S39). When it is determined that the display of all the lesion candidate areas or annotations to be confirmed by the user has not ended (step S39; NO), the control unit 31 increments the variable n (step S40) and returns to step S37. Then, steps S37 to S39 are repeatedly executed. That is, until the display of all the lesion candidate areas or annotations to be confirmed by the user ends, each time a predetermined instruction input is performed, the control unit 31 changes the area of the medical image to be displayed in the image display area 331b and switches the displayed lesion candidate area or annotation.

[0089] When it is determined that the display of all the lesion candidate areas or annotations to be confirmed by the user has ended (step S39; YES), the control unit 31 proceeds to step S42.

[0090] In step S42, the control unit 31 cancels the magnification of the medical image (returns it to the original size) and causes it to be displayed in the image display area 331b (step S42), and then proceeds to step S43.

[0091] In step S43, the control unit 31 determines whether an instruction to end the display of the analysis result has been given (step S43). For example, when the analysis result display button 331e is pressed again, the control unit 31 determines that an instruction to end the display of the analysis result has been given. If it is determined that an instruction to end the display of the analysis result has not been given (step S43; NO), the control unit 31 returns to step S33. If it is determined that an instruction to end the display of the analysis result has been given (step S43; YES), the control unit 31 ends the analysis result display process B.

[0092] FIG. 15 is a diagram showing an example of the screen transition of the reading screen 331 in the analysis result display process B. In FIG. 15, a case where there are three lesion candidate regions that are not displayed in the image display area 331b after magnification is shown as an example. First, the entire medical image to be read is displayed in the image display area 331b of the reading screen 331. When an enlargement is instructed, the medical image to be read is enlarged and displayed. Here, if there is a lesion candidate area or annotation that is not displayed within the image display area 331b, when a key (predetermined key) preset by the operation unit 32 is pressed, among the lesion candidate areas or annotations that are not displayed within the image display area 331b, the first lesion candidate area or the annotation A1 attached thereto is displayed. Since the annotation is displayed attached to the lesion candidate area, both the first lesion candidate area and the annotation A1 are displayed. Next, when a key (predetermined key) preset by the operation unit 32 is pressed, among the lesion candidate areas or annotations that are not displayed within the image display area 331b, the second lesion candidate area or the annotation A2 attached thereto is displayed. When a key (predetermined key) preset by the operation unit 32 is pressed, among the lesion candidate areas or annotations that are not displayed within the image display area 331b, the third lesion candidate area or the annotation A3 attached thereto is displayed.

[0093] Thus, according to the analysis result display process B, when a certain lesion candidate area (the first lesion candidate area) or its annotation (the first display information) is not displayed within the image display area 331b, for example, by performing a predetermined instruction input such as pressing a predetermined key, the lesion candidate area or the annotation can be displayed within the image display area 331b. Also, when there are a plurality of lesion candidate areas or their annotations that are not displayed within the image display area 331b, by repeating the predetermined instruction input, it is possible to switch from the display of a certain lesion candidate area (the first lesion candidate area) or its annotation (the first display information) that is not displayed to the display of another lesion candidate area (the second lesion candidate area) or its annotation (the second display information) that is not displayed. Therefore, it is possible to prevent the user from overlooking a lesion that should be viewed because the lesion candidate region in the medical image and the annotation, which is the display information thereof, move out of the image display region on the screen and are no longer displayed on the screen being viewed.

[0094] As described above, the first and second embodiments of the present invention have been explained. However, the description content in the above embodiments is a preferred example of the program, display device, display system, and display method according to the present invention, and is not limited thereto.

[0095] For example, in the flow of the above-described analysis result display process B, when all the lesion candidate regions or their annotations are displayed, the magnification of the medical image is automatically canceled. However, instead of canceling the magnification, a process of repeatedly switching and displaying the lesion candidate regions or their annotations in order in response to a predetermined instruction input may be performed, and when the cancellation of the magnification is instructed, the magnification of the medical image may be canceled to display the entire medical image.

[0096] Further, the control unit 31 functions as a first storage unit that stores the lesion candidate regions to be confirmed by the user, and as a second storage unit that stores confirmation information indicating that the first lesion candidate region has been confirmed when the user confirms the first lesion candidate region. When the confirmation information has been stored, the first lesion candidate region may be excluded from the lesion candidate regions to be confirmed by the user. That is, for the lesion candidate regions that the user has confirmed, they may be excluded from the display targets of the information indicating the existence of the lesion candidate regions or annotations that are not displayed in the first embodiment, or from the display targets of the lesion candidate regions or annotations by a predetermined instruction input in the second embodiment.

[0097] For example, when an annotation attached to a lesion candidate region displayed in the image display area 331b is specified by a right click or the like, the control unit 31 displays menu items including a "confirmed" item in the vicinity thereof. When the user clicks "confirmed" using the operation unit 32, the control unit 31 associates and stores confirmation information indicating that it has been confirmed with the information of the lesion candidate region corresponding to the specified annotation among the information of the lesion candidate regions to be confirmed by the user, which is stored in the storage unit 35 or the RAM. Alternatively, for the lesion candidate regions displayed in the image display area 331b after the medical image is enlarged, the control unit 31 may consider that the user has already confirmed them, and associate and store confirmation information with the information of the lesion candidate regions displayed in the image display area 331b after the medical image is enlarged among the information of the lesion candidate regions to be confirmed by the user, which is stored in the storage unit 35 or the RAM. Then, the control unit 31 excludes the lesion candidate regions with which the confirmation information is associated from the lesion candidate regions to be confirmed by the user. For example, for the lesion candidate regions with which the confirmation information is associated, the control unit 31 excludes them from the display targets of the information indicating the existence of the non-displayed lesion candidate regions or annotations in the first embodiment, or from the display targets of the lesion candidate regions or annotations by a predetermined instruction input in the second embodiment. Also, when the end button 331f is pressed, the control unit 31 transmits the information of the lesion candidate regions with which the confirmation information is associated to the medical image management server 10, and associates and stores the confirmation information with the information of the corresponding lesion candidate regions in the analysis results in the analysis result storage area 144. Then, in the analysis results transmitted from the medical image management server 10, for the lesion candidate regions with which the confirmation information is associated, the control unit 31 excludes them from the lesion candidate regions to be confirmed by the user. For example, for the lesion candidate regions with which the confirmation information is associated, the control unit 31 excludes them from the display targets of the information indicating the existence of the non-displayed lesion candidate regions or annotations in the first embodiment, or from the display targets of the lesion candidate regions or annotations by a predetermined instruction input in the second embodiment. In this way, among the lesion candidate regions to be confirmed by the user, it is possible to narrow down to the unconfirmed lesion candidate regions and indicate or display their existence, so that the work of the user to confirm the lesion candidate regions can be made more efficient.

[0098] In addition, for the lesion candidate regions associated with the confirmation information, the control unit 31 may display them together with information indicating that they have been confirmed. For example, as shown in FIG. 16, for the lesion candidate regions associated with the confirmation information, they may be displayed together with a mark CM such as "checked" or "confirmed". Alternatively, the annotation of the lesion candidate regions associated with the confirmation information may be displayed in a display mode (such as color or shape) different from that of the annotation of the unconfirmed lesion candidate regions. Thereby, the user can easily distinguish between the already confirmed lesion candidate regions and the unconfirmed lesion candidate regions, so that the work of the user to confirm the lesion candidate regions can be made more efficient. In addition, it is also possible to display on the display unit 33 the total number of lesion candidate regions obtained by computer processing of the medical image and information 331m indicating the number of the already confirmed lesion candidate regions among them. Thereby, it becomes possible for the user to easily grasp how many of the lesion candidate regions to be confirmed have been confirmed.

[0099] In addition, the display of information indicating the existence of the lesion candidate regions or annotations not displayed in the first embodiment and the display of the lesion candidate regions or annotations based on a predetermined instruction input in the second embodiment may be combined. For example, when there are lesion candidate regions or annotations not displayed in the image display area 331b, the control unit 31 may display on the display unit 33 information indicating the existence of the lesion candidate regions or annotations not displayed, and each time a predetermined instruction input is made, sequentially switch and display the lesion candidate regions or annotations not displayed.

[0100] Also, as information indicating the existence of a lesion candidate region or annotation that is not being displayed in the first embodiment, for example, a message such as "There is an AI detection result outside the image display area. Please be careful not to overlook it." may be displayed.

[0101] Also, in the above first embodiment, when an annotation, which is display information, is attached to a lesion candidate region obtained by computer processing of a medical image and displayed in the image display area 331b, when there is a lesion candidate region or its annotation that is not displayed within the image display area 331b, it has been described that information indicating the existence of the non-displayed lesion candidate region or annotation is displayed on the display unit 33. However, the target lesion candidate region is not limited to those obtained by computer processing. For example, when an annotation or other display information is attached to a lesion candidate region obtained by a radiologist's reading and displayed in the image display area 331b, when there is a lesion candidate region or its display information that is not displayed within the image display area 331b, information indicating the existence of the non-displayed lesion candidate region or display information may be displayed on the display unit 33. Or, based on an instruction input for processing, the non-displayed lesion candidate region or display information may be displayed on the display unit 33.

[0102] Also, in the above first embodiment, second embodiment, and their modified examples, the control unit 31 of the information processing apparatus 30 functions as the acquisition means, display control means, first storage means, second storage means, and exclusion means of the present application. However, a device other than the information processing apparatus 30 may be provided with the above respective means. Also, in the above embodiment, the medical image management server 10 is provided with a function of performing computer processing on a medical image to generate an analysis result. However, a device other than the medical image management server 10 may be provided with the analysis function.

[0103] In the above embodiment, an example in which a chest image is used as a medical image is illustrated. However, the imaging site is not limited to the chest. Further, the medical image to be processed may be a plurality of slice images obtained by CT or the like, a multi-frame image (video), or an image obtained by 3D conversion of an image obtained by CT, MRI, or the like.

[0104] Also, the program for executing each process in each device may be stored in a portable recording medium. Further, a carrier wave may be applied as a medium for providing program data via a communication line.

[0105] In addition, regarding the detailed configuration and detailed operations of each device described in the above embodiment, they can be appropriately changed without departing from the spirit of the present invention.

Explanation of Reference Numerals

[0106] 10 Medical image management server 11 Control unit 12 Communication unit 13 Image analysis unit 14 Storage unit 20 Modality 30 Information processing device 31 Control unit 32 Operation unit 33 Display unit 331 Interpretation screen 34 Communication unit 35 Storage unit 100 Medical image display system 141 User management table 142 Data management table 143 Medical image storage area 144 Analysis result storage area 145 Interpretation result storage area 351 Interpretation support processing program N Communication network

Claims

1. On the computer, an acquisition function for acquiring first information indicating a first lesion candidate region in a medical image; a display function of displaying the medical image accompanied by first display information based on the first information on a display unit; A program for executing The display function, in a case where an enlarged image obtained by enlarging a predetermined range of the medical image to which the first display information is added is displayed on the display unit, When the first lesion candidate region or the first display information present in the medical image is not entirely displayed in the enlarged image, displaying on the display unit any one of the number of the first lesion candidate regions or the first display information that are present outside a predetermined range of the medical image and within the medical image, a direction with respect to the enlarged image, and a position with respect to the enlarged image; program.

2. the display function displays, on the display unit, a reduced image of the medical image and an enlarged range of the enlarged image superimposed on the reduced image, thereby displaying, on the display unit, a relative position based on the enlarged image. The program according to claim 1.

3. The display function displays a mark indicating a direction based on the enlarged image on the display unit. The program according to claim 1.

4. The display function displays, on the display unit, display information in which an active frame indicating that the medical image is being operated is changed. The program according to claim 1.

5. The display function displays, on the display unit, the number of all lesion candidate regions included in the medical image and the number of lesion candidate regions included in the enlarged image. The program according to claim 1.

6. an acquisition means for acquiring first information indicating a first lesion candidate region in a medical image; a display control means for displaying the medical image accompanied by first display information based on the first information on a display unit; A display device comprising: When the display control means causes the display unit to display an enlarged image obtained by enlarging a predetermined area of ​​the medical image to which the first display information is added, When the first lesion candidate region or the first display information present in the medical image is not entirely displayed in the enlarged image, displaying on the display unit any one of the number of the first lesion candidate regions or the first display information that are present outside a predetermined range of the medical image and within the medical image, a direction with respect to the enlarged image, and a position with respect to the enlarged image; Display device.

7. an acquisition means for acquiring first information indicating a first lesion candidate region in a medical image; a display control means for displaying the medical image accompanied by first display information based on the first information on a display unit; A display system comprising: When the display control means causes the display unit to display an enlarged image obtained by enlarging a predetermined area of ​​the medical image to which the first display information is added, When the first lesion candidate region or the first display information present in the medical image is not entirely displayed in the enlarged image, displaying on the display unit any one of the number of the first lesion candidate regions or the first display information that are present outside a predetermined range of the medical image and within the medical image, a direction with respect to the enlarged image, and a position with respect to the enlarged image; Display system.

8. an acquiring step of acquiring first information indicating a first lesion candidate region in a medical image; a display step of displaying the medical image accompanied by first display information based on the first information on a display unit; A display method comprising: In the display step, when an enlarged image obtained by enlarging a predetermined area of ​​the medical image to which the first display information is added is displayed on the display unit, When the first lesion candidate region or the first display information present in the medical image is not entirely displayed in the enlarged image, displaying on the display unit any one of the number of the first lesion candidate regions or the first display information that are present outside a predetermined range of the medical image and within the medical image, a direction with respect to the enlarged image, and a position with respect to the enlarged image; Display method.

Images