Information processing device, information processing method, and program

Abstract

To provide an information processor capable of selecting a medical image to be compared from a plurality of medical images according to a condition related to an imaging date and time.SOLUTION: An information processor 10 which has a selection part 55 selecting a second image to be compared with a first image from a plurality of candidate images includes: an imaging date and time acquisition part 53 acquiring imaging dates and times when the plurality of candidate images were captured; and a condition setting part 54 setting a condition related to the imaging dates and times. The selection part 55 selects at least one candidate image as a second image from the plurality of candidate images on the basis of the condition related to the imaging dates and times set by the condition setting part 54 and the imaging dates and times of the plurality of candidate images.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and a program for processing medical images captured by various modalities. [Background technology]

[0002] In the medical field, doctors make diagnoses using medical images captured by various modalities. In particular, for the purpose of monitoring the progress of a subject's condition, doctors compare multiple medical images captured by the same modality at different times to observe changes in the subject over time. As a method for supporting the observation of changes in the subject over time, Patent Document 1 discloses a technology for generating a medical image (difference image) depicting the difference between a medical image of a diagnostic target (diagnostic target image) and a medical image of a comparison target (comparison image), and displaying changes in the subject over time. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-126575 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when observing changes in a subject over time using a plurality of medical images, it is necessary to select an appropriate comparison image from a plurality of medical images taken at different times.

[0005] SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide an information processing device that can select a medical image to be compared from a plurality of medical images based on conditions related to the imaging date and time. [Means for solving the problem]

[0006] In order to achieve the object of the present invention, an information processing device is provided which has a selection means for selecting a second image to be compared with a first image from a plurality of candidate images, and which has an evaluation means for setting conditions based on the image capture date and time and the image capture site of the first image, acquiring the image capture date and time and the image capture site of each of the plurality of candidate images, and evaluating the plurality of candidate images based on the image capture date and time and the image capture site of the plurality of candidate images against the conditions, and the selection means selects at least one candidate image from the plurality of candidate images based on the evaluation result of the evaluation means. As the second image choice The evaluation means selects one of the following conditions: the image capture date and time is a certain period or more after the image capture date and time of the first image; the image capture date and time is within a predetermined period after the image capture date and time of the first image; or the image capture date and time is within a predetermined period that is a certain period or more after the image capture date and time of the first image and has an upper limit and a lower limit. . [Effects of the Invention]

[0007] According to the present invention, a medical image to be compared can be selected from a plurality of medical images based on conditions related to the imaging date and time. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing the configuration of an information processing apparatus according to a first embodiment of the present invention. [Figure 2] FIG. 4 is a diagram showing conditions related to image capture date and time set by a condition setting unit of the present invention. [Figure 3] 3 is a flowchart showing the operation of the first embodiment of the present invention. [Figure 4] FIG. 10 is a diagram showing the configuration of an information processing apparatus according to a second embodiment of the present invention. [Figure 5] 10 is a flowchart showing the operation of the second embodiment of the present invention. [Figure 6] 10A and 10B are diagrams showing an example of the relationship between the imaging range of a diagnostic object image and the imaging range of a candidate image according to the present invention; [Figure 7] 10A and 10B are diagrams showing an example of the relationship between the imaging range of a diagnostic object image and the imaging range of a candidate image according to the present invention; [Figure 8] 10A and 10B are diagrams showing an example of the relationship between the imaging range of a diagnostic object image and the imaging range of a candidate image according to the present invention; [Figure 9] 10A and 10B are diagrams showing an example of the relationship between the imaging range of a diagnostic object image and the imaging range of a candidate image according to the present invention; DETAILED DESCRIPTION OF THE INVENTION

[0009] Preferred embodiments of the present invention will now be described with reference to the accompanying drawings. [Example]

[0010] An information processing device 10 according to a first embodiment will be described with reference to Fig. 1 to Fig. 3. The information processing device 10 according to the embodiment of the present invention provides the following functions to users such as doctors and radiologists at medical institutions. That is, the information processing device 10 performs a comparison process between a diagnostic target image and a comparison image relating to a patient (subject) on whom the user is going to perform a medical procedure, and provides the result of the comparison process to the user.

[0011] In this embodiment, a case will be described in which there are multiple medical images (candidate images) of the same subject captured at different times from the time of capturing the diagnostic target image. The information processing device 10 selects a medical image suitable for comparison with the diagnostic target image from the multiple candidate images as a comparison image, and performs a comparison process between the diagnostic target image and the comparison image. Here, the comparison process may, for example, display each medical image so that the user can compare them, or perform a difference process between the diagnostic target image and the candidate image and display the difference image.

[0012] The information processing device 10 depicts the occurrence and progression of a lesion in a subject by comparing a medical image captured at the current time or the latest medical image (diagnostic target image) with a medical image captured earlier than the diagnostic target image (comparison image).

[0013] The information processing device 10 acquires the imaging dates and times when multiple candidate images were captured and sets conditions related to the imaging dates and times. Then, based on the set conditions and the imaging dates and times of the multiple candidate images, a comparison image is selected from the multiple candidate images. The information processing device 10 then generates a difference image depicting the difference between the diagnostic target image and the comparison image, and displays the changes in the subject over time on the display unit 36. In the following description, the imaging date and time includes not only information indicating both the imaging date and imaging time, but also information indicating only the imaging date. It also includes information indicating only the imaging time. For example, it also includes information recording only the elapsed time from a predetermined starting time (e.g., January 1, 1970, 0:00:00). The imaging date generally refers to the imaging date, but may also be information indicating only the imaging date and month.

[0014] 1 is a diagram showing the overall configuration of a medical information processing system of the present invention and the configuration of an information processing device 10. The medical information processing system includes the information processing device 10 and a medical image database 23. The information processing device 10 and the medical image database 23 are communicably connected to each other via communication means. In this embodiment, the communication means is configured as a LAN (Local Area Network) 21, but may also be a WAN (Wide Area Network). Furthermore, the connection method of the communication means may be a wired connection or a wireless connection.

[0015] The medical image database 23 stores multiple medical images related to multiple subjects and their associated information. Medical images are images captured using modalities such as CT devices and MRI devices, and can be various images such as two-dimensional, three-dimensional, monochrome, and color. The associated information of medical images includes information such as subject ID (patient ID), imaging date and time, imaging region, reconstruction conditions, and imaging conditions such as tube voltage and tube current values. Other additional information may include the purpose of the examination, the name of the organ being examined, and the name of the disease being examined.

[0016] Each medical image and its associated information is assigned a unique identifier (examination ID) to enable identification from other information, and information is read by the information processing device 10 based on the examination ID. In the case where the medical image is a three-dimensional volume image composed of multiple two-dimensional cross-sectional images (tomographic images), an examination ID is assigned to each two-dimensional cross-sectional image (tomographic image) and each three-dimensional volume image, which is a collection of tomographic images. In addition to information reading, the medical image database 23 works in conjunction with the information processing device 10 to provide functions such as displaying a list of medical images, displaying thumbnails, searching, and writing information. In this embodiment, medical images refer to medical image data.

[0017] The information processing device 10 acquires information held in the medical image database 23 via the LAN 21. The information processing device 10 includes a communication IF 31, a ROM 32, a RAM 33, a storage unit , an operation unit , a display unit , and a control unit .

[0018] The communication IF (Interface) 31 is realized by, for example, a LAN card or the like, and communicates between an external device (medical image database 23) and the information processing device 10 via the LAN 21. The ROM (Read Only Memory) 32 is realized by, for example, a non-volatile memory or the like, and stores various programs, etc. The RAM (Random Access Memory) 33 is realized by, for example, a volatile memory or the like, and temporarily stores various information. The storage unit 34 is realized by, for example, an HDD (Hard Disk Drive) or the like, and stores various information. The operation unit 35 is realized by, for example, a keyboard, a mouse, etc., and a user can input various information via the operation unit 35. The display unit 36 ​​is, for example, a display. The operation unit 35 and the display unit 36 ​​function as a graphical user interface (GUI) under the control of the control unit 50.

[0019] The control unit 50 is realized by, for example, a CPU (Central Processing Unit), and controls the overall processing in the information processing device 10. The control unit 50 includes a diagnostic target image acquisition unit 51, a candidate image acquisition unit 52, an imaging date and time acquisition unit 53, a condition setting unit 54, a selection unit 55, an image processing unit 56, and a display control unit 57.

[0020] The diagnostic target image acquisition unit 51 acquires a medical image of the subject as a diagnostic target image from the medical image database 23 via the communication IF 31 and the LAN 21 in accordance with a user operation input through the operation unit 35. Then, the diagnostic target image acquisition unit 51 outputs the acquired diagnostic target image together with accompanying information to the image processing unit 56.

[0021] The candidate image acquisition unit 52 acquires multiple medical images of the same subject captured in the past from the medical image database 23 via the communication IF 31 and the LAN 21 as medical images (candidate images) that are candidates for comparison images for the diagnostic target image acquired by the diagnostic target image acquisition unit 51. Then, the candidate image acquisition unit 52 outputs supplementary information of the multiple acquired candidate images to the imaging date and time acquisition unit 53, and outputs the multiple candidate images to the selection unit 55.

[0022] The image capture date and time acquisition unit 53 acquires the image capture dates and times of the multiple candidate images. Since the image capture dates and times are included in the incidental information attached to the multiple candidate images, the image capture date and time acquisition unit 53 can acquire the image capture dates and times of the multiple candidate images by reading the incidental information attached to the multiple candidate images.

[0023] The condition setting unit 54 sets conditions related to the imaging date and time in order to select a medical image (comparison image) to be compared from a plurality of candidate images. Specifically, the condition setting unit 54 sets the imaging date and time based on the imaging date and time of the diagnostic target image.

[0024] FIG. 2 illustrates an example of a condition related to imaging date and time set by the condition setting unit 54. The imaging date and time includes the date and time when the subject is imaged. However, for simplicity, the following description will use the date. The condition setting unit 54 can set, for example, the most recent imaging date and time (the imaging date and time closest to the imaging date and time of the diagnostic target image) as the imaging date and time condition. This allows comparison with the most recent examination, which is the basis of comparative image interpretation. In this condition, the selection unit 55 selects the candidate image corresponding to the most recent imaging date and time as the comparison image. In the example of FIG. 2, the imaging date and time of the diagnostic target image is April 15, 2019. Among multiple candidate images 1 to 5, candidate image 5 is selected by the selection unit 55 because its imaging date and time is October 20, 2018, making it the candidate image with the most recent imaging date and time. The selection unit 55 outputs the selected candidate image 5 to the image processing unit 56 as the comparison image. The oldest imaging date and time (the imaging date and time furthest from the imaging date and time of the diagnostic target image) can also be set as the imaging date and time condition. According to this, the image that has changed the most from the image to be diagnosed can be selected as the comparison image. Under this condition, the selection unit 55 selects the candidate image that has the oldest imaging date and time as the comparison image.

[0025] Furthermore, the condition setting unit 54 can set an imaging date and time within a predetermined period based on the imaging date and time of the diagnostic target image as a condition related to the imaging date and time. For example, a lower limit of the predetermined period can be set. For example, a condition can be set that the examination was performed at an interval of a predetermined period (e.g., one year) or more from the imaging date and time of the diagnostic target image. This makes it possible to select candidate images from examinations performed within an appropriate period as comparison images when it is known that a certain amount of time is required for the development of a lesion of interest. Furthermore, an additional condition related to the imaging date and time can be set that the imaging date and time is the most recent within the predetermined period. This makes it possible to select candidate images from examinations that satisfy the period condition and that are closest to the diagnostic target image and have no additional changes as comparison images.

[0026] Conversely, an upper limit can be set as the predetermined period. For example, as shown in FIG. 2(a), the condition setting unit 54 can set the period to, for example, within two years based on the imaging date and time of the diagnostic target image (April 15, 2019). This can reduce the increase in noise caused by past changes appearing in the subtraction image due to a long time gap between the diagnostic target image and the comparison image. Alternatively, the predetermined period can be set with an upper and lower limit, such as one year or more but less than two years. When a predetermined period is set as a condition, the selection unit 55 selects candidate images whose imaging dates fall within the predetermined period as comparison images. In the example of FIG. 2(a), among multiple candidate images, candidate image 4 was imaged on September 5, 2018, and candidate image 5 was imaged on October 20, 2018. Therefore, candidate image 4 and candidate image 5 are selected by the selection unit 55. The selection unit 55 outputs the selected candidate images 4 and 5 to the image processing unit 56 as comparison images. Furthermore, an additional condition regarding the imaging date and time can be set that the imaging date and time must be the earliest within a specified period. This allows the examination that will produce the greatest change within the period condition to be selected. In this case, in the example of Figure 2(a), candidate image 4 is selected as the comparison image.

[0027] The condition setting unit 54 may be configured to set multiple conditions with different priorities as conditions related to the image capture date and time. For example, multiple levels of conditions may be set, such that if there is no candidate image that satisfies the first-priority condition, a candidate image that satisfies the second-priority condition is selected. For example, the first-priority condition may be that the image capture date and time is between one year and two years old, and the second-priority condition may be between two years and three years old. Furthermore, any number of conditions, three or more, may be set with priorities, such as between three years and four years old, as the third-priority condition. This has the effect of reducing cases where images cannot be compared, because even if there is no comparison image with ideal conditions, a comparison image that satisfies the next-best condition can be selected.

[0028] The condition setting unit 54 can also set, as a condition related to the imaging date and time, an imaging date and time that does not include a predetermined treatment such as surgery between the imaging date and time of the diagnostic target image. In this case, the selection unit 55 selects, as the comparison image, a candidate image corresponding to an imaging date and time that does not include a predetermined treatment such as surgery between the imaging date and time of the diagnostic target image.

[0029] If a treatment, such as surgery, is performed between the imaging date and time of the candidate image and the imaging date and time of the diagnostic target image, the pixel values ​​around the treatment site in the candidate image and the diagnostic target image will differ significantly, making the candidate image unsuitable for comparison. Figure 2(b) shows that surgery was performed at the imaging date and time of candidate image 4 and candidate image 5. Among multiple candidate images, candidate image 5 is selected by the selection unit 55 because its imaging date and time does not include a treatment, such as surgery, between the imaging date and time of the diagnostic target image and the imaging date and time of the diagnostic target image. The selection unit 55 outputs the selected candidate image 5 to the image processing unit 56 as a comparison image. Note that the imaging date and time may also be set as a condition that the imaging date and time does not include a specific treatment, such as surgery, and is as old as possible. This allows the image with the greatest change from the diagnostic target image to be selected as the comparison image, within the range of no significant changes, such as surgery.

[0030] The condition setting unit 54 can also set the imaging date and time as a condition related to the imaging date and time as recent as possible before the start of a predetermined treatment. In this case, the selection unit 55 selects, as a comparison image, a candidate image captured at the most recent date and time before the specified date and time of the predetermined treatment, based on the specified date and time of the predetermined treatment. This makes it possible to select an appropriate comparison image when observing changes due to the effects of the treatment.

[0031] The condition setting unit 54 can also set, as a condition related to the imaging date and time, an imaging date and time when the model of the modality has not been changed between the imaging date and time of the diagnostic object image.

[0032] In the case of this condition, the selection unit 55 selects, as a comparison image, a candidate image corresponding to an imaging date and time when the model of the modality has not been changed between the imaging date and time of the diagnostic target image.

[0033] This is because if the modality is changed between the imaging date and time of the candidate image and the imaging date and time of the diagnostic target image, the image quality of the candidate image and the diagnostic target image will differ significantly, making the candidate image unsuitable for comparison. Figure 2(c) shows that a modality change occurred between the imaging date and time of candidate image 3 and the imaging date and time of candidate image 4. Among multiple candidate images, candidate image 4 and candidate image 5 are imaged at dates and times that do not involve a modality change between the imaging date and time of the diagnostic target image, so candidate image 4 or candidate image 5 is selected by the selection unit 55. The selection unit 55 outputs the selected candidate image 4 or candidate image 5 to the image processing unit 56 as a comparison image. Note that the imaging date and time may also be conditioned on the fact that the modality has not been changed and that the imaging date and time is as old as possible. This allows the image that has undergone the greatest change from the diagnostic target image to be selected as the comparison image, provided that no significant changes occur due to the modality change. Although a change in modality model has been described as an example here, the date and time of any other event that affects image quality, such as a change in imaging protocol or an upgrade of the reconstruction algorithm, may also be used as a condition.

[0034] The condition regarding the image capture date and time may be a combination of the above conditions.

[0035] Generally, multiple images are captured during an examination at the same imaging date and time. Therefore, it may be difficult to identify a single comparison image from the candidate images solely based on the imaging date and time. Even when multiple examinations satisfy the imaging date and time condition, it may be difficult to identify a single comparison image from the candidate images solely based on the imaging date and time. In such cases, the selection unit 55 may be configured to further narrow down the comparison images by setting conditions other than the imaging date and time. In this case, the condition setting unit 54 may select a comparison image from the candidate images that satisfy the imaging date and time condition based on conditions other than the imaging date and time (such as imaging range, imaging site, and imaging conditions). The imaging site may be set to include the lung field, abdomen, or head. For example, the condition setting unit 54 may set a condition for selecting a candidate image of the same imaging site as the diagnostic target image. For example, if the diagnostic target image is an abdominal image, the condition setting unit 54 may set the imaging site to be the abdomen as a condition, and the selection unit 55 may select a candidate image of the abdomen as the comparison image. Similarly, if the diagnostic target image is an image of the head, the condition setting unit 54 sets the condition that the imaging region is the head, and the selection unit 55 selects a candidate image of the head as the comparison image. Similarly, the selection condition may be that the purpose of the examination, the name of the disease of the examination target, etc., match with the diagnostic target image.

[0036] Furthermore, in the case of imaging conditions, reconstruction conditions, slice thickness, contrast conditions (presence or absence of contrast agent), etc. can be set as selection conditions for comparison images. For example, the condition setting unit 54 can set, as a condition for selecting a comparison image, that the image is an image under imaging conditions suitable for subtraction processing. For example, the conditions can be set as follows: a slice thickness of 5 mm or less, a reconstruction function that satisfies a mediastinal condition, no contrast, a range of tube voltage or tube current, etc. The condition setting unit 54 can also set a condition for selecting a comparison image that the image is captured under the same imaging conditions as the diagnostic target image. For example, if the slice thickness of the diagnostic target image is 2.5 mm, the condition setting unit 54 sets a slice thickness of 2.5 mm as a condition for selecting a comparison image from among the candidate images. In this case, the selection unit 55 selects, from among the multiple candidate images, a candidate image with a slice thickness of 2.5 mm as the comparison image. Similarly, a condition for selecting a comparison image can also be set that the reconstruction function, tube voltage, and tube current of the diagnostic target image match, or that the difference is within a predetermined range. A condition combining multiple items can also be set. In this case, for example, a comprehensive evaluation value can be calculated based on the degree of match of each item, using the product or sum of these values, and the candidate image with the best evaluation value can be selected as the comparison image. Alternatively, all candidate images with evaluation values ​​exceeding a predetermined threshold can be selected as the comparison image. Note that in the above example, a comparison image is selected from candidate images that satisfy the imaging date and time condition based on conditions other than the imaging date and time. However, the order in which the conditions are applied is not limited to this. For example, candidate images may be narrowed down based on conditions other than the imaging date and time, and then comparison images may be selected based on the imaging date and time. In particular, when the imaging date and time condition is "oldest" or "newest," it is desirable to narrow down based on conditions other than the imaging date and time first. For example, a condition can be set such that, from among candidate images that satisfy conditions other than the imaging date and time, the candidate image with the oldest imaging date and time or the candidate image with the most recent imaging date and time is selected. This allows comparison according to a purpose (for example, to see changes that have occurred in a patient over the past year, or to see changes since the previous examination for the same purpose) to be performed from among candidate images that satisfy conditions other than the imaging date and time.

[0037] Then, the image processing unit 56 performs a comparison process (difference process) between the diagnostic target image and the comparison image (selected candidate image), and outputs the comparison result of the comparison process to the display control unit 57. Specifically, the image processing unit 56 generates a difference image that depicts the difference between the diagnostic target image and the comparison image. The display processing unit 57 displays the comparison result (difference image) on the display unit .

[0038] At least some of the components of the control unit 50 may be implemented as independent devices. Alternatively, each component may be implemented as software that implements its function. In this case, the software that implements the function may run on a server via a network such as the cloud. In this embodiment, each component is implemented by software in a local environment.

[0039] 1 is merely an example. For example, the storage unit 34 of the information processing device 10 may have the functions of the medical image database 23, and the storage unit 34 may store multiple medical images related to multiple subjects and their associated information.

[0040] Next, the operation of the information processing device 10 in this embodiment will be described in detail with reference to FIG. 3. Note that, although the following description will be given using an example in which a CT image is used as a medical image, the present invention is not limited to this. Also, the diagnostic target image and the candidate image do not necessarily have to be images of the same subject and the same modality.

[0041] (Step S1010) <Acquisition of diagnostic target image> In this step, the diagnostic target image acquisition unit 51 executes a process of acquiring a diagnostic target image (first image) to be processed from the medical image database 23. This process is executed by accepting a user's operation via a GUI provided by the operation unit 35 or the display unit 36. Through this process, the diagnostic target image acquisition unit 51 reads the diagnostic target image from the medical image database 23, and the information processing device 10 stores the diagnostic target image using the ROM 32, RAM 33, storage unit 34, etc. In this embodiment, an example will be described in which a three-dimensional CT image composed of multiple tomographic images is acquired as the diagnostic target image. However, the implementation of the present invention is not limited to this, and two-dimensional CT images, plain X-ray images, MRI images, camera images of a lesion in a subject, etc. may also be used. Note that the diagnostic target image is accompanied by additional information such as a subject ID (patient ID), imaging date and time, imaging site, and imaging parameters.

[0042] (Step S1020) <Obtaining multiple candidate images> In this step, the candidate image acquiring unit 52 executes a process of acquiring a plurality of medical images (candidate images) to be compared with the diagnostic target image acquired in step S1010 from the medical image database 23. As an example of this process, the candidate image acquiring unit 52 acquires, as candidate images, medical images of the same subject as the diagnostic target image from among a plurality of medical images recorded in the medical image database 23. Specifically, the candidate image acquiring unit 52 acquires, using a search function provided in the medical image database 23, medical images having, as incidental information, the same subject ID as the subject ID that is incidental information of the diagnostic target image.

[0043] The method of acquiring candidate images is not limited to the above method. For example, the candidate image acquisition unit 52 may refer to the imaging date and time of the diagnostic target image and acquire only medical images older (past) than that. In this embodiment, the above method is used to acquire candidate images limited to medical images of the same subject that were captured at a time earlier than the imaging date and time of the diagnostic target image and that were captured using the same modality (a CT device in this specific example) as the diagnostic target image.

[0044] (Step S1030) <Obtaining the image capture dates and times of multiple candidate images> In this step, the image capture date and time acquisition unit 53 acquires the image capture dates and times of the multiple candidate images acquired by the candidate image acquisition unit 52. The image capture dates and times recorded together with the candidate images are recorded as additional information in the header area of ​​each candidate image. The image capture date and time acquisition unit 53 acquires the image capture dates and times of the multiple candidate images by reading the additional information of the multiple candidate images. Here, the imaging date and time acquisition unit 53 may acquire the implementation date (examination date) of the examination in which the candidate images were acquired, and use that as the imaging date and time of each candidate image acquired in the examination. Alternatively, information correlated with the imaging date and time, such as the date of image reconstruction of the candidate image or the date of initial interpretation, may be used as the imaging date and time.

[0045] (Step S1035) <Setting conditions related to imaging date and time> In this step, the condition setting unit 54 sets conditions related to the image capture date and time for selecting a comparison image from a plurality of candidate images. For example, the conditions are set by having the user select a condition from the variations of the image capture date and time conditions listed above via a GUI (not shown). Alternatively, the condition setting unit 54 may be configured to read conditions previously written in a setting file. Note that it is desirable for the condition setting unit 54 to also set conditions other than the image capture date and time in this step.

[0046] (Step S1040) <Select a comparison image> In this step, the selection unit 55 selects a comparison image from among the plurality of candidate images based on the conditions relating to the image capture date and time set by the condition setting unit 54 and the image capture dates and times of the plurality of candidate images.

[0047] In the process by the selection unit 55, the comparison image does not necessarily have to be narrowed down to one, and multiple comparison images may be selected. In this case, the configuration may be such that the user can select, via a GUI (not shown), a comparison image to be output to the image processing unit 56 from the multiple comparison images selected by the selection unit 55. Alternatively, the configuration may be such that all of the selected multiple comparison images are output to the image processing unit 56.

[0048] (Step S1050) <Comparison process> In this step, the image processing unit 56 performs a comparison process between the diagnostic target image and the comparison image. Specifically, the image processing unit 56 performs a difference process between the diagnostic target image and the comparison image and calculates a difference image as the comparison result. Here, if the selection unit 55 selects multiple comparison images, the image processing unit 56 generates a difference image between the diagnostic target image and the comparison image for each comparison image. That is, the image processing unit 56 compares a first image, which is the diagnostic target image, with a second image, which is the comparison image, to generate a difference image between the first image and the second image. The difference process between the diagnostic target image and the comparison image is preferably performed after correcting image differences that are unnecessary for image diagnosis, such as differences in the position and shape of the subject depicted in the diagnostic target image and the comparison image, and differences in image quality between the images. Correction of differences between images may be performed using any known method, and detailed description thereof will be omitted here.

[0049] The process for calculating the comparison result is not limited to the above-described subtraction process. For example, the image processing unit 56 may generate a superimposed image of the diagnostic target image and the comparison image. In this case, different color channels may be assigned to the diagnostic target image and the comparison image, and the superimposed image may be generated as a color image by mixing them. Alternatively, a deformed image may be generated by deforming the comparison image so that the shapes of the diagnostic target image and the subject match.

[0050] (Step S1060) <Display of comparison results> In this step, the display control unit 57 executes a process of displaying the comparison result obtained by the process of step S1050 on the display unit 36. As a specific example, the display control unit 57 performs volume rendering on each of the diagnostic target image, comparison image, and difference image, and displays each of the images created by volume rendering (hereinafter, volume rendering images) side by side on the display unit 36.

[0051] The method of displaying the comparison results is not limited to the above method, and the display control unit 57 may display a tomographic image of an arbitrary position in each image on the display unit 36, and the tomographic image to be displayed may be changed by a user operation. The display control unit 57 can perform processing such as identifying corresponding positions in the diagnostic target image and the comparison image, and displaying the tomographic image of that position (displaying the corresponding cross section). That is, when the user changes the tomographic image of the diagnostic object image to be displayed, the display control unit 57 displays the tomographic image at the position of the comparison image corresponding to the position of the changed tomographic image on the display unit 36. Furthermore, when the diagnostic object image and the comparison image are aligned in step S1050, it is desirable that the display control unit 57 perform processing such as switching the tomographic images to be displayed in the diagnostic object image and the difference image in conjunction with each other based on the alignment result.

[0052] As described above, according to the present invention, the information processing device 10 has a selection unit 55 that selects a comparison image (second image) to be compared with a diagnostic target image (first image) from a plurality of candidate images, and includes an imaging date and time acquisition unit 53 that acquires the imaging dates and times at which the plurality of candidate images are captured, and a condition setting unit 54 that sets conditions related to the imaging dates and times, and the selection unit 55 selects at least one candidate image from the plurality of candidate images as a comparison image (second image) based on the conditions related to the imaging dates and times set by the condition setting unit 54. Thus, the selection unit 55 can select a candidate image (comparison image) to be compared from the plurality of candidate images based on the conditions related to the imaging dates and times, and the display unit 36 ​​can quickly display the comparison results using the comparison images.

[0053] As described above, according to this embodiment, it is possible to select comparison images that can be suitably compared with the diagnostic target image without requiring the user to perform troublesome operations, and to provide the user with the results of the comparison process of those images.

[0054] In the above embodiment, the results of the comparison process between the selected comparison image and the diagnostic target image are displayed, but displaying the results is not necessarily required. For example, a configuration may be adopted in which only the process of storing the comparison process results and information identifying the comparison image in association with the diagnostic target image in the medical image database 23 is performed. In this case, when observing the diagnostic target image using another image viewer, the associated comparison process results and the comparison image can be read and displayed. Furthermore, performing the comparison process is not necessarily required. For example, a configuration may be adopted in which only the process of storing information identifying the selected comparison image in association with the diagnostic target image in the medical image database 23 is performed. In this case, when observing the diagnostic target image using another image viewer, the associated comparison image can be read and displayed in a form that allows comparison, or a superimposed image or a difference image can be generated between the diagnostic target image and the comparison image. [Example]

[0055] Next, an information processing device 10 of a second embodiment will be described with reference to Figs. 4 to 9. The difference from the first embodiment is that a combination of a plurality of candidate images is evaluated and the combination is selected. Fig. 4 is a diagram showing the overall configuration of the medical information processing system of the present invention and the configuration of the information processing device 10. Here, the configuration different from Fig. 1 will be mainly described.

[0056] The candidate image acquisition unit 52 acquires a plurality of medical images (candidate images) that are candidates for comparison images for the diagnostic target image acquired by the diagnostic target image acquisition unit 51 from the medical image database 23 via the communication IF 31 and the LAN 21. Then, the candidate image acquisition unit 52 outputs the acquired plurality of candidate images to the combination generation unit 60 and the selection unit 55.

[0057] The combination generation unit 60 generates at least one combination of the candidate images acquired by the candidate image acquisition unit 52. Here, a combination of candidate images is a combination of one or more candidate images. Furthermore, the combinations of candidate images generated by the combination generation unit 60 include at least one combination of multiple (i.e., two or more) candidate images. Then, the combination generation unit 60 outputs the generated combination of candidate images to the evaluation unit 61.

[0058] The evaluation unit 61 calculates an evaluation value relating to the appropriateness of comparison with the diagnostic target image for each combination of candidate images generated by the combination generation unit 60. Then, the evaluation unit 61 outputs each calculated evaluation value to the selection unit 55.

[0059] The selection unit 55 selects a combination of candidate images to be compared with the diagnostic target image from among the combinations of candidate images based on each evaluation value. The selected combination of candidate images is composed of one or more candidate images. Hereinafter, the selected combination of candidate images will be referred to as a set of comparison images, and the candidate images that make up the set of comparison images will be referred to as comparison images. Then, the selection unit 55 outputs the set of comparison images to the image processing unit 56.

[0060] The image processing unit 56 performs a comparison process between the diagnostic target image and the set of comparison images, and outputs the comparison result of the comparison process to the display control unit 57. The display control unit 57 causes the display unit 36 ​​to display the comparison result of the image processing unit 56.

[0061] Next, the overall processing procedure by the information processing device 10 in this embodiment will be described in detail with reference to Fig. 5. Steps S1010, S1020, S1050, and S1060 are generally the same as those in Fig. 3.

[0062] Here, the candidate images are represented as I_r,i (1≦i≦N), where N represents the number of candidate images acquired in step S1020. In this embodiment, the following description will be given taking the case where N=3 as a specific example.

[0063] Note that if the number N of candidate images acquired in this step is 1, the processing of steps S2000 to S2020 described below may be omitted, and the acquired candidate images may be regarded as a set of comparison images described in detail later, and the processing from step S1050 onwards may be executed.

[0064] (Step S2000) <Generate combinations of candidate images> In this step, the combination generation unit 60 generates a plurality of combinations of one or more candidate images from the N candidate images acquired in step S1020, including at least one combination of two or more candidate images. In other words, the combination generation unit 60 corresponds to a setting means for setting a plurality of combinations including two or more candidate images from among the plurality of candidate images. In this embodiment, an example is shown in which the combinations of candidate images are generated by combining two different candidate images. In a specific example where N=3, the following three combinations are generated:<I_r,1,I_r,2> ,<I_r,1,I_r,3> ,<I_r,2,I_r,3> In this embodiment, a combination of candidate images is expressed as P_j (1≦j≦M), where M is the total number of combinations. In this embodiment, the following explanation will be given taking the case where M=3 as an example.

[0065] (Step S2010) <Calculation of evaluation value> In this step, the evaluation unit 61 executes a process of calculating an evaluation value for each of the combinations of candidate images generated in step S2000 in relation to a comparison with the diagnostic target image. In this embodiment, a specific example will be described in which an evaluation value is calculated based on the overlapping range (common imaging range) between the imaging range of the combination of candidate images to be evaluated and the imaging range of the image to be diagnosed.

[0066] Here, the processing of this step will be described in detail with reference to FIGS. 6 to 9. FIGS. 6 to 9 are diagrams showing the relationship between the imaging range of the diagnostic target image and the imaging range of the candidate image. In FIG. 6, 400 is the subject in this embodiment. 410 indicates the range in the body axis direction of the subject 400 in the imaging range of the diagnostic target image acquired in step S1010. Here, the imaging range of the diagnostic target image shows a case in which the range from the chest to the abdomen of the subject 400 is included. Also, in FIG. 6, 420, 430, and 440 indicate the imaging range (in the body axis direction) of each of the candidate images I_r,1, I_r,2, and I_r,3 acquired in step S1020, respectively. Here, I_r,1 shows a case in which the candidate image shows the head of the subject, I_r,2 shows the abdomen, and I_r,3 shows the chest.

[0067] In FIG. 7, 450 indicates the overlapping range between the imaging range (the sum of 420 and 430) of the candidate image combination P_1 (the combination of candidate images I_r,1 and I_r,2) and the imaging range 410 of the diagnostic target image. In other words, 450 represents the range in which image comparison processing with the diagnostic target image can be performed using the candidate image combination P_1. FIG. 7 shows that the imaging ranges of the diagnostic target image and candidate image I_r,1 do not overlap, while the imaging ranges of the diagnostic target image and candidate image I_r,2 partially overlap. Therefore, the overlapping range of the imaging ranges of the diagnostic target image and candidate image I_r,2 is the overlapping range with the diagnostic target image and candidate image combination P_1.

[0068] In Fig. 8, 460 indicates the overlapping range (the sum of 420 and 440) of the imaging range of the candidate image combination P_2 (the combination of candidate images I_r,1 and I_r,3) with the imaging range 410 of the diagnostic target image, expressed in the same manner as in Fig. 7. Fig. 8 shows that the imaging ranges of the diagnostic target image and candidate image I_r,1 do not overlap, while the imaging ranges of the diagnostic target image and candidate image I_r,3 partially overlap. Therefore, the overlapping range of the imaging ranges of the diagnostic target image and candidate image I_r,3 is the overlapping range with the diagnostic target image and candidate image combination P_2.

[0069] In FIG. 9, 470 indicates the overlapping range (the sum of 430 and 440) of the imaging range of the candidate image combination P_3 (the combination of candidate images I_r,2 and I_r,3) with the imaging range 410 of the diagnostic target image, expressed in the same manner as in FIG. 7. FIG. 9 shows that the imaging range 410 of the diagnostic target image partially overlaps with the imaging ranges 430 and 440 of the candidate images I_r,2 and I_r,3. In this step, the evaluation unit 61 calculates the size of each range (overlapping range) 450 in FIG. 7, 460 in FIG. 8, and 470 in FIG. 9, and calculates an evaluation value E_j (1≦j≦M) for each combination of candidate images based on the size of the overlapping range. The evaluation value E_j may be the length of the overlapping range in the body axis direction of the subject 400 as shown in FIGS. 7, 8, and 9, or the volume of the overlapping range. Alternatively, it may be the ratio of the overlapping range to the entire imaging range of the diagnostic target image. That is, the evaluation unit 61 corresponds to an example of an overlapping range calculation means that calculates the overlapping range with the first image for each of the plurality of combinations, and an evaluation value calculation means that calculates an evaluation value for each of the plurality of combinations based on the overlapping range. In particular, the evaluation unit 61 corresponds to an example of an overlapping range calculation means that calculates, as the overlapping range, the range of overlap between the sum of the imaging ranges of two or more candidate images included in the combination and the imaging range of the first image.

[0070] The above explanation is based on the premise that the relative positional relationship between the imaging areas of the diagnostic target image and the candidate image is clear. If the relative positional relationship between the imaging areas of each image is not clear, the information processing device 10 can calculate the relative positional relationship by aligning the images in this step. This alignment process can be performed using any known method, and a detailed description thereof will be omitted here.

[0071] Furthermore, the calculation of the relative positional relationship between the imaging ranges of each image is not limited to a method of aligning the images, but may be calculated based on the additional information of each image. For example, if the diagnostic target image and the candidate image are accompanied by information on the "imaging region," the positional relationship between the images can be calculated based on that information. For example, suppose the additional information regarding the imaging region of the diagnostic target image is "chest, abdomen," the additional information regarding the imaging region of candidate image I_r,1 is "head," the additional information regarding the imaging region of candidate image I_r,2 is "abdomen," and the additional information regarding the imaging region of candidate image I_r,3 is "chest." In this case, the imaging range of the combination of candidate images P_1 (the combination of I_r,1 and I_r,2) is estimated to be "head and abdomen," and the overlapping area with the diagnostic target image is estimated to be "abdomen." Furthermore, the imaging range of the combination of candidate images P_2 (the combination of I_r,1 and I_r,3) is estimated to be "head and chest," and the overlapping area with the diagnostic target image is estimated to be "chest." Furthermore, it is estimated that the imaging range of the combination P_3 of candidate images (the combination of I_r,2 and I_r,3) is "chest and abdomen," and the overlapping range with the diagnostic target image is "chest and abdomen." In this case, the evaluation unit 61 can use the number of parts included in the overlapping range (1 if the overlapping range is "chest" or "abdomen," and 2 if "chest and abdomen") as the evaluation value. Alternatively, a predetermined coefficient may be set in advance for each part of the human body, such as "chest" or "abdomen," and the evaluation value may be calculated by multiplying each overlapping range by the coefficient. As a more specific example, for the "chest" or "abdomen," the size of the corresponding part on a standard human body is set as the coefficient. This allows the size of the overlapping range to be calculated in a simpler manner and used as the evaluation value.

[0072] Using the method described above, the evaluation unit 61 calculates an evaluation value E_j (1≦j≦M) for each combination P_j of candidate images generated in step S2010.

[0073] (Step S2020) <Select a set of comparison images> In this step, the selection unit 55 executes a process of selecting a combination of candidate images suitable for comparison with the diagnostic target image from among the combinations of M candidate images based on each evaluation value calculated in step S2010. Specifically, the selection unit 55 selects the combination with the highest evaluation value among the evaluation values ​​E_j (1≦j≦M) for the combinations of M candidate images. The selected combination of candidate images becomes a set of comparison images, and the candidate images constituting the set of comparison images become comparison images. In other words, the selection unit 55 corresponds to an example of a selection means that selects, from among the plurality of candidate images, a plurality of second images to be compared with the first image. In particular, the selection unit 55 corresponds to an example of a selection means characterized by selecting one of the plurality of combinations as a plurality of second images based on the evaluation value.

[0074] (Step S1050) <Comparison process> In this step, the image processing unit 56 performs a comparison process between the diagnostic target image and the set of comparison images to calculate a comparison result. Specifically, for example, the image processing unit 56 performs a subtraction process between the diagnostic target image and the set of comparison images to calculate a subtraction image as the comparison result. That is, the image processing unit 56 corresponds to an example of a generating unit that generates a subtraction image between the first image and the second image by comparing the first image and the second image. In this embodiment, the set of comparison images is composed of multiple comparison images. As an example of a processing method in this step, the image processing unit 56 may perform subtraction process between each of the multiple comparison images included in the set of comparison images and the diagnostic target image. In this case, subtraction images between each of the multiple comparison images and the diagnostic target image are calculated, and these sets of subtraction images can be used as the processing result of this step. It is desirable to perform the subtraction process between the diagnostic target image and each of the multiple comparison images after correcting image differences that are unnecessary for image diagnosis, such as differences in the position and shape of the subject depicted in the diagnostic target image and each of the multiple comparison images, and differences in image quality between the images. Furthermore, the comparison process can process only the overlapping range between the imaging range of each of the multiple comparison images and the imaging range of the diagnostic target image. The overlapping range can be easily obtained from the processing results of steps S2000 and S2010, and therefore a detailed description thereof will be omitted. Note that multiple comparison images constituting a comparison image set may be stitched together into a single comparison image, and then the combined comparison image may be compared with the diagnostic target image. In this case, for overlapping areas between multiple comparison images, any comparison image including the overlapping area may be selected and combined. Alternatively, a comparison image captured at a date and time close to the diagnostic target image, a comparison image captured under similar imaging conditions to the diagnostic target image, or a comparison image with better image quality may be selected. In addition to selecting and combining any comparison images, a method of smoothly calculating a weighted average between overlapping images may also be an embodiment of the present invention.

[0075] The process for calculating the comparison result is not limited to the above-described subtraction process. For example, the image processor 56 may generate a superimposed image for each of the diagnostic target image and multiple comparison images. In this case, different color channels may be assigned to the diagnostic target image and the comparison images, and the superimposed image may be generated as a color image by mixing the two images.

[0076] (Step S1060) <Display of comparison results> In this step, the display control unit 57 executes processing to display the comparison result obtained by the processing of step S1050 on the display unit 36. As a specific example, the display control unit 57 may perform volume rendering on each of the diagnostic target image, the set of comparison images, and the set of difference images that are the comparison results, and display each of the images created by volume rendering (hereinafter, volume-rendered images) side by side on the display unit 36. In this case, for the set of comparison images or the set of difference images, the display control unit 57 may perform volume rendering on each of the multiple comparison images or difference images that constitute the set of comparison images or the set of difference images, and display the multiple volume-rendered images side by side. Alternatively, the display control unit 57 may perform volume rendering after combining the multiple images that constitute each set into a single three-dimensional image by stitching based on the result of step S1050, etc.

[0077] The method of displaying the comparison results is not limited to the above method. The display control unit 57 may display a tomographic image at an arbitrary position in each image on the display unit 36, and the tomographic image to be displayed may be changed by a user operation. In this case, it is desirable that the display control unit 57 identify corresponding positions in each pair of diagnostic target image and comparison image based on the positional relationship between the diagnostic target image and the pair of comparison image, and display a tomographic image at that position (display a corresponding cross section). In other words, when the user changes the tomographic image of the diagnostic target image to be displayed, the display control unit 57 displays a tomographic image at a position in the pair of comparison image corresponding to the position of the changed tomographic image on the display unit 36. Furthermore, when the diagnostic target image and the pair of comparison image are aligned in step S1050, it is desirable that the display control unit 57 perform processing such as switching the tomographic images to be displayed in the diagnostic target image and the difference image in conjunction with each other based on the alignment result.

[0078] The information processing device 10 also has a combination generation unit 60 that sets multiple combinations of multiple candidate images, an overlap range calculation means (evaluation unit 61) that calculates the overlap range between the candidate images included in the multiple combinations and the diagnostic target image (first image), and a selection unit 55 that selects at least one combination from the multiple combinations based on the overlap range, and the selection unit 55 further selects a candidate image included in the selected combination as a comparison image (second image).

[0079] As described above, according to this embodiment, it is possible to select a plurality of comparison images that can be suitably compared with the diagnostic target image without requiring the user to perform cumbersome operations, and to provide the user with the results of the comparison process of those images.

[0080] (Variation 2-1: Combination of candidate images <number of candidate images, evaluation based on the number of candidate images>) In the process of step S2000 of this embodiment, two candidate images are combined as a combination of candidate images. However, this embodiment is not limited to this. For example, three or more candidate images may be combined. In this case, in the process of step S2010, the evaluation unit 61 calculates an evaluation value by comparing the imaging range of the combination of three or more candidate images with the imaging range of the diagnostic target image. The number of candidate images included in each combination of candidate images may be a predetermined constant or may be different numbers. In this case, the combination of candidate images is not necessarily limited to a combination of multiple candidate images; each candidate image may be treated as one of the combinations of candidate images. For example, if the total number of candidate images N is 3, the combination generation unit 60 generates three combinations including only one candidate image, three combinations including two candidate images, and one combination including three candidate images. The subsequent processes may then be performed with a total number of combinations M set to 7. In this case, the greater the number of candidate images combined, the greater the overlapping range tends to be. Therefore, it is desirable to calculate the evaluation value in step S2010 based on not only the overlapping area information but also the number of candidate images included in the combination of candidate images to be evaluated. For example, when there are two combinations of candidate images with approximately the same evaluation value due to the overlapping area (the difference between the evaluation values ​​is equal to or less than a predetermined threshold), the evaluation unit 61 may increase the evaluation value of the combination of candidate images consisting of the fewer number of candidate images. For example, among combinations of candidate images in which the entire area of ​​the diagnostic target image overlaps, the selection unit 55 may select the combination of candidate images consisting of the fewer number of candidate images as the set of comparison images. Alternatively, the evaluation value based on the overlapping area may be multiplied by a predetermined correction coefficient (the value becomes smaller as the number of images to be combined increases) depending on the number of candidate images to be combined, and the corrected evaluation value may be used. This allows the comparison process in step S1050 to be performed on a smaller number of comparison images, thereby improving the efficiency of the process in step S1050 and obtaining higher-quality comparison results.

[0081] (Variation 2-2: Evaluation value calculation method <image quality / imaging conditions>) The processing of step S2010 in this embodiment has been described as an example of calculating an evaluation value based on an overlapping range between the imaging range of the diagnostic target image and the imaging range of the combination of candidate images (hereinafter referred to as overlapping range evaluation), but the implementation of the present invention is not limited to this.

[0082] For example, the evaluation unit 61 may perform an evaluation based on the image quality of each candidate image included in the combination of candidate images (hereinafter referred to as image quality evaluation) separately from the overlapping range evaluation, and calculate an evaluation value by integrating the overlapping range evaluation and the image quality evaluation. That is, the evaluation unit 61 corresponds to an example of an image quality evaluation means for evaluating the image quality of each candidate image included in a plurality of combinations. Specifically, the evaluation unit 61 estimates the noise level of each candidate image included in each combination of candidate images and reduces the evaluation value for combinations including candidate images with high noise levels. For example, a configuration may be adopted in which the evaluation value obtained by the overlapping range evaluation is multiplied by a predetermined correction coefficient (the higher the noise level, the smaller the value) according to the noise level of the candidate image, and the resulting value is used as the corrected evaluation value. In this case, it is desirable for the evaluation unit 61 to calculate the size of the overlapping range between each candidate image and the diagnostic target image, and to calculate the evaluation value by placing greater importance on the noise level of candidate images with larger overlapping ranges. Furthermore, the evaluation unit 61 may calculate the evaluation value by placing greater importance on the noise level of the candidate image with the highest noise level among the candidate images that at least partially overlap with the imaging range of the diagnostic target image. In addition to this, for example, when the image quality of multiple candidate images included in the same combination of candidate images is different, the evaluation unit 61 may lower the evaluation value of the combination. For example, a configuration may be adopted in which the evaluation value based on the overlapping range is multiplied by a predetermined correction coefficient (a value that becomes smaller as the evaluation value of image quality is lower) according to the image quality of the candidate images, and the resulting value is used as the corrected evaluation value.

[0083] Furthermore, without being limited to the above-mentioned method, the evaluation unit 61 may evaluate the candidate images based on, for example, the reconstruction conditions that are supplementary information of the candidate images, and imaging conditions such as the tube voltage and tube current of the X-ray radiation device. The evaluation unit 61 may also evaluate the candidate images based on the resolution of the candidate images (such as the pixel size of the two-dimensional slices and the slice interval). For example, the evaluation unit 61 may correct the evaluation value of the combination so that the evaluation value of the candidate image with a narrow slice interval is higher. Furthermore, when the image capturing conditions of multiple candidate images included in the same combination of candidate images are different, the evaluation unit 61 may lower the evaluation value of the combination.

[0084] In addition, although the above description has been given as an example of a method of evaluation based on the image quality of the candidate image, evaluation may also be based on the image quality of the diagnostic target image. For example, the evaluation unit 61 may evaluate the image quality of the diagnostic target image using a method similar to that described above, and calculate an evaluation value based on both the evaluation of the image quality of the candidate image and the evaluation of the image quality of the diagnostic target image. More specifically, the evaluation value of a combination of candidate images including candidate images with image quality lower than that of the diagnostic target image may be lowered, or the evaluation value of a combination of candidate images including candidate images with image quality close to that of the diagnostic target image may be higher.

[0085] The evaluation unit 61 may also acquire supplementary information, such as the purpose of examination, the name of the organ being examined, and the name of the disease being examined, of each candidate image included in the combination of candidate images from a medical image database as examination information, and evaluate the candidate images based on the examination information. For example, the evaluation unit 61 may be configured to correct the evaluation value so that the evaluation value of a combination of candidate images including a candidate image having supplementary information similar to the examination information of the diagnostic target image is higher. That is, the evaluation unit 61 corresponds to an example of an examination information acquisition means that acquires examination information of each candidate image included in multiple combinations. The evaluation value may also be multiplied by a correction coefficient (the lower the degree of coincidence, the smaller the value) determined according to the degree of coincidence between the diagnostic target image and the supplementary information of the candidate image, and the corrected evaluation value may be used.

[0086] (Variation 2-3: Selection Method) In step S2020 of this embodiment, the selection unit 55 selects one combination of candidate images with the highest evaluation value calculated in step S2010, but the present invention is not limited to this. For example, in step S2020, the selection unit 55 may select multiple combinations of candidate images with evaluation values ​​higher than a predetermined value as sets of comparison images. In this case, the image processing unit 56 may perform a similar comparison process on each of the plurality of sets of comparison images, and calculate the same number of comparison results as the number of sets of comparison images. The above method has the advantage that the user can arbitrarily select and observe a desired comparison result from the comparison results for the plurality of sets of comparison images that meet predetermined conditions.

[0087] (Variation 2-4: Comparison Method) In the processing of step S1050 in this embodiment, the image processing unit 56 generates a difference image or a superimposed image as a comparison process between a diagnostic target image and a set of comparison images. However, the present invention is not limited to this. For example, the image processing unit 56 may perform a deformation and registration process on each of the comparison images constituting the set of comparison images so that the anatomical structures depicted in each comparison image substantially coincide with the anatomical structures depicted in the diagnostic target image, and then deform each comparison image based on the result of the deformation and registration process to generate an image as the result of the comparison process. This has the effect of allowing the user to easily grasp the position in each comparison image constituting the set of comparison images that corresponds to the region of interest to the user in the diagnostic target image.

[0088] The present invention is not limited to this embodiment, and in step S1060, the display control unit 57 may display the diagnostic target image and the set of comparison images side by side on the display unit 36. This has the effect of enabling a set of comparison images selected from multiple candidate images of the same subject as images suitable for comparison with the diagnostic target image to be displayed in a format that allows easy comparison with the diagnostic target image.

[0089] Furthermore, the information processing device 10 may be configured to only perform processing to associate information identifying the selected set of comparison images with the diagnostic target image and store the information in the medical image database 23. In this case, when observing the diagnostic target image using another image viewer, it is possible to read the associated set of comparison images and display them in a form that allows comparison, or to generate a superimposed image or a difference image between the diagnostic target image and the set of comparison images.

[0090] (Variation 2-5: Save as an association) In this embodiment, the case where the display control unit 57 displays the comparison processing result between the diagnostic target image and the set of comparison images as the processing of step S1060 has been described as an example, but the implementation of the present invention is not limited to this. For example, the comparison result calculated by the image processing unit 56 in step S1050 may be stored in the medical image database 23, and the control unit 37 may acquire it through a user operation or the like. Then, a mechanism may be provided in which the display control unit 57 displays the comparison result acquired from the medical image database 23 by processing similar to step S1060. In this case, it is desirable that the control unit 37 saves the comparison processing result in association with the diagnostic target image acquired in step S1010 and the comparison image included in the set of comparison images selected in step S2020. [Example]

[0091] The information processing device 10 according to this embodiment performs a comparison process between a diagnostic target image and a comparison image relating to a subject on whom a user is about to perform a medical procedure, and provides the user with the results of the comparison process. As a specific example, a case will be described in which there are multiple images (hereinafter, candidate images) of the same subject captured on dates different from the date and time of capturing the diagnostic target image. The information processing device 10 according to this embodiment selects an image suitable for comparison with the diagnostic target image from the multiple candidate images as the comparison image, based on information relating to the date and time of capturing the diagnostic target image and the date and time of capturing the candidate image.

[0092] The overall configuration of the medical information processing system according to this embodiment is the same as that shown in FIG. 4 used in the description of the second embodiment. However, only the details of the processing performed by the evaluation unit 61 are different from those in the second embodiment. The processing procedure executed by the information processing device 10 according to this embodiment is the same as that shown in FIG. 5 used in the description of the second embodiment. From step S1010 to step S2000 in FIG. 5, the information processing device 10 executes the same processing as in the second embodiment. A detailed description will be omitted here.

[0093] (Step S2010) In this step, the evaluation unit 61 executes a process of calculating an evaluation value for each of the combinations of candidate images generated in step S2000 in relation to a comparison with the diagnostic target image.

[0094] In this embodiment, the evaluation unit 61 calculates the following evaluation value in addition to the evaluation value calculated in the same manner as in step S2010 of embodiment 2 (evaluation value based on the overlapping range). That is, the evaluation unit 61 also calculates the imaging date and time (imaging date) of each candidate image included in the combination of candidate images to be evaluated, and an evaluation value based on the imaging date and time of the image to be diagnosed (evaluation value based on imaging date and time). Then, the evaluation unit 61 calculates an evaluation value by integrating (for example, adding or multiplying) the two evaluation values.

[0095] A specific example of calculating the evaluation value based on the imaging date and time is a method of calculating the evaluation value based on the difference between the imaging date and time of the diagnostic target image and the imaging date and time (imaging date) of each candidate image included in the combination of candidate images. More specifically, a high evaluation value can be calculated when the period (elapsed time) between the imaging date and time of the diagnostic target image and the representative value of the imaging dates and times of the candidate images included in the combination of candidate images (the representative imaging date and time of the combination of candidate images) is long. Here, the representative value may be the average imaging date and time of the candidate images included in the combination of candidate images, or the oldest or newest imaging date and time. According to this, in step S2020 described below, a combination of candidate images with a long elapsed time based on the imaging date and time of the diagnostic target image is preferentially selected. Note that, in addition to the above, various conditions based on the imaging date and time of the diagnostic target image and the representative imaging date and time of the combination of candidate images can be used as conditions based on the imaging date and time of the diagnostic target image and the representative imaging date and time of the combination of candidate images, as described in Example 1. Here, if a condition is set that a predetermined treatment such as surgery does not occur between the diagnostic target images and the combination of candidate images, it is desirable to set the imaging date and time of the oldest candidate image included in the combination of candidate images as the representative imaging date and time of the combination of candidate images.

[0096] The method of calculating the evaluation value by the evaluation unit 61 is not limited to the method exemplified above. For example, the evaluation unit 61 may calculate a low evaluation value when there is a large variation in the imaging dates and times (imaging dates) of the candidate images included in the combination of candidate images (for example, the interval between the earliest imaging date and time and the latest imaging date and time). In this case, the evaluation value does not depend on the imaging date and time of the diagnostic target image. Furthermore, the evaluation unit 61 may calculate a low evaluation value when there is a large ratio between the imaging date and time of the diagnostic target image and the imaging date and time of the oldest candidate image and the imaging date and time of the diagnostic target image and the latest candidate image. In this way, a combination composed of candidate images with small differences in imaging dates and times is preferentially selected. In this way, a combination of candidate images in which the differences between the candidate images are as small as possible is preferentially selected.

[0097] The condition regarding the image capture date and time may be a combination of the above conditions.

[0098] The conditions regarding the image capture date and time that the evaluation unit 61 uses to calculate the evaluation value may be predetermined fixed conditions, or, as in Example 1, a condition setting unit (not shown) may be provided so that the user can set the conditions according to their purpose.

[0099] In steps S2020 to S1060, the information processing device 10 executes the same processes as those in the second embodiment, and detailed descriptions thereof will be omitted here.

[0100] As described above, in this embodiment, the information processing device 10 has a selection unit 55 that selects a comparison image (second image) to be compared with a diagnostic target image (first image) from a plurality of candidate images, and includes an imaging date and time acquisition unit 53 that acquires imaging dates and times at which the plurality of candidate images are captured, a combination generation unit 60 that sets a plurality of combinations of the plurality of candidate images, a condition setting unit 54 that sets conditions related to the imaging dates and times, and the selection unit 55 that selects at least one combination from the plurality of combinations based on the imaging date and time conditions set by the condition setting unit 54, and the imaging dates and times of the candidate images, and the selection unit 55 further selects a candidate image included in the selected combination as a comparison image (second image). In addition, the evaluation unit 61 may acquire evaluation values ​​of the imaging dates and times of the plurality of candidate images with respect to the imaging date and time conditions, and the selection unit 55 may select at least one candidate image from the plurality of candidate images based on the evaluation values.

[0101] The process of the information processing device 10 in this embodiment is executed according to the procedure described above. In this embodiment, it is possible to select a plurality of comparison images that can be more suitably compared based on the imaging dates and times of the diagnostic object image and the candidate images, and to provide the user with the results of the comparison process of these images.

[0102] (Variation 3-1) In this embodiment, the evaluation value calculation process executed in step S2010 uses the imaging date and time of the diagnostic target image and the imaging date and time of the candidate image. However, the present invention is not limited to this. For example, when generating a combination of candidate images in step 2000, a condition may be set regarding the length of the period between the imaging date and time of the diagnostic target image and the imaging date and time of the candidate image, and a combination of candidate images that satisfies the condition may be generated. Alternatively, a condition may be set regarding the variation in imaging date and time between the candidate images, and a combination of candidate images that satisfies the condition may be generated. Alternatively, a condition may be set regarding whether or not the subject underwent surgery or treatment during the period between the imaging date and time of the diagnostic target image and the imaging date and time of the candidate image, and a combination of candidate images that satisfies the condition may be generated. For example, when generating a combination of candidate images, the imaging dates and times of the multiple comparison images that make up the combination may be set to fall within a predetermined range (e.g., within one year). This makes it possible to omit the process of generating a combination of candidate images that does not satisfy the predetermined condition and the process of calculating the evaluation value, thereby improving processing efficiency.

[0103] (Variation 3-2) The evaluation unit 61 can calculate an evaluation value based on the contrast conditions of the diagnostic target image and the candidate images. Specifically, a high evaluation value can be calculated for a combination of candidate images consisting of candidate images with the same contrast conditions as those of the diagnostic target image. Alternatively, for example, the evaluation value can be calculated based on the variation in the contrast conditions of the multiple candidate images included in the combination of candidate images. For example, when the presence or absence of contrast is used as the contrast condition, a combination of candidate images consisting only of images with contrast (or with the same contrast phase) or a combination of candidate images consisting only of images without contrast can be calculated to have a high evaluation value. Furthermore, the evaluation value can be calculated based on both an evaluation based on the difference between the contrast conditions of the diagnostic target image and those of the candidate images, and the variation in the contrast conditions of the multiple candidate images included in the combination of candidate images. For example, a higher evaluation value can be calculated for a combination of candidate images consisting only of images with the same contrast conditions as those of the diagnostic target image. Furthermore, when the diagnostic target image and the candidate images are MRI images, the evaluation value can be calculated based on the type of image sequence (e.g., T1 or T2) in a manner similar to that described for the example of the contrast condition. According to these methods, a high evaluation value is calculated for a combination of candidate images whose image characteristics match those of the diagnostic target image, thereby providing the user with favorable comparison processing results.

[0104] (Variation 3-3) In step S2010, the evaluation unit 61 may calculate the evaluation value based on the imaging date and time of each image, rather than based on the overlapping range of the imaging of the candidate image and the diagnostic target image. Here, the method of calculating the evaluation value based on the imaging date and time of each image can be performed using the method described above. This has the effect of enabling more efficient processing when the evaluation value based on the overlapping range is not important, such as when it is known that the overlapping range with the diagnostic target image is approximately the same between each of the multiple combinations of candidate images generated in step S2000.

[0105] <Other Examples> It is also possible to combine at least two of the above-described variations.

[0106] Furthermore, the disclosed technology can be embodied as, for example, a system, a device, a method, a program, or a recording medium (storage medium), etc. Specifically, it may be applied to a system consisting of multiple devices (for example, a host computer, an interface device, an imaging device, a web application, etc.), or it may be applied to an apparatus consisting of a single device.

[0107] Needless to say, the object of the present invention can be achieved by the following: A recording medium (or storage medium) on which software program code (computer program) that realizes the functions of the above-described embodiments is recorded is supplied to a system or device. The storage medium is, of course, a computer-readable storage medium. The computer (or CPU or MPU) of the system or device then reads and executes the program code stored on the recording medium. In this case, the program code itself read from the recording medium realizes the functions of the above-described embodiments, and the recording medium on which the program code is recorded constitutes the present invention. [Explanation of symbols]

[0108] 10. Information processing equipment 21 LAN 23 Medical Image Database 31 Communication Interface 32 ROM 33 RAM 34 Storage section 35 Control section 36 Display section 50 control section 51 Diagnostic target image acquisition unit 52 Comparison candidate image acquisition unit 53 Shooting date and time acquisition unit 54 Condition setting section 55 Selection section 56 Image processing section 57 Display control unit

Claims

1. An information processing device having a selection means for selecting a second image to be compared with a first image from a plurality of candidate images, an evaluation means for setting conditions based on the imaging date and time and imaging region of the first image, acquiring the imaging date and time and imaging region of each of the plurality of candidate images, and evaluating the plurality of candidate images based on the imaging date and time and imaging region of the plurality of candidate images in response to the conditions; the selecting means selects at least one candidate image as the second image from the plurality of candidate images based on the evaluation result of the evaluating means; The information processing device is characterized in that the evaluation means includes as its conditions any one of the following: the imaging date and time being a certain period or more after the imaging date and time of the first image; the imaging date and time being within a predetermined period after the imaging date and time of the first image; or the imaging date and time being within a predetermined period that is a certain period or more after the imaging date and time of the first image and has an upper and lower limit.

2. 2. The information processing apparatus according to claim 1, wherein the evaluation means includes in the condition that the imaging region is the same as the imaging region of the first image.

3. 2. The information processing apparatus according to claim 1, wherein the evaluation means further evaluates the plurality of candidate images based on imaging conditions for the plurality of candidate images.

4. 2. The information processing apparatus according to claim 1, wherein the evaluation means further evaluates the plurality of candidate images based on resolutions of the plurality of candidate images.

5. 2. The information processing apparatus according to claim 1, wherein the evaluation means further evaluates the plurality of candidate images based on a pixel size of a slice or a slice interval in the plurality of candidate images.

6. 2. The information processing apparatus according to claim 1, wherein the evaluation means further evaluates the plurality of candidate images based on image quality of the plurality of candidate images.

7. 2. The information processing apparatus according to claim 1, wherein the evaluation means further evaluates the plurality of candidate images based on a noise level in the plurality of candidate images.

8. 8. The information processing apparatus according to claim 1, wherein the evaluation means acquires an evaluation value based on the evaluation result, and the selection means selects candidate images having an evaluation value higher than a predetermined value.

9. The condition includes that the image capture date and time is within a predetermined period of time that is a period having an upper limit and a lower limit from the image capture date and time of the first image, and 2. The information processing apparatus according to claim 1, wherein the selection means selects a candidate image that satisfies the condition from among the plurality of candidate images.

10. The information processing device described in claim 8, characterized in that the evaluation means acquires the overlapping range between the first image and each of the multiple candidate images, and further performs evaluation based on the overlapping range, and if there is a combination of multiple candidate images among the multiple candidate images where the difference in evaluation value due to the overlapping range is less than a predetermined threshold, the evaluation means evaluates so that the evaluation value of the combination of candidate images consisting of a smaller number of candidate images among the multiple candidate image combinations is higher.

11. The evaluation means includes in the condition that the image capture date and time is the most recent image capture date and time and is a certain period or more after the image capture date and time of the first image, 2. The information processing apparatus according to claim 1, wherein the selection means selects a candidate image that satisfies the condition from among the plurality of candidate images.

12. The evaluation means includes in the condition that the image is taken within a predetermined period from the first image taking date and time and is the earliest image taking date and time, 2. The information processing apparatus according to claim 1, wherein the selection means selects a candidate image that satisfies the condition from among the plurality of candidate images.

13. An information processing method for selecting a second image to be compared with a first image from a plurality of candidate images, comprising: a step of setting conditions based on the imaging date and time and imaging region of the first image, acquiring the imaging date and time and imaging region of each of the plurality of candidate images, and evaluating the plurality of candidate images based on the imaging date and time and imaging region of the plurality of candidate images relative to the conditions; selecting at least one candidate image from the plurality of candidate images as the second image based on a result of the evaluation; An information processing method characterized in that in the step of performing the evaluation, the conditions include any of the following: the image capture date and time being a certain period or more after the image capture date and time of the first image; the image capture date and time being within a predetermined period after the image capture date and time of the first image; or the image capture date and time being within a predetermined period that is a certain period or more after the image capture date and time of the first image and has an upper and lower limit.

14. A program for causing a computer to execute the information processing method described in claim 13.

Images