Information processing device, medical photographing error information management system, and program
The system addresses the challenge of comparing diagnostic and reference images by displaying them together, enhancing imaging standards recognition and technique improvement in medical facilities.
Patent Information
- Application Number
- JP2024147141
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-29
- Publication Date
- 2024-11-21
- Estimated Expiration
- 2041-03-31
AI Technical Summary
Conventional systems fail to easily facilitate the comparison of diagnostic images with reference images, complicating the process of identifying imaging standards in medical facilities.
An information processing device and system that displays failed images alongside reference images, allowing for easy comparison and confirmation of imaging standards, with the reference images being displayed in separate or same windows as the failed images.
Enables easy confirmation and comparison of reference images with failed images, improving imaging techniques by providing a clear reference for diagnosis.
Smart Images

Figure 2024163135000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device, a medical failure information management system, and a program. [Background technology]
[0002] Conventionally, in the medical field, various imaging tests are performed on patients using examination devices such as radiography devices. In taking medical images, there are cases where the images are judged to be unsuitable for diagnosis (image failure) due to defects in the imaging area or body movement, and re-imaging is required.
[0003] For example, in a failure information management device that associates and stores failure information including a failure image and failure shooting conditions with re-shooting information including a diagnostic image obtained by re-shooting and re-shooting conditions, a technology has been proposed that displays the failure information and re-shooting information in a failure case viewing window (see Patent Document 1). [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2015-173804 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, in the above conventional technology, since the re-photographing information and the failure information are associated with each other, it is possible to find the cause of the judgment that the image is a failure, but it is difficult to recognize how far the image used for diagnosis (diagnostic image) is from the shooting standard required in medical facilities such as hospitals. If the reference image serving as the shooting standard is searched for using a screen or function other than the failure example viewing window, the work becomes complicated, and it is not easy for the user to check the reference image while viewing the failure image and the diagnostic image.
[0006] The present invention has been made in consideration of the above-mentioned problems in the conventional technology, and an object of the present invention is to enable a reference image that serves as a shooting reference to be easily checked in addition to a failed image. [Means for solving the problem]
[0007] In order to solve the above problem, the invention described in claim 1 is an information processing device having a display unit that displays a failed image that has been photographed and is deemed a failure, and a reference image that is an image that is set in advance as an image suitable for diagnosis and is the target image for photographing.
[0008] The invention described in claim 2 is the information processing device described in claim 1, wherein the display unit displays the failed image, a diagnostic image used for diagnosing the same patient as the failed image, and the reference image.
[0009] The invention described in claim 3 is an information processing device described in claim 2, in which the diagnostic image is displayed in a window different from the window in which the failed image is displayed, or in a window different from the window in which the reference image is displayed.
[0010] The invention described in claim 4 is an information processing device described in claim 1 or 2, wherein the window in which the failed image is displayed and the window in which the reference image is displayed are the same window, and the failed image and the reference image are displayed side by side in the same window.
[0011] In accordance with a fifth aspect of the present invention, in the information processing device according to the second aspect, the diagnostic image is an image obtained by re-imaging the same patient as that of the failed image in response to the same imaging request as that of the failed image.
[0012] According to a sixth aspect of the present invention, in the information processing device according to the first aspect, data for displaying the failed image and the reference image is provided to a console.
[0013] The invention described in claim 7 is a medical failure information management system having a display unit that displays a failure image that has been unsuccessfully photographed and a reference image that is a target image for photographing that has been preset as an image suitable for diagnosis.
[0014] The invention described in claim 8 is a medical image failure information management system described in claim 7, wherein the display unit displays the failed image, a diagnostic image used to diagnose the same patient as the failed image, and the reference image.
[0015] The invention described in claim 9 is the medical image failure information management system described in claim 8, wherein the diagnostic image is displayed in a window different from the window in which the failed image is displayed, or in a window different from the window in which the reference image is displayed.
[0016] The invention described in claim 10 is a medical failure information management system described in claim 7 or 8, in which the window in which the failure image is displayed and the window in which the reference image is displayed are the same window, and the failure image and the reference image are displayed side by side in the same window.
[0017] The invention described in claim 11 is the medical failure information management system described in claim 8, wherein the diagnostic image is an image obtained by re-taking an image of the same patient as that of the failure image in response to the same imaging request as that of the failure image.
[0018] According to a twelfth aspect of the present invention, in the medical failure information management system according to the seventh aspect, data for displaying the failure image and the reference image is provided to a console.
[0019] The invention described in claim 13 is a program for causing a computer to function as a display unit that displays a failed image that has been photographed and is deemed a failure, and a reference image that is a target image for photography that has been preset as an image suitable for diagnosis.
[0020] The invention described in claim 14 is the program described in claim 13, wherein the display unit displays the failed image, a diagnostic image used for diagnosing the same patient as the failed image, and the reference image.
[0021] The invention described in claim 15 is the program described in claim 14, wherein the diagnostic image is displayed in a window different from the window in which the failed image is displayed, or in a window different from the window in which the reference image is displayed.
[0022] The invention described in claim 16 is the program described in claim 13 or 14, wherein the window in which the failed image is displayed and the window in which the reference image is displayed are the same window, and the failed image and the reference image are displayed side by side in the same window.
[0023] In accordance with a seventeenth aspect of the present invention, in the program according to the fourteenth aspect, the diagnostic image is an image obtained by re-imaging the same patient as that of the failed image in response to the same imaging request as that of the failed image.
[0024] The invention described in claim 18 is the program described in claim 13, which causes the computer to function as providing data for displaying the failed image and the reference image to a console. Effect of the Invention
[0025] According to the present invention, in addition to the failed image, the reference image that serves as the shooting reference can be easily checked. [Brief description of the drawings]
[0026] [Figure 1] 1 is a diagram illustrating an example of a system configuration of a failure information management system according to an embodiment of the present invention. [Diagram 2] 11 is a diagram showing an example of a data configuration of shooting result record information transmitted from the console to the failure information management device. FIG. [Diagram 3]FIG. 2 is a block diagram showing a functional configuration of the failure information management device. [Figure 4] FIG. 4 illustrates an example of a data configuration of an image management table. [Diagram 5] 13 is a diagram illustrating an example of a data configuration of a reference image setting table. [Figure 6] 13 is a diagram showing an example of a data configuration of a continuous playback condition setting table. FIG. [Figure 7] 13 is an example of a reference image setting screen. [Figure 8] 13 is an example of a continuous playback condition setting screen. [Figure 9] 13 is an example of a radiography region / direction selection screen. [Figure 10] 11 is a flowchart showing a failure information display process executed in the failure information management device. [Figure 11] 13 is a flowchart showing a continuous reproduction process. [Figure 12] 13 is an example of a comparison display screen. [Figure 13] 13 is an example of a bookmark selection screen. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0027] Hereinafter, an embodiment of a medical image failure information management device according to the present invention will be described. Note that the present invention is not limited to the illustrated examples.
[0028] FIG. 1 shows an example of the system configuration of a failure information management system 100. As shown in FIG. 1, the image failure information management system 100 is composed of an inspection device 10, a console 20, an image failure information management device 30 as a medical image failure information management device, and the devices are connected to each other so as to be able to transmit and receive data via a communication network NT such as a LAN (Local Area Network). Each device constituting the image failure information management system 100 complies with the HL7 (Health Level Seven) or DICOM standard, and communication between the devices is performed in accordance with HL7 or DICOM.
[0029] The examination device 10 is a modality such as an X-ray device (DR, CR), an ultrasound diagnostic device (US), a CT, or an MRI, and takes an image of a patient to generate image data of a medical image. The examination device 10 writes the additional information in the header of an image file of the medical image in accordance with the DICOM standard, thereby attaching additional information to the medical image. The additional information includes, for example, a patient ID (identification information for identifying a patient), name, sex, date of birth, examination UID (identification information for identifying an examination), imaging site, imaging direction, imaging date and time, imaging technician, modality, tube voltage, tube current, irradiation time, image UID (identification information for identifying a medical image), and the like.
[0030] The console 20 controls the imaging operation in the examination device 10 according to an imaging order (including patient information such as a patient ID and a patient name, and imaging request information such as an imaging part and an imaging direction). The console 20 includes a display unit that displays medical images captured by the examination device 10, and an operation unit that accepts operation inputs from a radiographer. The radiographer performs various settings related to the examination by inputting information from the operation unit of the console 20.
[0031] The radiographer (image examiner) checks on the console 20 whether the medical images captured by the inspection device 10 are images usable for diagnosis (diagnostic images) or defective images.
[0032] A failed image is an image that fails to be captured for some reason and is not used for diagnosis. It is also called a NG image. If multiple images are judged to be failed for one planned capture (same examination for the same patient), there will be multiple failed images. When the radiographer judges that a medical image obtained by radiography is a rejected image, he or she operates the operation section of the console 20 to record that the medical image is a rejected image and the reason for the rejection. There are various reasons for poor imaging, including positioning, body movement, foreign bodies, insufficient intake, insufficient dose, artifacts, catheter readjustment, imaging conditions, wrong patient, wrong site, etc.
[0033] A diagnostic image is an image that is suitable for diagnostic purposes (an image that is used for diagnosis), and is also called an OK image. Diagnostic images are often images that have been retaken (re-taken images) after a failed image. A re-taken image is an image of the same patient as the failed image, taken again for the same shooting request as the failed image. A re-taken image is taken using the same shooting method as the failed image.
[0034] The imaging method is the imaging and examination method used in diagnostic imaging. The imaging method is composed of the imaging area, imaging direction, imaging technique, etc., and may also include conditions related to the imaging subject.
[0035] On the other hand, among the imaging conditions, the tube voltage, tube current, irradiation time, and the like are adjusted at the time of re-imaging, so that the values may differ between the failed image and the re-imaging image.
[0036] The console 20 generates imaging result record information for each examination by operation of the imaging technician based on the imaging request. Note that the console 20 may automatically determine whether a medical image is a diagnostic image or a failed image based on image analysis or the like.
[0037] FIG. 2 shows an example of the data structure of the shooting result record information. The imaging result record information includes at least the examination UID and the image UID of the diagnostic image. The examination UID is identification information for identifying an examination. The examination UID identifies the patient to be examined and the examination (imaged part, image direction). In this embodiment, an examination performed according to a certain imaging order (imaging request) is managed with one examination UID. That is, when an examination is performed on a certain patient, both failed images and diagnostic images used for later diagnosis are managed with the same examination UID. The image UID is identification information for identifying a medical image, and for example, a SOP instance UID or the like is used. The image UID of the diagnostic image is the image UID of an image (diagnostic image) that was successfully captured for the examination indicated by the examination UID.
[0038] Furthermore, if there is a failed image for the examination indicated by the examination UID (if the diagnostic image is a retaken image), the shooting result record information further includes the image UID of failed image k and the reason for failure of failed image k, the same number as the number of failed images (k=1, 2,..., n, where n is the number of failed images). Here, the kth failed image is expressed as "failed image k." The imaging result record information indicates the correspondence between diagnostic images and failed images for an examination identified by the examination UID.
[0039] The console 20 transmits the imaging result record information generated for each examination to the failure information management device 30 together with the image file of the medical image.
[0040] The failure information management device 30 is a computer device that manages medical images taken by the inspection device 10 and information regarding failures (information indicating whether each medical image is a failure image, the correspondence between diagnostic images and failure images, etc.).
[0041] FIG. 3 shows a functional configuration of the failure information management device 30. As shown in FIG. As shown in FIG. 3, the failure information management device 30 includes a control unit 31, a display unit 32, an operation unit 33, a communication unit 34, a storage unit 35, etc., and each unit is connected by a bus.
[0042] The control unit 31 is composed of a CPU (Central Processing Unit) and a RAM (Random Access Memory), and generally controls the processing operations of each unit of the failure information management device 30. Specifically, the CPU reads out various processing programs stored in the storage unit 35, loads them into the RAM, and performs various processes in cooperation with the programs.
[0043] The display unit 32 is configured to include a monitor such as an LCD (Liquid Crystal Display), and displays various screens according to instructions of a display signal input from the control unit 31.
[0044] The operation unit 33 is configured with a keyboard equipped with cursor keys, letter and number input keys, various function keys, etc., and a pointing device such as a mouse, and outputs operation signals input by key operations on the keyboard or mouse operations to the control unit 31.
[0045] The communication unit 34 is configured with a network interface or the like, and transmits and receives data to and from an external device connected via the communication network NT. For example, the communication unit 34 receives, from the console 20, medical images obtained by photographing a patient with the examination device 10 and photographing result record information.
[0046] The storage unit 35 is configured with an HDD (Hard Disk Drive), a non-volatile memory, etc., and stores various data. An image management table 351, a reference image setting table 352, and a continuous playback condition setting table 353 are stored in the storage unit 35. The storage unit 35 also has a file storage area 354.
[0047] The image management table 351 stores information for each medical image stored in the file storage area 354 . FIG. 4 shows an example of the data configuration of the image management table 351. As shown in FIG. In the image management table 351, each medical image is associated with an image UID, patient ID, name, sex, date of birth, examination UID, imaging area, imaging direction, imaging date and time, imaging technician, file path, reject category, reject reason, bookmark type, etc.
[0048] The "Image UID" field stores the image UID of the medical image. The "Patient ID", "Name", "Gender", and "Date of Birth" fields store the patient ID, name, gender, and date of birth of the patient who is the subject of imaging, respectively. The "Examination UID" field stores the examination UID of the examination related to the medical image. The "photographed part", "photographing direction", "photographing date and time", and "photographer" fields store the photographed part, photographing direction, photographing date and time, and photographer of the medical image, respectively. Information such as the image UID, patient ID, name, sex, date of birth, examination UID, imaging part, imaging direction, imaging date and time, and imaging technician is obtained from the supplementary information of the medical image.
[0049] The "file path" field stores the location in the file storage area 354 where the medical image is saved. The "failure category" field stores information (failure category) indicating whether the medical image is a diagnostic image or a failure image. If the medical image is a failure image, the failure category includes information on which failure image it is. Specifically, for a diagnostic image, the failure category is "0", for the first failure image, the failure category is "1", for the second failure image, the failure category is "2", ... In the "reject reason" field, when the reject category is other than "0", that is, when the medical image is a rejected image, the reject reason is stored.
[0050] In the "Bookmark type" field, the bookmark type is stored when classification is performed for medical images (failed images) using the bookmark function. The bookmark function allows you to bookmark images that interest you (images of high interest) while reviewing images. By tagging a specific medical image, you can specify the bookmark type when viewing the medical image again later, and search and extract medical images that belong to the specified bookmark type. Examples of bookmark types include images for conferences (images you want to use at the next conference), for academic presentations, and for important examinations. The names of bookmark types can be defined in advance by the user, and can include "the most difficult knee image that failed to be photographed," "images you want to ask a veteran to check," and "images where your photography skills have improved significantly."
[0051] The reference image setting table 352 is a table for managing a reference image set for each imaging method (imaged part and imaging direction).
[0052] The reference image is an image suitable for diagnosis, and serves as a standard for imaging. The reference image is set in advance for each imaging method. Each medical facility can define the reference image as an imaging standard required within the medical facility. The reference image is like a target set by the medical facility, and does not indicate a boundary for determining whether an image is diagnostic or not. In other words, whether a medical image can be used for diagnosis is determined by each medical facility, so even if a medical image is not as good as the reference image, it can be used as a diagnostic image. The reference image is often specified for each imaging region and imaging direction, but it can also be specified based on factors that affect imaging, such as the patient's physique. Also, multiple reference images can be specified for the same imaging method.
[0053] FIG. 5 shows an example of the data configuration of the reference image setting table 352. As shown in FIG. In the reference image setting table 352, the image UID of the reference image, the reference image type, the name, a comment common to all regions, and a comment specific to the image are associated with each combination of an imaging region and an imaging direction.
[0054] The "imaging site" and "imaging direction" are the imaging method for which the reference image is specified. "Image UID of reference image" is the image UID of the medical image designated as the reference image. "Reference image type" is the type of reference image, and there are "A standard" and "B standard". A standard is an image that is very suitable as a reference image (e.g., the best image using the same shooting method, etc.). B standard is an image that is suitable as a reference image (e.g., an image of a pass level, an acceptable level, etc.). The criteria for setting a reference image differs for each medical facility. Also, here, the reference images are classified into two types, but it may be possible to set reference images by classifying them into more types, or there may be only one type of reference image. "Name" is the name of the reference image. The "region-wide comment" is a comment input for the region photographed in the reference image. An "image-specific comment" is a comment entered for a reference image. The site-wide comment and image-specific comment are input as memos or notices when setting or referring to a reference image. Note that the reference image may be searched for using terms included in the comment.
[0055] The continuous playback condition setting table 353 is a table for managing continuous playback conditions. The continuous playback conditions are conditions for displaying multiple sets of failed images, diagnostic images, and reference images, that is, conditions for continuously playing back multiple sets. FIG. 6 shows an example of the data configuration of the continuous playback condition setting table 353. As shown in FIG. In the continuous playback condition setting table 353, for each continuous playback condition, a name, a shooting period, a camera operator (photographer), a shooting part / direction (shooting method), a bookmark type, an automatic playback interval, a playback order, and the like are associated.
[0056] "Name" is the name of the continuous playback condition. "Shooting period," "Photographer," "Photographed part / direction," and "Bookmark type" are conditions for narrowing down the medical images (failed images) to be displayed. For example, if the shooting date and time of a failed image is included in the "shooting period" of the continuous playback conditions, the failed image will be displayed. Also, if the photographer, photographed part, shooting direction, and bookmark type of the failed image match those specified in the continuous playback conditions, the failed image will be displayed.
[0057] The "automatic playback interval" is the time for playing (displaying) one set when playing back multiple sets of failed images, diagnostic images, and reference images in succession. The display automatically switches from the currently displayed set to the next set at the time interval set as the automatic playback interval. The "playback order" refers to the order in which a plurality of sets of failed images, diagnostic images, and reference images are played back in succession, and may be in chronological order, such as oldest first, newest first, etc. For example, the order is determined by the date and time of capture of the failed images.
[0058] The control unit 31 acquires the failed image, the diagnostic image, and the reference image from an external device (the console 20, the inspection device 10, etc.) via the communication unit 34. That is, the control unit 31 functions as an acquisition unit.
[0059] The control unit 31 causes the display unit 32 to display the failed image, the diagnostic image used for diagnosis, and the reference image serving as a shooting standard in a manner that allows comparison. "Comparable" means that the user can compare the three images, the failed image, the diagnostic image, and the reference image, and also includes displaying each image in a separate window. The control unit 31 causes a reference image corresponding to the same imaging method as that of the failed image to be displayed together with the failed image and the diagnostic image.
[0060] For example, the control unit 31 causes the defective image, the diagnostic image, and the reference image to be displayed in one window. The control unit 31 causes the defective image, the diagnostic image, and the reference image to be displayed side by side.
[0061] The control unit 31 switches and displays a set to be displayed from among a plurality of sets of failed images, diagnostic images, and reference images.
[0062] The control unit 31 plays back a plurality of sets continuously based on the continuous playback conditions set in advance. Specifically, the control unit 31 determines a plurality of sets based on the shooting period, the imaging technician, the shooting part and direction, and the bookmark type included in the continuous playback conditions. That is, the control unit 31 narrows down the medical images to be displayed. Then, the control unit 31 determines the order in which the sets of the failed images, the diagnostic images, and the reference images are displayed based on the playback order included in the continuous playback conditions, and switches the sets to be displayed based on the automatic playback interval included in the continuous playback conditions.
[0063] Next, the operation of the failure information management system 100 will be described. <How to register image failure information> First, a method for registering information on medical images and failures in the failure information management device 30 will be described. When the examination apparatus 10 captures an image of a patient's body part in accordance with the imaging direction, the imaging technician checks on the console 20 whether the medical image is a diagnostic image or a failed image.
[0064] The console 20 transmits to the failure information management device 30 the imaging result record information (see FIG. 2) generated for each examination together with the image file of the medical image captured by the examination device 10.
[0065] The control unit 31 of the imaging failure information management device 30 acquires, via the communication unit 34, from the console 20, image files of one or more medical images generated in the same examination (same imaging request) of the same patient, and the imaging result record information corresponding to the examination. The control unit 31 stores image files of each medical image of the same patient in the same examination obtained from the console 20 in a file memory area 354 of the memory unit 35, and also stores information about each medical image in an image management table 351 of the memory unit 35 (see Figure 4).
[0066] Specifically, the control unit 31 associates, for each medical image, the image UID, patient ID, name, sex, date of birth, examination UID, imaging part, imaging direction, imaging date and time, imaging technician, etc., obtained from the supplementary information of the medical image, and stores them as a new record in the image management table 351. In addition, for each medical image, the control unit 31 stores the storage location of the image file of the medical image in the "file path" field of the record corresponding to the medical image in the image management table 351.
[0067] Furthermore, the control unit 31 acquires the examination UID, the image UID of the diagnostic image, the image UID of the failed image k, and the reason for the failure of the failed image k from the imaging result record information (k=1, 2, . . . , n). The control unit 31 stores "0" in the "failure classification" field for records corresponding to medical images in which the value of the "image UID" field in the image management table 351 is "image UID of diagnostic image". The control unit 31 also stores "k" in the "failure classification" field and stores "reason for the failure of the failed image k" in the "reason for the failure" field for records corresponding to medical images in which the value of the "image UID" field in the image management table 351 is "image UID of the failed image k".
[0068] <How to set the reference image> Next, a method for setting the reference image will be described. FIG. 7 shows an example of a reference image setting screen 321 displayed on the display unit 32 of the failure information management device 30. As shown in FIG. The reference image setting screen 321 includes an image area 40, a detailed information area 41, a reference image type selection area 42, a name input area 43, a site-common comment input area 44, an image-specific comment input area 45, a save button B1, and the like.
[0069] In the image area 40, a medical image designated by the user as a reference image is displayed. Detailed information about the medical image designated as the reference image is displayed in the detailed information area 41. The detailed information area 41 includes an imaging region selection area 41A and an imaging direction selection area 41B. The imaging region selection area 41A is an area for selecting an imaging region of the reference image. The photographing direction selection area 41B is an area for selecting the photographing direction of the reference image. By selecting an imaging region and an imaging direction in the imaging region selection area 41A and the imaging direction selection area 41B, a reference image can be specified for each imaging region and imaging direction.
[0070] The reference image type selection area 42 is an area for selecting "A reference" or "B reference" for the reference image. The name input area 43 is an area for inputting the name of the reference image. The region-common comment input area 44 is an area for inputting a comment common to the photographed regions of the reference image. The image-specific comment input area 45 is an area for inputting an image-specific comment for the reference image. The save button B1 is a button for instructing saving of the reference image set on the reference image setting screen 321.
[0071] For example, when no image is displayed in the image area 40, if the user clicks on the image area 40 by operating the operation unit 33, the control unit 31 causes the display unit 32 to display a list of medical images based on the image management table 351 in the storage unit 35. Here, the control unit 31 may limit the list to display only diagnostic images (imaging failure category: 0). When the user operates the operation unit 33 to specify a medical image to be used as a reference image from the list, the control unit 31 obtains the "file path" of the specified medical image (reference image) from the image management table 351, obtains the image file of the reference image from the file memory area 354 based on this "file path", and displays the reference image in the image area 40. Furthermore, the control unit 31 causes the detailed information area 41 to display information included in the supplementary information of the reference image and information on the reference image managed in the image management table 351 .
[0072] The user operates the operation unit 33 to select a region to be photographed in the region to be photographed selection area 41A, and selects a photographing direction in the photographing direction selection area 41B. Furthermore, the user operates the operation unit 33 to select “A reference” or “B reference” in the reference image type selection area 42 . Furthermore, the user operates the operation unit 33 to input the name of the reference image, the region-common comment, and the image-specific comment in the name input area 43, the region-common comment input area 44, and the image-specific comment input area 45, respectively.
[0073] When the user presses the save button B1 through the operation unit 33, the control unit 31 saves the set contents in the reference image setting table 352 (see FIG. 5) of the storage unit 35. Specifically, the control unit 31 stores in the reference image setting table 352 the imaging part, imaging direction, image UID of the reference image, reference image type, name, part-common comment, and image-specific comment in association with each other.
[0074] <How to set continuous playback conditions> Next, a method for setting the continuous playback condition will be described. FIG. 8 shows an example of a continuous playback condition setting screen 322 displayed on the display unit 32. As shown in FIG. The continuous playback condition setting screen 322 includes a course selection area 50, a name input area 51, a shooting period selection area 52, a camera operator selection area 53, a shooting part / direction selection area 54, a bookmark selection area 55, an automatic playback interval selection area 56, a playback order selection area 57, an add button B11, a delete button B12, an edit button B13, etc.
[0075] In the course selection area 50, the names of the continuous playback conditions already set in the continuous playback condition setting table 353 (see FIG. 6) in the storage unit 35 are displayed. The name input area 51 is an area for inputting the name of the continuous playback condition.
[0076] The imaging period selection area 52 is an area for selecting the period (target range) of imaging dates and times of medical images to be continuously played back. For example, when the imaging period selection area 52 is clicked, a pull-down menu is displayed with options such as today, past three days, past week, past month, past three months, past year, past three years, past five years, past ten years, etc.
[0077] The camera operator selection area 53 is an area for selecting a camera operator of medical images to be continuously played back. For example, when the camera operator selection area 53 is clicked, the names or operator IDs (identification information for identifying a camera operator) of multiple camera operators are displayed. In the camera operator selection area 53, one or multiple camera operators can be selected.
[0078] The shooting part / direction selection area 54 is an area for selecting the shooting part / direction of the medical image to be continuously played back. For example, when the shooting part / direction selection area 54 is clicked, the shooting part / direction selection screen 323 shown in Fig. 9 is displayed. Here, the shooting part / direction is managed in three hierarchical levels: "part group", "part", and "direction". As "site groups (first hierarchical layer)", an abdomen group 60, a chest group 61, and a chest / abdomen group 62 are displayed, and each group can be expanded to a lower hierarchical layer. For the abdomen group 60, the lower hierarchical levels are expanded, and an abdomen 63, a child abdomen 64, and a portable abdomen 65 are displayed as "sites (second hierarchical level)". For the abdomen 63, the lower layers are expanded, and standing position, front 66, lying position, front 67, sitting position, front 68, and lying position, side 69 are displayed as "orientations (third layer)". "Shooting location and direction" can be selected at any of the "Location Group", "Location", and "Direction" hierarchies. When a higher level is selected, the shooting location and shooting direction of the lower levels included in the selected level will be included.
[0079] 8 is an area for selecting the type of bookmark for medical images to be played back continuously. For example, when the bookmark selection area 55 is clicked, a pull-down menu is displayed with options such as for conferences, for academic presentations, and for important examinations.
[0080] The automatic playback interval selection area 56 is an area for selecting a time interval (5 seconds, 10 seconds, . . . ) for continuously playing back a plurality of sets of failed images, diagnostic images, and reference images. The playback order selection area 57 is an area for selecting the playback order when a plurality of sets of failed images, diagnostic images, and reference images are played back consecutively.
[0081] The Add button B11 is a button for instructing the addition of a continuous playback condition. When the user inputs or selects in the areas 51 to 57 and presses the Add button B11, the control unit 31 adds the new continuous playback condition to the continuous playback condition setting table 353. As a result, the name of the continuous playback condition input in the name input area 51 is added to the course selection area 50.
[0082] The Delete button B12 is a button for instructing the deletion of a continuous playback condition. When the user selects a continuous playback condition to be deleted from among the continuous playback conditions displayed in the course selection area 50 and presses the Delete button B12, the control unit 31 deletes the record corresponding to the selected continuous playback condition from the continuous playback condition setting table 353. As a result, the name of the selected continuous playback condition is deleted from the course selection area 50.
[0083] The edit button B13 is a button for instructing editing of the continuous playback conditions. When the user selects a continuous playback condition to be edited from among the continuous playback conditions displayed in the course selection area 50 and presses the edit button B13, the control unit 31 obtains the currently set information for the selected continuous playback condition from the continuous playback condition setting table 353, displays it in the areas 51 to 57, and accepts changes.
[0084] <Image failure information display processing> Next, the failure information display process will be described. 10 is a flowchart showing a failure information display process executed in the failure information management device 30. This process is realized by software processing in cooperation with the CPU of the control unit 31 and a program stored in the storage unit 35.
[0085] First, the control unit 31 displays a continuous playback condition designation screen on the display unit 32, and accepts the designation of continuous playback conditions by the user's operation on the operation unit 33 (step S1). Specifically, the control unit 31 reads out the names of each continuous playback condition from the continuous playback condition setting table 353 in the storage unit 35, and displays the names of each continuous playback condition on the continuous playback condition designation screen. The user designates one of the continuous playback conditions from the candidates displayed on the continuous playback condition designation screen.
[0086] Next, the control unit 31 extracts failed images that match the conditions (shooting period, photographer, shooting body part / direction, bookmark type) related to the images to be displayed from the specified continuous playback conditions (step S2). Specifically, the control unit 31 extracts medical images from the image management table 351 of the storage unit 35, in which the value of the "shooting date and time" field is included in the "shooting period", the values of the "photographer", "shooting body part", "shooting direction", and "bookmark type" fields match the specified conditions, and the value of the "failure classification" field is other than "0". It should be noted that items not specified in the continuous playback conditions are not limited when extracting failed images that meet the conditions.
[0087] Next, the control unit 31 acquires a failure image for one examination from among the extracted failure images (step S3). Specifically, the control unit 31 acquires the "file path" of the record of an unprocessed failure image from among the extracted failure images from the image management table 351, and acquires the image file of the failure image from the file storage area 354 of the storage unit 35 based on this "file path". Here, if there are multiple failure images in the same examination (common examination UID, imaging region, and imaging direction) of the same patient (common patient ID), each of the multiple failure images is acquired.
[0088] Next, the control unit 31 acquires the photographing method (photographed part and photographing direction) of the acquired failed image (step S4). Specifically, the control unit 31 acquires the "photographed part" and "photographing direction" included in the record corresponding to the failed image acquired in step S3 in the image management table 351.
[0089] Next, the control unit 31 judges whether or not there is a retaken image corresponding to the failed image to be processed (step S5). Specifically, the control unit 31 judges whether or not there is a retaken image of the same patient and the same examination (same imaging request) as the failed image to be processed in the image management table 351. That is, the control unit 31 judges whether or not there is a medical image in the image management table 351 whose values in the "Patient ID", "Examination UID", "Photographed part", and "Photographing direction" fields match those of the failed image and whose value in the "Failure classification" field is "0".
[0090] If there is no re-taken image corresponding to the failed image to be processed (step S5; NO), the control unit 31 excludes this failed image from the display targets because there is no re-taken image (step S6).
[0091] In step S5, if there is a recaptured image (diagnostic image) corresponding to the failed image to be processed (step S5; YES), the control unit 31 acquires the diagnostic image corresponding to the failed image to be processed (step S7). Specifically, the control unit 31 acquires the "file path" of the record of the diagnostic image corresponding to the failed image to be processed from the image management table 351, and acquires the image file of the diagnostic image from the file storage area 354 based on this "file path".
[0092] Next, the control unit 31 judges whether there is a reference image corresponding to the same imaging method (imaging part and imaging direction) as the failure image to be processed (step S8). Specifically, the control unit 31 refers to the reference image setting table 352 of the storage unit 35 and judges whether there is a record corresponding to the same combination of "imaging part" and "imaging direction" as the failure image to be processed.
[0093] If there is no reference image corresponding to the same shooting method as the failed image to be processed (step S8; NO), the control unit 31 excludes this failed image from the display targets because there is no reference image (step S9).
[0094] In step S8, if there is a reference image corresponding to the same photographing method as the failed image to be processed (step S8; YES), the control unit 31 acquires this reference image (step S10). Specifically, the control unit 31 acquires the "image UID of reference image" and "reference image type" corresponding to the same combination of "photographed part" and "photographing direction" as the failed image from the reference image setting table 352. Then, the control unit 31 acquires the "file path" of a record whose "image UID" field value is "image UID of reference image" from the image management table 351, and acquires an image file of the reference image from the file storage area 354 based on this "file path". Here, if there are multiple reference images corresponding to the same photographing method as the failed image to be processed, each of the multiple reference images is acquired.
[0095] The control unit 31 manages the failed image acquired in step S3, the diagnostic image acquired in step S7, and the reference image acquired in step S10 as one set of display objects.
[0096] After step S6, step S9 or step S10, the control unit 31 determines whether or not the processing is completed for all the failed images extracted in step S2 (step S11). If there is an unprocessed failed image among the failed images extracted in step S2 (step S11; NO), the process returns to step S3, and the process is repeated with another failed image as the processing target.
[0097] In step S11, when the processing is completed for all the failed images extracted in step S2 (step S11; YES), the control unit 31 acquires the playback order (oldest first, newest first, etc.) from the continuous playback condition specified in step S1 (step S12). The control unit 31 determines the order of displaying the sets of the failed images, diagnostic images, and reference images according to the playback order.
[0098] Next, the control unit 31 causes the display unit 32 to continuously play back the sets of the failed image, the diagnostic image, and the reference image in accordance with the playback order (step S13). Details of the process of step S13 will be described in the continuous playback process of FIG. This completes the failure information display process.
[0099] 11 is a flowchart showing the continuous playback process, which is a process for switching among a plurality of sets of a failed image, a diagnostic image, and a reference image, a set to be displayed and displaying the selected set.
[0100] First, the control unit 31 causes the display unit 32 to display the first set of failed images, diagnostic images, and reference images in a comparative manner according to the playback order included in the continuous playback conditions (step S21). If the playback order is "oldest first," the set of failed images with the oldest "photographed date and time" becomes the first set.
[0101] FIG. 12 shows an example of a comparison display screen 324 displayed on the display unit 32. As shown in FIG. The comparison display screen 324 includes a course display area 70, a failed image display area 71, a diagnostic image display area 72, a reference image display area 73, a next button B21, a back button B22, and a "hide detailed information" button B23. In the course display area 70, continuous playback conditions designated by the user are displayed.
[0102] The failed image display area 71 includes an image area 71A, a thumbnail area 71B, a detailed information area 71C, position adjustment buttons 71D and 71E, and a bookmark button 71F. In the image area 71A, the failed image is displayed. A thumbnail image of the failed image is displayed in the thumbnail area 71B. When there are multiple failed images for the same examination of the same patient, thumbnail images corresponding to the multiple failed images are displayed in the thumbnail area 71B, and the failed image corresponding to the thumbnail image selected in the thumbnail area 71B is displayed in the image area 71A. In the detailed information area 71C, detailed information of the failed image displayed in the image area 71A (information included in the additional information of the failed image, information of the failed image managed in the image management table 351, etc.) is displayed.
[0103] The position adjustment button 71D (left button) is a button for swapping the display position of the failed image display area 71 with the diagnostic image display area 72 or reference image display area 73 to the left when a diagnostic image display area 72 or reference image display area 73 exists to the left of the failed image display area 71. The position adjustment button 71E (right-facing button) is a button for swapping the display position of the failed image display area 71 with the diagnostic image display area 72 or reference image display area 73 to the right when a diagnostic image display area 72 or reference image display area 73 is present to the right of the failed image display area 71.
[0104] The bookmark button 71F is a button for attaching a bookmark to the failed image. When the bookmark button 71F is pressed, a bookmark selection screen 325 shown in FIG. The bookmark selection screen 325 includes check boxes 80-89 corresponding to multiple bookmark types, an input completion button B31, and a cancel button B32. The user can add a bookmark to the failed image by checking one or more of the check boxes 80-89 corresponding to the bookmark type to which the failed image is to be classified and pressing the input completion button B31. The cancel button B32 is a button for canceling the addition of a bookmark to the failed image.
[0105] The diagnostic image display area 72 includes an image area 72A, a thumbnail area 72B, a detailed information area 72C, and position adjustment buttons 72D and 72E. A diagnostic image is displayed in image area 72A. In the thumbnail area 72B, a thumbnail image of the diagnostic image is displayed. In the detailed information area 72C, detailed information of the diagnostic image displayed in the image area 72A (information included in the supplementary information of the diagnostic image, information of the diagnostic image managed in the image management table 351, etc.) is displayed.
[0106] The position adjustment button 72D is a button for swapping the display position with the failed image display area 71 or reference image display area 73 to the left of the diagnostic image display area 72 when a failed image display area 71 or reference image display area 73 exists to the left of the diagnostic image display area 72. The position adjustment button 72E is a button for swapping the display position of the diagnostic image display area 72 with the adjacent failed image display area 71 or reference image display area 73 to the right when a failed image display area 71 or reference image display area 73 is present to the right of the diagnostic image display area 72.
[0107] The reference image display area 73 includes an image area 73A, a thumbnail area 73B, a detailed information area 73C, and position adjustment buttons 73D and 73E. A reference image is displayed in image area 73A. Thumbnail area 73B displays thumbnail images of reference images, distinguishing between reference A and reference B. When there are multiple reference images, thumbnail images corresponding to the multiple reference images are displayed in thumbnail area 73B, and the reference image corresponding to the thumbnail image selected in thumbnail area 73B is displayed in image area 73A. In the detailed information area 73C, detailed information about the reference image displayed in the image area 73A (information included in the supplementary information of the reference image, information about the reference image managed in the image management table 351, etc.) is displayed.
[0108] The position adjustment button 73D is a button for swapping the display position with the failed image display area 71 or diagnostic image display area 72 to the left of the reference image display area 73 when a failed image display area 71 or diagnostic image display area 72 exists to the left of the reference image display area 73. The position adjustment button 73E is a button for swapping the display position with the failed image display area 71 or diagnostic image display area 72 to the right of the reference image display area 73 when a failed image display area 71 or diagnostic image display area 72 exists to the right of the reference image display area 73.
[0109] In the comparison display screen 324, the failed image, the diagnostic image, and the reference image are displayed side by side in one window. The left, center, and right arrangement of the failed image (failed image display area 71), the diagnostic image (diagnostic image display area 72), and the reference image (reference image display area 73) can be changed by the position adjustment buttons 71D, 71E, 72D, 72E, 73D, and 73E. For example, by arranging the failed image and the reference image next to each other, it becomes easier to recognize how different the failed image is from the reference image.
[0110] The next button B21 is a button for switching the display of the set of the failed image, diagnostic image, and reference image displayed in the failed image display area 71, diagnostic image display area 72, and reference image display area 73 to the next set. The back button B22 is a button for switching the display of the set of the failed image, diagnostic image, and reference image displayed in the failed image display area 71, diagnostic image display area 72, and reference image display area 73 to the previous set.
[0111] The "Hide detailed information" button B23 is a button for instructing not to display the detailed information in the detailed information areas 71C, 72C, and 73C.
[0112] Next, the control unit 31 determines whether or not the next button B21 has been pressed by the user through the operation unit 33 (step S22). When the Next button B21 is pressed (step S22; YES), the control unit 31 causes the display unit 32 to display the next set of failed images, diagnostic images, and reference images in a comparative manner after the currently displayed set (step S23).
[0113] After step S23, or if the Next button B21 is not pressed in step S22 (step S22; NO), the control unit 31 determines whether or not the Back button B22 is pressed by the user operating the operation unit 33 (step S24). When the back button B22 is pressed (step S24; YES), the control unit 31 causes the display unit 32 to display the failed image, diagnostic image, and reference image of the set immediately preceding the currently displayed set in a comparative manner (step S25).
[0114] After step S25 or in step S24, if the back button B22 is not pressed (step S24; NO), the control unit 31 judges whether the automatic playback interval (included in the continuous playback condition) has elapsed since the display of the currently displayed set of the failed image, diagnostic image, and reference image started (step S26). For example, the control unit 31 starts counting time when the display of the set of the failed image, diagnostic image, and reference image is switched, and judges whether the automatic playback interval has elapsed. Note that when another thumbnail image is selected in the thumbnail area 71B and the failed image displayed in the image area 71A is changed, when another thumbnail image is selected in the thumbnail area 73B and the reference image displayed in the image area 73A is changed, when the position adjustment buttons 71D, 71E, 72D, 72E, 73D, and 73E are pressed and the arrangement of the failed image display area 71, the diagnostic image display area 72, and the reference image display area 73 is changed, the time is restarted at the timing when the display is changed. If the automatic playback interval has elapsed since the display of the currently displayed set of failed images, diagnostic images, and reference images was started (step S26; YES), the control unit 31 causes the display unit 32 to display the next set of failed images, diagnostic images, and reference images in a comparative manner (step S27).
[0115] After step S27, or in step S26, if the automatic playback interval has not elapsed since the display of the currently displayed set of failed images, diagnostic images, and reference images was started (step S26; NO), the process returns to step S22 and is repeated.
[0116] As described above, according to this embodiment, the failed image, the diagnostic image, and the reference image are displayed on the display unit 32 so as to be comparable, so that in addition to the failed image and the diagnostic image, the reference image serving as the shooting reference can be easily confirmed. By displaying the reference image, it becomes easy to compare the failed image and the diagnostic image, and it is possible to understand the current problems in shooting and to support the improvement of shooting techniques. Specifically, by displaying the defective image, the diagnostic image, and the reference image in one window, it becomes easy to compare the three images. Moreover, by displaying the defective image, the diagnostic image, and the reference image side by side, it becomes easy to compare the three images.
[0117] Furthermore, the failure image, the diagnostic image, and the reference image managed by the failure information management device 30 can be acquired from an external device (the console 20, the inspection device 10, etc.).
[0118] In addition, a diagnostic image obtained by re-imaging the same patient as the failed image in response to the same imaging request as the failed image is displayed so as to be comparable with the failed image, making it easy to grasp the difference between the failed image and the diagnostic image. In addition, since the reference image corresponding to the same imaging method as the failed image is displayed together with the failed image and the diagnostic image, it is easy to grasp the difference between the failed image and the diagnostic image and the reference image.
[0119] Furthermore, for a plurality of sets of a failed image, a diagnostic image, and a reference image, the failed image, the diagnostic image, and the reference image can be displayed by switching for each set to be displayed.
[0120] Furthermore, multiple sets of images (failed images, diagnostic images, and reference images) can be played back continuously based on the continuous playback conditions. Specifically, the sets to be displayed can be switched at the automatic playback interval included in the continuous playback conditions in accordance with the order determined based on the playback order included in the continuous playback conditions. That is, even if the user does not press the Next button B21 for displaying the next set of images on the comparison display screen 324, the sets to be displayed can be switched sequentially at the automatic playback interval.
[0121] When playing back a plurality of sets in succession, images can be switched automatically based on time (automatic playback interval), and images can also be switched manually (with the next button B21 and back button B22).
[0122] Furthermore, by allowing the user to set in advance the conditions for continuous playback, such as the photographer (photographer), shooting area and direction (shooting method), and shooting period, continuous playback of multiple sets of images can be achieved under the conditions desired by the user. Specifically, the images to be displayed (multiple sets) can be narrowed down based on the radiographer, the imaging site and direction (site group, site, direction), and the imaging period. For example, this can be used to review (review) medical images taken by the radiographer himself, or to review issues with imaging of a specific imaging site or imaging period.
[0123] In addition, if a bookmark is added to a failed image, the images to be displayed can be narrowed down according to the bookmark type. By specifying the bookmark type, it is possible to check multiple sets of images (failed image, diagnostic image, and reference image) for each bookmark type. The bookmark function allows users to extract images of high interest, allowing users to efficiently reuse sets of failed image, diagnostic image, and reference image that have already been checked.
[0124] The above description of the embodiment is an example of the medical image failure information management device according to the present invention, and is not limited thereto. The detailed configuration and detailed operation of each part constituting the device can be appropriately changed without departing from the spirit of the present invention.
[0125] For example, in the above embodiment, a case has been described in which a set of a failure image, a diagnostic image, and a reference image is displayed on the display unit 32 of the failure information management device 30, but the failure information management device 30 may provide an external device with data for displaying the failure image, the diagnostic image, and the reference image in a comparative manner. Specifically, the failure information management device 30 may be accessible from a client terminal, and the failure information management device 30 may display the set of a failure image, a diagnostic image, and a reference image on the display unit of the client terminal in the order of playback.
[0126] In addition, when continuous playback is performed by specifying any of the continuous playback conditions, the playback history (date and time, continuous playback conditions, etc.) may be recorded, and the continuous playback conditions may be selected from the history to perform continuous playback based on those continuous playback conditions.
[0127] In addition, in the above embodiment, a case has been described in which both automatic image switching based on time and manual image switching are possible when playing multiple sets continuously, but it is also possible to enable only one of the automatic switching and manual switching.
[0128] In addition, in the above embodiment, a reference image is set later for a medical image acquired from the console 20, but a medical image that has been set in advance as a reference image may be acquired from an external device.
[0129] The programs for executing the processes in each device may be stored in a portable recording medium. A carrier wave may be used as a medium for providing the program data via a communication line. [Explanation of symbols]
[0130] 10 Inspection equipment 20 Console 30 Photo loss information management device 31 Control Unit 32 Display section 33 Operation section 34 Communications Department 35 Storage section 70 Course display area 71 Missing Image Display Area 72 Diagnostic image display area 73 Reference image display area 100 Photo failure information management system 321 Reference image setting screen 322 Continuous playback condition setting screen 324 Comparison display screen 351 Image Management Table 352 Reference Image Setting Table 353 Continuous playback condition setting table 354 File Storage NT Communications Network
Claims
1. An information processing device having a display unit that displays a failed image that has been photographed unsuccessfully and a reference image that is a target image for photographing and is preset as an image suitable for diagnosis.
2. The information processing apparatus according to claim 1 , wherein the display unit displays the failed image, a diagnostic image used for diagnosing the same patient as the failed image, and the reference image.
3. The information processing apparatus according to claim 2 , wherein the diagnostic image is displayed in a window different from a window in which the failed image is displayed, or a window different from a window in which the reference image is displayed.
4. The information processing apparatus according to claim 1 , wherein a window in which the failed image is displayed and a window in which the reference image is displayed are the same window, and the failed image and the reference image are displayed side by side in the same window.
5. The information processing apparatus according to claim 2 , wherein the diagnostic image is an image obtained by re-imaging the same patient as that of the failed image in response to the same imaging request as that of the failed image.
6. The information processing apparatus according to claim 1 , further comprising: a console that displays the failed image and the reference image.
7. A medical failure information management system having a display unit that displays a failed image that has been photographed and is deemed a failure, and a reference image that is a target image for photographing that has been preset as an image suitable for diagnosis.
8. The medical reject information management system according to claim 7 , wherein the display unit displays the reject image, a diagnostic image used for diagnosing the same patient as the reject image, and the reference image.
9. The medical reject information management system according to claim 8 , wherein the diagnostic image is displayed in a window different from a window in which the reject image is displayed, or a window different from a window in which the reference image is displayed.
10. The medical failure information management system according to claim 7 or 8, wherein a window in which the failed image is displayed and a window in which the reference image is displayed are the same window, and the failed image and the reference image are displayed side by side in the same window.
11. The medical failure information management system according to claim 8 , wherein the diagnostic image is an image obtained by re-taking an image of the same patient as that of the failure image in response to the same imaging request as that of the failure image.
12. The medical reject information management system according to claim 7 , further comprising: a console provided with data for displaying the reject image and the reference image.
13. Computer, A program for causing the display unit to function as a display unit that displays a failed image that has been photographed and is deemed a failure image, and a reference image that is a target image for photography that has been preset as an image suitable for diagnosis.
14. The program according to claim 13 , wherein the display unit displays the failed image, a diagnostic image used for diagnosing the same patient as the failed image, and the reference image.
15. The program of claim 14 , wherein the diagnostic image is displayed in a window different from a window in which the failed image is displayed or a window different from a window in which the reference image is displayed.
16. 15. The program according to claim 13, wherein a window in which the failed image is displayed and a window in which the reference image is displayed are the same window, and the failed image and the reference image are displayed side by side in the same window.
17. The program according to claim 14 , wherein the diagnostic image is an image obtained by re-imaging the same patient as that of the failed image in response to the same imaging request as that of the failed image.
18. The computer, The program according to claim 13, which functions to provide a console with data for displaying the failed image and the reference image.
Citation Information
Patent Citations
Method for identifying image and radiation image photographing apparatus
JP2002272726A
Display method of display of image processing apparatus
JP2006078381A
Information processor, image diagnostic system, and display control method of image for diagnosis
JP2010240141A
Medical image display apparatus
JP2011177530A
Examination information display device and system
JP2013128725A
