Image diagnosis support device, operation method of image diagnosis support device, and program

Abstract

This image diagnosis assistance device includes a processor and a memor, and the image diagnosis assistance device can be carried by a user. The processor executes: computer-aided diagnosis processing on an medical image; communication processing in which an image file containing a medical image and supplemental information is received from an external device, and information including the results of the computer-aided diagnosis processing is transmitted to the external device; and prohibition instruction transmission processing, by which an instruction is sent to the external device to prohibit the transmission of an image file containing supplemental information that includes personal information unnecessary for the computer-aided diagnosis processing.

Description

[Technical Field]

[0001] The technology of the present disclosure relates to an image diagnosis support device, an operation method for the image diagnosis support device, and a program. [Background technology]

[0002] There is known an image diagnosis support device that performs image analysis processing to analyze medical images such as radiological images using a computer, thereby providing information useful for diagnosis, such as the detection of lesions in the medical images. This image diagnosis support device is also called a computer-aided diagnosis (CAD) device.

[0003] The image diagnosis support device is configured as a stationary server and is connected to an image storage device such as a PACS (Picture Archiving and Communication Systems) via a network within a medical facility. Medical images captured by modalities such as a radiographic device are stored in the PACS. The image diagnosis device then performs CAD processing on the medical images based on a request from a terminal device operated by a doctor performing a diagnosis within the medical facility, and transmits the results of the CAD processing to the terminal device that issued the request (Japanese Patent Laid-Open Publication No. 2003-150714).

[0004] Furthermore, Japanese Patent Application Laid-Open No. 2003-150714 discloses that, for example, an imaging diagnostic device installed in a medical facility such as a base hospital is connected to a terminal device in a remote regional hospital via a network, allowing a regional hospital that does not have an imaging diagnostic support device to use the imaging diagnostic support device located in the base hospital. Summary of the Invention [Problem to be solved by the invention]

[0005] In recent years, there has been an increasing need for medical diagnosis outside of hospitals, such as in disaster medical care or home medical care, and to meet this need, portable modalities such as portable radiography devices have been developed. Even in such situations, there is a demand for the use of image diagnosis support devices to enable rapid on-site medical diagnosis.

[0006] However, in disaster medical care or at-home medical care, it may not be possible to use a network such as the Internet, and it may be difficult to use an image diagnosis support device installed in a facility such as that described in JP 2003-150714 A from a remote location. Therefore, there is a demand for an image diagnosis support device that can be used in disaster medical care or at-home medical care.

[0007] However, in disaster medical care or at-home medical care, it is often not possible to use a network such as the Internet, and it may be difficult to use an image diagnosis support device installed in a facility such as that described in JP 2003-150714 A from a remote location. Therefore, there is a demand for an image diagnosis support device that can be used in disaster medical care or at-home medical care.

[0008] Therefore, it is conceivable to make the image diagnosis support device portable so that it can be used in disaster medical care, home medical care, etc. However, if the image diagnosis support device is made portable, there is a risk of it being stolen. Since the image diagnosis support device stores medical images and the incidental information of the medical images includes personal information of patients, there is a possibility that the personal information may be leaked.

[0009] The technology disclosed herein aims to provide an image diagnosis support device, an operating method for an image diagnosis support device, and a program that can be used in disaster medical care or home medical care and that can prevent the leakage of personal information. [Means for solving the problem]

[0010] In order to achieve the above object, the image diagnosis support device disclosed herein is an image diagnosis support device that has a processor and memory and is portable by a user, and the processor performs computer-aided diagnostic processing on a medical image, a communication process that receives an image file including a medical image and accompanying information from an external device and transmits information including the results of the computer-aided diagnostic processing to the external device, and a prohibition instruction transmission process that transmits to the external device an instruction to prohibit the transmission of an image file including personal information unnecessary for the computer-aided diagnostic processing in the accompanying information.

[0011] The processor preferably executes the prohibition instruction transmission process before receiving the image file from the external device.

[0012] After executing the prohibition instruction transmission process, if the image file received from the external device contains personal information unnecessary for the computer-aided diagnostic process, the processor preferably discards the image file.

[0013] Preferably, the processor will refuse to receive data from the external device after discarding the image file.

[0014] The processor preferably executes the prohibition instruction transmission process after receiving the image file from the external device.

[0015] If the additional information of the image file from the external device includes personal information unnecessary for the computer-aided diagnostic process, the processor preferably discards the image file and executes a prohibition instruction transmission process.

[0016] After executing the prohibition instruction transmission process, it is preferable that the processor refuses to receive data from the external device if the additional information of the image file received from the external device contains personal information that is not necessary for the computer-aided diagnostic process.

[0017] After executing the prohibition instruction transmission process, if the additional information of the image file received from the external device contains personal information that is not necessary for the computer-aided diagnostic process, it is preferable that the processor discard the image file after performing the computer-aided diagnostic process.

[0018] The present disclosure provides an operating method for an image diagnosis support device that is portable by a user, the operating method comprising: The processor: The system performs computer-aided diagnostic processing on medical images, communication processing to receive an image file containing a medical image and accompanying information from an external device and transmit information containing the results of the computer-aided diagnostic processing to the external device, and prohibition instruction transmission processing to transmit an instruction to the external device to prohibit the transmission of an image file containing personal information unnecessary for the computer-aided diagnostic processing in the accompanying information.

[0019] The program of the present disclosure is a program for causing a processor to execute processing in an image diagnosis support device that has a processor and a memory and is portable by a user. , medical The processor executes a computer-aided diagnostic process for the image to be used, a communication process for receiving an image file including a medical image and additional information from an external device and transmitting information including the results of the computer-aided diagnostic process to the external device, and a prohibition instruction transmission process for transmitting to the external device an instruction to prohibit the transmission of an image file including personal information unnecessary for the computer-aided diagnostic process in the additional information. [Effects of the Invention]

[0020] According to the technology of the present disclosure, it is possible to provide an image diagnosis support device, an operating method for an image diagnosis support device, and a program that can be used in the field of disaster medical care or home medical care, and that can prevent the leakage of personal information. [Brief explanation of the drawings]

[0021] [Figure 1] 1 is a diagram illustrating an example of the configuration of an X-ray imaging system according to a first embodiment. [Figure 2]1 is a block diagram showing an example of a hardware configuration of an X-ray imaging system according to a first embodiment. [Figure 3] FIG. 10 is a diagram illustrating an example of a console screen. [Figure 4] FIG. 2 is a diagram illustrating an example of a file format of an image file. [Figure 5] FIG. 10 is a diagram illustrating an example of personal information deletion processing. [Figure 6] 10A and 10B are diagrams conceptually illustrating an example of personal information deletion processing and CAD processing. [Figure 7] FIG. 10 is a diagram illustrating an example of a learning phase in which a detection model is learned by machine learning. [Figure 8] 10 is a flowchart showing an example of a processing flow of an X-ray source and an electronic cassette. [Figure 9] 10 is a flowchart showing an example of a processing flow of the console and the image diagnosis support device. [Figure 10] 10 is a flowchart showing an example of processing of the image diagnosis support device according to a modified example of the first embodiment. [Figure 11] 10 is a flowchart showing an example of processing by the console and the image diagnosis support device according to the second embodiment. [Figure 12] 10 is a flowchart showing an example of processing of the image diagnosis support apparatus according to the first modified example of the second embodiment. [Figure 13] 10 is a flowchart showing an example of processing of an image diagnosis support apparatus according to a second modified example of the second embodiment. [Figure 14] 10A and 10B are diagrams illustrating an example in which part of personal information is deleted from the incidental information of an image file. DETAILED DESCRIPTION OF THE INVENTION

[0022] [First embodiment] 1 shows an example of the configuration of an X-ray imaging system 2 that uses X-rays as radiation. The X-ray imaging system 2 that uses X-rays as radiation includes an X-ray source 10, an electronic cassette 20, a console 30, an image diagnosis support device 40, and a repeater 50. The console 30 communicates with the electronic cassette 20 and the image diagnosis support device 40 via the repeater 50. The repeater 50 functions as, for example, an access point.

[0023] The X-ray source 10 is an example of a radiation source that generates radiation. The electronic cassette 20 is an example of a radiation image detector that detects radiation and generates a radiation image. The image diagnosis support device 40 performs CAD processing to detect areas including abnormal shadows from the radiation image.

[0024] The X-ray source 10, electronic cassette 20, console 30, and image diagnosis support device 40 of this embodiment are all small and portable devices. The X-ray imaging system 2 can be carried to the scene where emergency medical response is required, such as an accident or disaster, or to the home of a patient receiving home medical care, and used to take X-ray images. With such a portable X-ray imaging system 2, captured X-ray images can be immediately checked on the spot, preventing the need for re-imaging that would require a return visit at a later date. X-ray images are an example of a "medical image" according to the technology of the present disclosure.

[0025] In the X-ray imaging system 2, the electronic cassette 20 is placed in a position facing the X-ray source 10. By placing the subject H between the X-ray source 10 and the electronic cassette 20, an examination region of the subject H (for example, the chest) can be X-rayed.

[0026] The X-ray source 10 is held by, for example, a holding device 60. The holding device 60 is, for example, a four-legged device having four support legs 61 and a horizontal bar 62. The upper ends of the support legs 61 and both ends of the horizontal bar 62 are connected to a three-pronged joint 63, thereby assembling the holding device 60. The horizontal bar 62 is provided with a mounting fixture 64 for mechanically mounting the X-ray source 10. The X-ray source 10 is suspended by the mounting fixture 64 so that the emission direction of the X-rays 4 faces downward.

[0027] An exposure switch 11 is connected to the X-ray source 10 via a cable 11A. A user, such as a radiologist or a doctor, who uses the X-ray imaging system 2 can operate the exposure switch 11 to cause the X-ray source 10 to start emitting X-rays 4.

[0028] The electronic cassette 20 has an automatic X-ray detection function that detects the start of irradiation of X-rays 4 emitted from the X-ray source 10. Therefore, the electronic cassette 20 does not need to be connected to the X-ray source 10. Furthermore, the electronic cassette 20 has a built-in battery and wireless communication function, so it does not need to be connected to a power source or the console 30 via a cable. The electronic cassette 20 is wirelessly connected to a repeater 50 and communicates with the console 30 via the repeater 50.

[0029] The console 30 is configured, for example, by a personal computer, and has a display unit 31 and an input operation unit 32. The console 30 is connected, for example, to a repeater 50 via a communication cable 51. The display unit 31 is a display device such as a liquid crystal display or an organic EL (Electro Luminescence) display. The input operation unit 32 is an input device including a keyboard, a mouse, a touchpad, or the like.

[0030] The user can input patient information, imaging conditions, etc. by operating the input operation unit 32. The display unit 31 displays the X-ray image that the console 30 receives from the X-ray source 10. If the user observes the X-ray image and determines that CAD processing is necessary, the user can use the input operation unit 32 to input a request to execute CAD processing.

[0031] The console 30 communicates with the image diagnosis support device 40 via the repeater 50. The console 30 transmits a CAD processing request to the image diagnosis support device 40 in response to an operation signal input by a user via the input operation unit 32. At this time, the console 30 transmits an X-ray image together with the CAD processing request to the image diagnosis support device 40. Upon receiving the CAD processing result from the image diagnosis support device 40, the console 30 causes the display unit 31 to display the X-ray image reflecting the CAD processing result.

[0032] The image diagnosis support device 40 has a housing 41 that is large enough for a user to carry. The housing 41 is, for example, a box-shaped case with dimensions of 20 cm or less in length, width, and height. The housing 41 is provided with a power switch 42, a first connector 43A, a second connector 43B, and a third connector 43C. For example, the first connector 43A is a terminal having a USB (Universal Serial Bus) Type A interface (hereinafter referred to as USB-A I / F). The second connector 43B is a terminal having a LAN (Local Area Network) interface (hereinafter referred to as LAN I / F). The third connector 43C is a terminal having a USB Type C interface (hereinafter referred to as USB-C I / F).

[0033] The housing 41 does not have a display for displaying X-ray images. Furthermore, the housing 41 does not have a user interface that is operated by a user to input information. The user interface is, for example, a physical operation button or a touch panel. In this way, the housing 41 does not have a display or a user interface, and therefore can be made smaller as described above. The housing 41 may also have a connector for connecting a display as an external device (for example, an HDMI (registered trademark) (High-Definition Multimedia Interface) terminal), and a connector for connecting a keyboard or other external device (for example, a USB terminal).

[0034] The image diagnosis support device 40 is connected to the repeater 50 wirelessly or via a wire. For example, by connecting a wireless dongle 70 to the first connector 43A, the image diagnosis support device 40 is wirelessly connected to the repeater 50. The wireless dongle 70 is, for example, a WiFi_USB adapter that enables communication via WiFi. When the wireless dongle 70 is connected to the first connector 43A, the image diagnosis support device 40 communicates with the console 30 via the repeater 50. The console 30 is an example of an "external device" according to the technology of the present disclosure.

[0035] The second connector 43B is used when the image diagnosis support device 40 and the repeater 50 are wired connected via a LAN cable (not shown). When a LAN cable is connected between the second connector 43B and the repeater 50, the image diagnosis support device 40 communicates with the console 30 via the repeater 50.

[0036] The third connector 43C is compatible with the USB_PD (Power Delivery) power supply standard. A mobile battery 80 can be connected to the third connector 43C via a USB cable 81 that is compatible with USB_PD. The mobile battery 80 can supply power to the inside of the image diagnosis support device 40 and to an internal battery built into the image diagnosis support device 40. The mobile battery 80 supplies DC power to the image diagnosis support device 40.

[0037] The third connector 43C can also be connected to an AC (Alternating Current) adapter (not shown) instead of the mobile battery 80. The third connector 43C can be connected to an AC adapter via a USB cable 81, and the AC adapter can be connected to a commercial AC power source in a general household, etc. This allows the image diagnosis support device 40 to receive power that has been converted from the commercial AC power source to DC by the AC adapter.

[0038] 2 shows an example of the hardware configuration of the X-ray imaging system 2. The X-ray source 10 includes a processor 12, an input operation unit 13, an internal battery 14, a high-voltage generator 15, an X-ray tube 16, and an irradiation field limiter 17. The processor 12 functions as a control unit that controls the operations of the high-voltage generator 15 and the irradiation field limiter 17. The processor 12 is connected to the above-mentioned irradiation switch 11. The input operation unit 13 is also connected to the processor 12. The input operation unit 13 includes an imaging condition adjustment button for setting the tube voltage and tube current of the X-ray tube 16, an irradiation field button for adjusting the size of the irradiation field of the irradiation field limiter 17, a power button, etc.

[0039] The processor 12 controls the high voltage generator 15 and the irradiation field limiter 17 based on the setting conditions set by the input operation unit 13. The processor 12 causes the high voltage generator 15 to generate a high voltage in response to operation of the irradiation switch 11. The built-in battery 14 is a secondary battery such as a lithium polymer battery, and can be charged via a connector (not shown).

[0040] The X-ray tube 16 is a fixed anode type X-ray tube that does not have a target rotation mechanism. The X-ray tube 16 is composed of a cold cathode electron source that emits electrons, an electron accelerator, a target that generates X-rays 4 through electron collisions, and an outer tube that houses these. A cold cathode electron source does not require a filament or a heater to heat it, as is the case with a hot cathode. The X-ray tube 16 is small and lightweight because it does not have a target rotation mechanism, filament, or heater. Furthermore, because the X-ray tube 16 does not require preheating of the filament, it is possible to generate X-rays 4 immediately in response to an irradiation start command.

[0041] The irradiation field limiter 17 limits the irradiation field of the X-rays 4 generated by the X-ray tube 16. The X-rays 4 generated by the X-ray tube 16 have an irradiation field limited by the irradiation field limiter 17 and are irradiated onto the examination region of the subject H. The X-rays 4 that have passed through the examination region of the subject H enter the electronic cassette 20.

[0042] The electronic cassette 20 includes a processor 21, an X-ray detection panel 22, a memory 23, a communication I / F 24, and an internal battery 25. The processor 21 functions as a control unit that controls each unit in the electronic cassette 20. The X-ray detection panel 22 is, for example, a flat panel detector having a matrix substrate on which a plurality of pixels, each made of a thin film transistor (TFT) and an X-ray detection element, are two-dimensionally arranged.

[0043] In the X-ray detection panel 22, when the TFTs are turned off and in a charge accumulation state, the X-ray detection elements convert incident X-rays into electric charges and accumulate the electric charges. Then, when the TFTs are turned on and in a charge readout state, the X-ray detection panel 22 reads out the electric charges accumulated in the X-ray detection elements to a signal processing circuit. In the signal processing circuit, an integrating amplifier converts the read-out electric charges into voltage signals, and an A / D converter converts the converted voltage signals into digital image data. Hereinafter, this image data will be referred to as the X-ray image XP.

[0044] The memory 23 is a non-volatile memory such as a flash memory, and stores the X-ray image XP generated by the X-ray detection panel 22. The communication I / F 24 is wirelessly connected to the repeater 50. The processor 21 transmits the X-ray image XP stored in the memory 23 to the console 30 via the repeater 50. Note that the electronic cassette 20 can also be wired and connected to the repeater 50 via a communication cable.

[0045] The built-in battery 25 is a secondary battery such as a lithium polymer battery, and can be charged via a connector (not shown).

[0046] The console 30 includes a display unit 31, an input operation unit 32, a processor 33, a random access memory (RAM) 34, a non-volatile memory (NVM) 35, and a communication I / F 36. The processor 33 is, for example, a central processing unit (CPU). The RAM 34 is a work memory for the processor 33 to execute processing. The NVM 35 is a storage device such as a flash memory, and stores a program 37.

[0047] The processor 33 loads a program 37 stored in the NVM 35 into the RAM 34 and executes processing in accordance with the program 37, thereby functioning as a console control unit 38 that comprehensively controls each unit of the console 30. The console control unit 38 displays a GUI (Graphical User Interface) screen on the display unit 31, thereby enabling input of patient information, imaging conditions, and the like using the input operation unit 32. The console control unit 38 also causes the display unit 31 to display the X-ray image XP received from the electronic cassette 20. A doctor can make a diagnosis based on the X-ray image XP displayed on the display unit 31, but can also input a request to execute CAD processing using the input operation unit 32 in order to narrow down candidates for abnormal shadows, including lesions, from the X-ray image XP.

[0048] The console control unit 38 also creates an image file PF by adding supplementary information, including patient information and imaging conditions, to the X-ray image XP. The console control unit 38 also performs a personal information deletion process to delete personal information from the image file PF based on an instruction sent from the image diagnosis support device 40.

[0049] The communication I / F 36 is wired to the repeater 50 via a communication cable 51 (see FIG. 1). The console control unit 38 transmits a CAD processing request and an image file PF including an X-ray image XP to the image diagnosis support device 40 via the communication I / F 36. It is also possible to wirelessly connect the console 30 to the repeater 50. The console 30 may be, for example, a laptop computer equipped with a battery, or a portable terminal such as a tablet terminal or a smartphone.

[0050] The image diagnosis support device 40 includes, in a housing 41, the above-mentioned power switch 42, first connector 43A, second connector 43B, and third connector 43C, as well as a processor 44, RAM 45, NVM 46, a power supply unit 47, and an internal battery 48. The processor 44 is configured, for example, with a CPU and a GPU (Graphics Processing Unit). The RAM 45 is a work memory for the processor 44 to execute processing. The NVM 46 is a storage device such as a flash memory, and stores a program 90 and a detection model 91. The NVM 46 also stores data such as an image file PF transmitted from the console 30. The NVM 46 is an example of a "memory" according to the technology of the present disclosure.

[0051] The processor 44 loads the program 90 stored in the NVM 46 into the RAM 45 and executes processing in accordance with the program 90, thereby functioning as a communication processing unit 92, a prohibition instruction transmission processing unit 93, and a CAD processing unit 94.

[0052] The communication processing unit 92 controls communication with the console 30 via the first connector 43A or the second connector 43B. Specifically, the communication processing unit 92 receives an image file PF from the console 30 and performs communication processing to transmit information including the CAD processing result to the console 30. The prohibition instruction transmission processing unit 93 performs prohibition instruction transmission processing to transmit to the console 30 an instruction to prohibit the transmission of an image file PF whose incidental information includes personal information unnecessary for CAD processing (hereinafter referred to as a transmission prohibition instruction).

[0053] The CAD processing unit 94 performs CAD processing on the X-ray image XP included in the image file PF using the detection model 91 stored in the NVM 46. The detection model 91 is a trained model that has been trained by machine learning.

[0054] The detection model 91 is configured using a neural network. The detection model 91 is configured using, for example, a deep neural network (DNN), which is a multi-layer neural network that is the subject of deep learning. As the DNN, for example, a convolutional neural network (CNN) that targets images is used.

[0055] The power supply unit 47 supplies the power received from the mobile battery 80 via the third connector 43C to the processor 44, etc. The power supply unit 47 includes, for example, a power supply circuit and a charge control circuit. The power supply circuit regulates the power received from the mobile battery 80 and supplies it to the processor 44, etc. The charge control circuit controls charging of the built-in battery 48 with the power received from the mobile battery 80. The built-in battery 48 is a secondary battery such as a lithium polymer battery.

[0056] Fig. 3 shows an example of a console screen displayed on the display unit 31 of the console 30 by the console control unit 38. The console screen 100 shown in Fig. 3 is displayed on the display unit 31 after X-ray imaging is performed by the X-ray source 10 and electronic cassette 20 and the console 30 receives the X-ray image from the electronic cassette 20. The console screen 100 has an image display area 101 for displaying an X-ray image XP.

[0057] Also displayed on the console screen 100 are an end imaging button 102 for completing imaging, a next imaging button 103 for performing the next imaging, and a CAD processing button 104 for making a CAD processing request. To make a CAD processing request, a doctor or the like presses the CAD processing button 104 by operating the input operation unit 32, for example, a mouse.

[0058] Furthermore, the console control unit 38 stores the X-ray image XP in the NVM 46 as an image file PF in a format conforming to the DICOM (Digital Imaging and Communication in Medicine) standard, for example, as shown in FIG. 4. The image file PF is a file in which the X-ray image XP and the additional information AD are associated with one image ID. The additional information AD includes patient information, reception number, examination area, imaging conditions, etc. Of the additional information AD of the image file PF shown in FIG. 4, items 3 to 9 (patient name, patient ID, sex, date of birth, age, height, and weight) are personal information of the patient. Personal information refers to information specific to the person being diagnosed from whom the medical image was acquired. Personal information is not limited to the information indicated by items 3 to 9.

[0059] 5 shows an example of personal information deletion processing executed by the console control unit 38. In this embodiment, when the console control unit 38 executes personal information deletion processing in response to an instruction from the console 30, it deletes all personal information included in the incidental information AD of the image file PF, thereby generating an image file PF from which the personal information has been deleted.

[0060] In Fig. 5, the console control unit 38 deletes the data of items 3 to 9 corresponding to personal information. Note that the console control unit 38 may add dummy data to items 3 to 9 from which the personal information has been deleted. That is, the personal information may be deleted by replacing it with dummy data. For example, the image file PF from which the personal information has been deleted is a DICOM format file, just like the image file PF before the personal information was deleted.

[0061] 6 conceptually illustrates an example of processing executed by the image diagnosis support device 40. In this embodiment, first, a "CAD processing request" is transmitted from the console 30 to the image diagnosis support device 40. When the communication processing unit 92 receives the CAD processing request from the console 30, it inputs the received CAD processing request to the prohibition instruction transmission processing unit 93. The prohibition instruction transmission processing unit 93 generates "personal information transmission permission information" indicating whether or not transmission of personal information is permitted based on the setting information S, and transmits the generated personal information transmission permission information to the console 30 via the communication processing unit 92.

[0062] The setting information S is data indicating whether or not transmission of an image file PF including personal information is permitted to the console 30, and is stored, for example, in the NVM 46 (see FIG. 2). The setting information S is set in advance by an administrator or the like of the X-ray imaging system 2. When the setting information S indicates that transmission of personal information is not permitted, the prohibition instruction transmission processing unit 93 transmits a transmission prohibition instruction to the console 30 as personal information transmission permission information.

[0063] If the received personal information transmission permission information includes a transmission prohibition instruction, the console control unit 38 of the console 30 transmits the image file PF from which the personal information has been deleted to the image diagnosis support device 40. On the other hand, if the received personal information transmission permission information does not include a transmission prohibition instruction, the console control unit 38 transmits the image file PF from which the personal information has not been deleted to the image diagnosis support device 40.

[0064] When the communication processing unit 92 receives the image file PF from the console 30 , the image file PF is input to the CAD processing unit 94 via the prohibition instruction transmission processing unit 93 .

[0065] The CAD processing unit 94 inputs the X-ray image XP included in the image file PF to the detection model 91. The detection model 91 detects an area including an abnormal shadow from the input X-ray image XP and outputs the detection result R. The detection result R includes position information of the area including the abnormal shadow within the X-ray image XP.

[0066] The CAD processing unit 94 generates a processed X-ray image XPC by performing image processing on the X-ray image XP based on the detection result R. For example, the CAD processing unit 94 generates a processed X-ray image XPC by superimposing a circular mark M that surrounds the abnormal shadow on the X-ray image XP based on the detection result R. The CAD processing unit 94 transmits the processed X-ray image XPC to the console 30 via the communication processing unit 92 as a CAD processing result.

[0067] The CAD processing unit 94 may transmit only information representing the detection result R as the CAD processing result to the console 30. In this case, image processing may be performed on the X-ray image XP based on the detection result R within the console 30.

[0068] FIG. 7 illustrates an example of a learning phase in which the detection model 91 is trained by machine learning. The detection model 91 is trained using training data TD. The training data TD includes X-ray images XP as training images to which a correct answer label L is attached. The X-ray images XP included in the training data TD are sample images including various abnormal shadows. The correct answer label L is, for example, position information of the abnormal shadow within the X-ray image XP.

[0069] In the learning phase, an X-ray image XP is input as a teacher image to the detection model 91. The detection model 91 outputs a detection result R based on the input X-ray image XP. A loss calculation is performed using a loss function based on this detection result R and the correct label L. Then, update settings for various coefficients (weighting coefficients, biases, etc.) of the detection model 91 are performed according to the result of the loss calculation, and the detection model 91 is updated according to the update settings.

[0070] In the learning phase, a series of processes is repeatedly performed, including input of a teacher image to the detection model 91, output of the detection result R from the detection model 91, loss calculation, update setting, and update of the detection model 91. This series of processes is repeated when the detection accuracy reaches a predetermined set level. The detection model 91 whose detection accuracy has thus reached the set level is stored in the NVM 46 and then used by the CAD processing unit 94 in CAD processing, which is the operation phase (also called the inference phase).

[0071] The learning phase is executed, for example, in a computer separate from the image diagnosis support device 40. The detection model 91 generated by the separate computer is transmitted to the image diagnosis support device 40 and stored in the NVM 46. Note that the learning phase may be executed within the image diagnosis support device 40.

[0072] Furthermore, in the learning phase, a detection model 91 may be generated for each examination region (chest, abdomen, etc.). That is, a plurality of detection models 91 generated for each examination region may be stored in the NVM 46. In this case, the CAD processing unit 94 may refer to the examination region included in the supplementary information AD (see FIG. 5) of the image file PF to be subjected to CAD processing, and select a detection model 91 according to the examination region.

[0073] Next, the operation of the X-ray imaging system 2 configured as described above will be described with reference to the flowcharts shown in Fig. 8 and Fig. 9. Fig. 8 shows an example of the processing flow of the X-ray source 10 and the electronic cassette 20. Fig. 9 shows an example of the processing flow of the console 30 and the image diagnosis support device 40.

[0074] Prior to imaging, a user such as a doctor inputs imaging conditions, patient information, and the like into the X-ray source 10 and console 30. Next, the subject H is placed between the X-ray source 10 and the electronic cassette 20. When preparations for imaging are complete, the user operates the irradiation switch 11 to cause the X-ray source 10 to start irradiating X-rays 4.

[0075] The processor 12 of the X-ray source 10 determines whether the user has pressed the exposure switch 11 (step S10). If the processor 12 determines that the exposure switch 11 has been pressed (step S10: YES), it causes the high voltage generator 15 to generate a high voltage, thereby causing the X-ray tube 16 to generate X-rays 4 (step S11). As a result, the X-ray source 10 irradiates the electronic cassette 20 with X-rays 4 via the subject H.

[0076] The processor 21 of the electronic cassette 20 determines whether or not X-ray irradiation has been detected using the automatic X-ray detection function (step S20). If the processor 21 determines that X-ray irradiation has been detected (step S20: YES), the processor 21 causes the X-ray detection panel 22 to generate an X-ray image XP (step S21). Then, the processor 21 transmits the X-ray image XP to the console 30 via the communication I / F 24 (step S22).

[0077] 9, in the console 30, the console control unit 38 determines whether or not an X-ray image XP has been received from the electronic cassette 20 (step S30). If the console control unit 38 determines that the X-ray image XP has been received (step S30: YES), the console control unit 38 displays the X-ray image XP on the console screen 100 (see FIG. 3) (step S31). Next, the console control unit 38 determines whether or not the CAD processing button 104 has been pressed by the user (step S32). If the console control unit 38 determines that the CAD processing button 104 has not been pressed (step S32: NO), the console control unit 38 ends the process.

[0078] On the other hand, if the console control unit 38 determines that the CAD processing button 104 has been pressed (step S32: YES), it transmits a CAD processing request to the image diagnosis support device 40 (step S33). Then, the console control unit 38 receives personal information transmission permission information from the image diagnosis support device 40 (step S34). The console control unit 38 determines whether the received personal information transmission permission information includes a transmission prohibition instruction (step S35).

[0079] When the console control unit 38 determines that the personal information transmission permission information includes a transmission prohibition instruction (step S35: YES), it deletes the personal information from the incidental information AD (step S36) as shown in Fig. 5, and transmits the image file PF from which the personal information has been deleted to the image diagnosis support device 40 (step S37). On the other hand, when the console control unit 38 determines that the personal information transmission permission information does not include a transmission prohibition instruction (step S35: NO), it transmits the image file PF from which the personal information has not been deleted (see Fig. 4) to the image diagnosis support device 40 (step S37).

[0080] Thereafter, the console control unit 38 receives the processed X-ray image XPC (see FIG. 6) from the image diagnosis support device 40 as the CAD processing result (step S38), and of This is displayed on the console screen 100 (step S39).

[0081] In the image diagnosis support device 40, the communication processing unit 92 determines whether or not a CAD processing request has been received from the console 30 (step S40). If the communication processing unit 92 determines that a CAD processing request has been received (step S40: YES), the prohibition instruction transmission processing unit 93 transmits personal information transmission permission information to the console 30 (step S41). Thereafter, the communication processing unit 92 receives the image file PF transmitted from the console 30 in the above-mentioned step S37 (step S42).

[0082] Then, the CAD processing unit 94 performs CAD processing on the X-ray image XP included in the image file PF (step S43). Here, the CAD processing unit 94 performs CAD processing using the detection model 91 to generate a processed X-ray image XPC (see FIG. 6). Then, the communication processing unit 92 transmits the processed X-ray image XPC to the console 30 as a result of the CAD processing (step S44).

[0083] As described above, the X-ray imaging system 2 is portable by the user and includes the image diagnosis support device 40 that can be powered by the mobile battery 80, and therefore can be used to support image diagnosis at the scene of disaster medical care or at home medical care. Help It can be done.

[0084] On the other hand, since the image diagnosis support device 40 is portable, there is a risk of theft. However, the image diagnosis support device 40 is configured to be able to send to the console 30 an instruction to prohibit the transmission of image files PF whose accompanying information includes personal information unnecessary for CAD processing, thereby preventing the leakage of personal information.

[0085] [Variations] Next, a modified example of the first embodiment will be described. This modified example differs from the first embodiment in the processing executed by the image diagnosis support device 40. In this modified example, when an image file PF is received from the console 30, the prohibition instruction transmission processing unit 93 of the image diagnosis support device 40 performs processing to verify whether the image file PF contains personal information unnecessary for CAD processing.

[0086] Fig. 10 is a flowchart showing an example of processing executed by the image diagnosis support device 40 according to a modified example of the first embodiment. The flowchart shown in Fig. 10 is obtained by adding steps S50 to S52 between steps S42 and S43 of the flowchart shown in Fig. 9. Only the differences from the first embodiment will be described below.

[0087] As in the first embodiment, the communication processing unit 92 receives the image file PF transmitted from the console 30 (step S42). Thereafter, in this modification, the prohibition instruction transmission processing unit 93 determines whether the image file PF received by the communication processing unit 92 contains personal information unnecessary for CAD processing (step S50). This personal information is information that is prohibited from transmission by the transmission prohibition instruction included in the personal information transmission permission information transmitted by the prohibition instruction transmission processing unit 93 in step S41.

[0088] If the prohibition instruction transmission processing unit 93 determines that the image file PF does not contain personal information unnecessary for CAD processing (step S50: NO), it causes the CAD processing unit 94 to execute CAD processing (step S43). On the other hand, if the prohibition instruction transmission processing unit 93 determines that the image file PF contains personal information unnecessary for CAD processing (step S50: YES), it discards the image file PF (step S51). Thereafter, the communication processing unit 92 refuses to receive data from the console 30 (i.e., blocks communication) (step S52). This ends the processing.

[0089] In this manner, in this modified example, if the image file PF sent from the console 30 contains personal information unnecessary for CAD processing, the image file PF is discarded and the reception of data from the console 30 is refused, thereby more reliably preventing the leakage of personal information.

[0090] [Second embodiment] Next, the second embodiment will be described. The second embodiment differs from the first embodiment in the processing executed by the console 30 and the image diagnosis support device 40.

[0091] In the first embodiment, the image diagnosis support device 40 transmits personal information transmission availability information to the console 30 before receiving the image file PF from the console 30. In contrast, in the present embodiment, the image diagnosis support device 40 transmits personal information transmission availability information to the console 30 after receiving the image file PF from the console 30.

[0092] Fig. 11 is a flowchart showing an example of processing executed by the console 30 and the image diagnosis support device 40 according to the second embodiment. Steps S60 to S63 are similar to steps S30 to S33 in the flowchart shown in Fig. 9. In this embodiment, the console control unit 38 of the console 30 transmits a CAD processing request to the image diagnosis support device 40 in step S63, and then transmits the image file PF to the image diagnosis support device 40 (step S64).

[0093] In the image diagnosis support device 40, the communication processing unit 92 determines that a CAD processing request has been received (step S70: YES), and then receives the image file PF transmitted from the console 30 (step S71). The prohibition instruction transmission processing unit 93 determines whether the image file PF received by the communication processing unit 92 contains personal information unnecessary for CAD processing (step S72). If the prohibition instruction transmission processing unit 93 determines that the image file PF does not contain personal information unnecessary for CAD processing (step S72: NO), it causes the CAD processing unit 94 to execute CAD processing (step S76).

[0094] On the other hand, if the prohibition instruction transmission processing unit 93 determines that the image file PF contains personal information unnecessary for CAD processing (step S72: YES), it discards the image file PF (step S73). Thereafter, the prohibition instruction transmission processing unit 93 transmits personal information transmission permission information including a transmission prohibition instruction to the console 30 via the communication processing unit 92 (step S74).

[0095] In the console 30, the console control unit 38 determines whether or not personal information transmission permission information has been received from the image diagnosis support device 40 (step S65). If the console control unit 38 determines that personal information transmission permission information has not been received (step S65: NO), it shifts the processing to step S68. On the other hand, if the console control unit 38 determines that personal information transmission permission information has been received (step S65: YES), it deletes the personal information from the incidental information AD of the image file PF (step S66), and transmits the image file PF from which the personal information has been deleted to the image diagnosis support device 40 (step S67).

[0096] In the image diagnosis support device 40, the communication processing unit 92 receives the image file PF transmitted from the console 30 (step S75). Thereafter, the CAD processing unit 94 performs CAD processing on the X-ray image XP included in the image file PF (step S76). Then, the communication processing unit 92 transmits the processed X-ray image XPC as the CAD processing result to the console 30 (step S77).

[0097] In the console 30, the console control unit 38 receives the processed X-ray image XPC (see FIG. 6) from the image diagnosis support device 40 as the CAD processing result (step S68), and outputs the received processed X-ray image XPC of This is displayed on the console screen 100 (step S69).

[0098] [First Modification] Next, a first modified example of the second embodiment will be described. This modified example differs from the second embodiment in the processing executed by the image diagnosis support device 40. In this modified example, similar to the modified example of the first embodiment, when the image diagnosis support device 40 receives an image file PF from the console 30 in step S75 described above, the prohibition instruction transmission processing unit 93 of the image diagnosis support device 40 performs processing to verify whether the image file PF contains personal information unnecessary for CAD processing.

[0099] Fig. 12 is a flowchart showing an example of processing executed by the image diagnosis support device 40 according to the first modified example of the second embodiment. The flowchart shown in Fig. 12 is obtained by adding steps S80 to S82 between steps S75 and S76 of the flowchart shown in Fig. 11. Only the differences from the second embodiment will be described below.

[0100] As in the second embodiment, the communication processing unit 92 receives the image file PF transmitted from the console 30 (step S75). Thereafter, in this modification, the prohibition instruction transmission processing unit 93 determines whether the image file PF received by the communication processing unit 92 includes personal information unnecessary for CAD processing (step S80). This personal information is information that is prohibited from transmission by the transmission prohibition instruction included in the personal information transmission permission information transmitted by the prohibition instruction transmission processing unit 93 in step S74.

[0101] If the prohibition instruction transmission processing unit 93 determines that the image file PF does not contain personal information unnecessary for CAD processing (step S80: NO), it causes the CAD processing unit 94 to execute CAD processing (step S76). On the other hand, if the prohibition instruction transmission processing unit 93 determines that the image file PF contains personal information unnecessary for CAD processing (step S80: YES), it discards the image file PF (step S81). Thereafter, the communication processing unit 92 refuses to receive data from the console 30 (i.e., blocks communication) (step S82). This ends the processing.

[0102] In this manner, in this modified example, if the image file PF sent from the console 30 contains personal information unnecessary for CAD processing, the image file PF is discarded and the reception of data from the console 30 is refused, thereby more reliably preventing the leakage of personal information.

[0103] [Second Modification] Next, a second modified example of the second embodiment will be described. This modified example differs from the second embodiment in the processing executed by the image diagnosis support device 40. In this modified example, the prohibition instruction transmission processing unit 93 of the image diagnosis support device 40 performs processing to verify whether or not personal information is included in the image file PF after the CAD processing unit 94 executes CAD processing.

[0104] Fig. 13 is a flowchart showing an example of processing executed by the image diagnosis support device 40 according to the second modified example of the second embodiment. The flowchart shown in Fig. 13 is obtained by adding steps S90 and S91 between steps S76 and S77 of the flowchart shown in Fig. 11. Only the differences from the second embodiment will be described below.

[0105] As in the second embodiment, the communication processing unit 92 receives the image file PF transmitted from the console 30 (step S75). The CAD processing unit 94 performs CAD processing on the X-ray image XP included in the image file PF (step S76). Thereafter, in this modification, the prohibition instruction transmission processing unit 93 determines whether or not personal information is included in the image file PF received by the communication processing unit 92 (step S90). This personal information is information that is prohibited from transmission by the transmission prohibition instruction included in the personal information transmission permission information transmitted by the prohibition instruction transmission processing unit 93 in step S74.

[0106] If the prohibition instruction transmission processing unit 93 determines that the image file PF does not contain personal information (step S90: NO), it proceeds to step S77. On the other hand, if the prohibition instruction transmission processing unit 93 determines that the image file PF contains personal information (step S90: YES), it discards the image file PF (step S91). Thereafter, the communication processing unit 92 transmits the processed X-ray image XPC to the console 30 as the CAD processing result (step S77).

[0107] In this manner, in this modified example, if the image file PF contains personal information that is not necessary for CAD processing, the image file PF is discarded after CAD processing, thereby more reliably preventing the leakage of personal information.

[0108] [Other variations] In each of the above embodiments, the console control unit 38 deletes all personal information from the additional information AD of the image file PF. However, it is also possible to delete at least the personal information contained in the additional information AD that is not necessary for CAD processing. "Personal information not necessary for CAD processing" refers to personal information other than information that may be used in CAD processing. For example, the console control unit 38 considers that, among the personal information specific to the person being diagnosed, information that identifies the person being diagnosed, such as the patient's name and patient ID, is personal information not necessary for CAD processing.

[0109] Figure 14 shows an example of deleting some of the personal information from the additional information AD of an image file PF. In the example shown in Figure 14, data items other than "date of birth" and "age" are deleted from the personal information. In other words, data items other than "date of birth" and "age" are personal information that is not required for CAD processing.

[0110] For example, suppose that the NVM 46 stores a detection model that supports pediatric diagnosis and a detection model that does not support pediatric diagnosis. The CAD processing unit 94 can determine whether to use the detection model that supports pediatric diagnosis by referring to the "age" included in the additional information AD of the image file PF from which personal information has been deleted. For example, if the age is under 15 years old, the CAD processing unit 94 uses the detection model that supports pediatric diagnosis.

[0111] The prohibition instruction transmission processing unit 93 may determine the personal information to be prohibited from transmission from the incidental information AD of the image file PF by referring to a table in which the personal information to be prohibited from transmission is recorded. This table is stored in, for example, the NVM 46.

[0112] In each of the above embodiments, in the learning phase (see FIG. 7 ) in which the detection model 91 is trained by machine learning, the detection model 91 is trained using training data TD including the X-ray image XP and the correct label L. Furthermore, the detection model 91 may be trained using training data TD including part of personal information (e.g., gender, age, height, weight). In this case, the CAD processing unit 94 inputs part of the personal information to the detection model 91 in addition to the X-ray image XP during CAD processing.

[0113] Although the X-ray source 10 is portable in the above embodiments, the X-ray source 10 may be an X-ray source used in a general X-ray imaging system. In this case, the X-ray source 10 is movably held by, for example, a ceiling-mounted holding device. In a general X-ray imaging system, the electronic cassette 20 is attached to an imaging table for use.

[0114] The X-ray imaging system 2 may also be a so-called mobile medical cart. Furthermore, the X-ray imaging system 2 may also be a mammography device, a CT (Computed Tomography) or the like.

[0115] Furthermore, the technology of the present disclosure is not limited to X-rays, but can also be applied to systems that use other radiation such as gamma rays to image a subject.

[0116] Furthermore, the image diagnosis support device 40 can also be applied to an ultrasound imaging system that generates images using ultrasound. That is, the image diagnosis support device 40 may perform CAD processing on ultrasound images as medical images.

[0117] Furthermore, in each of the above embodiments, the CAD processing unit 94 performs CAD processing using the detection model 91, which is a trained model generated by machine learning, but the method is not limited to machine learning, and software that performs CAD processing by image analysis may be used. Furthermore, in each of the above embodiments, the CAD processing unit 94 detects abnormal shadows by CAD processing, but the CAD processing unit 94 may also detect areas other than abnormal shadows. For example, when performing CAD processing on an ultrasound image, the CAD processing unit 94 may detect blood vessels from the ultrasound image.

[0118] Furthermore, in each of the above embodiments, the X-ray imaging system 2 includes the repeater 50, but the repeater 50 is not essential, and the console 30 may have the function of the repeater.

[0119] In each of the above embodiments, the hardware structure of the processing units that perform various processes, such as the communication processing unit 92, the prohibition instruction transmission processing unit 93, and the CAD processing unit 94, is various processors as shown below.

[0120] Various types of processors include CPUs, programmable logic devices (PLDs), dedicated electrical circuits, etc. As is well known, a CPU is a general-purpose processor that executes software (programs) and functions as various processing units. A PLD is a processor whose circuit configuration can be changed after manufacturing, such as an FPGA (Field Programmable Gate Array). A dedicated electrical circuit is a processor with a circuit configuration designed specifically to execute specific processes, such as an ASIC (Application Specific Integrated Circuit).

[0121] A single processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple processing units may be configured with a single processor. As an example of configuring multiple processing units with one processor, first, there is a form in which one processor is configured by combining one or more CPUs and software, and this processor functions as multiple processing units. Second, there is a form in which a processor is used that realizes the functions of an entire system including multiple processing units with one IC chip, as typified by a system on chip (SoC). In this way, various processing units are configured using one or more of the above-mentioned various processors as a hardware structure.

[0122] Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit made up of a combination of circuit elements such as semiconductor elements.

[0123] The present invention is not limited to the above-described embodiments, and various configurations can be adopted without departing from the spirit of the present invention. Furthermore, the present invention extends to a computer-readable storage medium that non-temporarily stores a program, in addition to the program itself.

Claims

1. An image diagnosis support device having a processor and a memory and portable by a user, The processor: Computer-aided diagnostic processing of medical images; a communication process of receiving an image file including the medical image and supplementary information from an external device, and transmitting information including a result of the computer-aided diagnosis process to the external device; a prohibition instruction transmission process for transmitting to the external device an instruction to prohibit transmission of the image file in which personal information unnecessary for the computer-aided diagnosis process is included in the supplementary information; An image diagnosis support device that performs the following:

2. The processor executes the prohibition instruction transmission process before receiving the image file from the external device. The image diagnosis support device according to claim 1.

3. and after executing the prohibition instruction transmission process, if the image file received from the external device contains personal information unnecessary for the computer-aided diagnostic process, the processor discards the image file. The image diagnosis support device according to claim 2.

4. the processor, after discarding the image file, refuses to receive data from the external device; The image diagnosis support device according to claim 3.

5. the processor executes the prohibition instruction transmission process after receiving the image file from the external device. The image diagnosis support device according to claim 1.

6. the processor discards the image file from the external device when the additional information of the image file includes personal information unnecessary for the computer-aided diagnostic processing, and executes the prohibition instruction transmission processing. The image diagnosis support device according to claim 5.

7. and after executing the prohibition instruction transmission process, if the incidental information of the image file received from the external device includes personal information unnecessary for the computer-aided diagnostic process, the processor refuses to receive data from the external device. The image diagnosis support device according to claim 6.

8. and after executing the prohibition instruction transmission process, if the incidental information of the image file received from the external device includes personal information unnecessary for the computer-aided diagnostic process, the processor discards the image file after performing the computer-aided diagnostic process. The image diagnosis support device according to claim 6.

9. 1. A method for operating an image diagnosis support device that is portable by a user, comprising: The processor: Computer-aided diagnostic processing of medical images; a communication process of receiving an image file including the medical image and supplementary information from an external device, and transmitting information including a result of the computer-aided diagnosis process to the external device; a prohibition instruction transmission process for transmitting to the external device an instruction to prohibit transmission of the image file in which personal information unnecessary for the computer-aided diagnosis process is included in the supplementary information; A method for operating an image diagnosis support device that executes the above.

10. A program for causing a processor to execute processing in an image diagnosis support device that has a processor and a memory and is portable by a user, the program comprising: Computer-aided diagnostic processing of medical images; a communication process of receiving an image file including the medical image and supplementary information from an external device, and transmitting information including a result of the computer-aided diagnosis process to the external device; a prohibition instruction transmission process for transmitting to the external device an instruction to prohibit transmission of the image file in which personal information unnecessary for the computer-aided diagnosis process is included in the supplementary information; A program that causes the processor to execute the above.

Images