Medical support device, its operating method and operating program, and medical support system
The medical support device addresses the challenge of accurately identifying foreign objects in medical images by using a processor to estimate their presence and type based on pre-existing correspondence information, thereby enhancing diagnostic efficiency and reducing medical risks.
Patent Information
- Application Number
- JP2021540938
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-08-19
- Filing Date
- 2020-08-17
- Publication Date
- 2025-05-26
- Estimated Expiration
- 2040-08-17
AI Technical Summary
In medical imaging, accurately determining the presence and type of foreign objects within medical images is crucial to prevent accidents and improve diagnostic efficiency, but existing technologies rely heavily on expert radiologists and are not efficient in distinguishing between foreign objects that require treatment and those that do not.
A medical support device equipped with a processor that acquires medical images, correlates them with pre-existing correspondence information to estimate the presence and type of foreign objects, and controls notifications based on this information to assist medical staff in appropriate decision-making.
The medical support device enhances the ability of medical staff to accurately determine the presence and type of foreign objects in medical images, thereby reducing the risk of medical accidents and improving the efficiency of medical operations.
Smart Images

Figure 0007682792000001 
Figure 0007682792000002 
Figure 0007682792000003
Abstract
Description
Technical Field
[0001] The present invention relates to a medical support device, an operating method and an operating program thereof, and a medical support system.
Background Art
[0002] In the medical field, it is important to prevent accidents that are medical accidents or incidents that may cause medical accidents. One of the factors of incidents or accidents in diagnosis using medical images is the remaining foreign matter during imaging. When there is a foreign object remaining on the subject, a medical image with insufficient image quality that hinders image reading is generated, leading to a decrease in diagnostic ability. In addition, the remaining foreign matter generated during surgery leads to damage to the patient and also causes many problems in medical facilities, such as cause analysis, recurrence prevention measures, or litigation risks, so early detection is necessary.
[0003] As a device for detecting foreign objects existing inside an object including the human body, an X-ray inspection device or the like is disclosed that creates a tomographic image from frame data of a plurality of tomographic planes and detects foreign objects based on the three-dimensional distribution of edge information calculated from the tomographic image (Patent Document 1). In addition, a medical image diagnostic device for detecting a site and presenting warning information or the like when there is a foreign object such as metal in the body is disclosed (Patent Document 2).
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Patent Document 2
Summary of the Invention
Problems to be Solved by the Invention
[0005] In the interpretation of medical images, expertise is required for the radiologist to determine lesions, foreign objects, etc. Also, due to the nature of medical care, it is difficult to use the image interpretation results obtained by image processing on devices, etc. directly as the diagnosis results. Furthermore, even when a foreign object is detected by image interpretation, since there are foreign objects that require treatment and those that do not, it is necessary to further determine the treatment for the foreign object. For example, a magnetic therapy device accidentally left during X-ray imaging needs to be removed and re-imaged. Therefore, it is a foreign object that requires treatment such as removing the foreign object and re-imaging after damaging the original image. Also, in the case of a foreign object image caused by a pacemaker detected in a medical image, since there is no need for removal and re-imaging, it is a foreign object that does not require treatment. Therefore, correctly determining not only the detection of foreign objects but also the type of foreign objects is important for preventing incidents or accidents and improving the efficiency of medical operations.
[0006] An object of the present invention is to provide a medical support device, an operating method and an operating program thereof, and a medical support system that can assist medical staff in appropriately determining the presence or absence of a foreign object image included in a medical image and the type of the foreign object that forms the foreign object image.
Means for Solving the Problems
[0007] The present invention is a medical support device including a processor. The processor acquires a medical image including a subject image, acquires correspondence information in which the medical image is associated in advance with the presence or absence of a foreign object image included in the medical image and the type of the foreign object that forms the foreign object image when there is a foreign object image, generates foreign object estimation information in which the presence or absence of a foreign object image included in the medical image and the type of the foreign object that forms the foreign object image are estimated based on the medical image and the correspondence information, and controls notification based on the foreign object estimation information and the content of the notification is information regarding the type of foreign object thereof.
[0008] It is preferable that the processor acquires correspondence information in which the medical image is associated in advance with the position of the foreign object, and generates foreign object estimation information in which the position of the foreign object is estimated based on the medical image and the correspondence information.
[0009] The processor preferably includes a database that, based on the notification, acquires treatment information regarding the treatment corresponding to the medical image and stores treatment correspondence information associating the medical image with the treatment information.
[0010] The processor preferably controls the notification based on the treatment correspondence information.
[0011] The processor acquires imaging instruction information for acquiring a medical image, and when acquiring again the medical image including the subject image based on the imaging instruction information, preferably controls the notification based on the imaging instruction information and / or the treatment correspondence information regarding the medical image. For the same patient When acquiring again the medical image including the subject image based on the imaging instruction information, preferably controls the notification based on the imaging instruction information and / or the treatment correspondence information regarding the medical image.
[0012] The notification is preferably performed by at least one of image display, sound output, and vibration generation.
[0013] The notification is preferably performed to a person other than the patient having the subject forming the subject image.
[0014] The processor preferably guides the patient having the subject based on the foreign object estimation information.
[0015] The guidance preferably includes the type of the foreign object.
[0016] The processor preferably changes the content of the guidance according to the type of the foreign object.
[0017] The processor preferably generates damage determination information for determining whether the medical image is damaged based on the foreign object estimation information.
[0018] The processor preferably generates imaging instruction information based on the foreign object estimation information.
[0019] Moreover, the present invention is a medical support system including any one of the above medical support devices.
[0020] A small portable terminal having a function of performing notification is provided, and it is preferable that the processor performs notification by the small portable terminal.
[0021] Further, the present invention is a method of operating a medical support device, including an image acquisition step of acquiring a medical image including a subject image, and correspondence information in which the medical image is associated in advance with the presence or absence of a foreign object image included in the medical image and the type of foreign object forming the foreign object image when there is a foreign object image, a correspondence information acquisition step of acquiring the correspondence information, a foreign object estimation information generation step of generating foreign object estimation information for estimating the presence or absence of a foreign object image included in the medical image and the type of foreign object forming the foreign object image when there is a foreign object image based on the medical image and the correspondence information, and a notification control step of controlling notification based on the foreign object estimation information. The content of the notification is information regarding the foreign object. type is information.
[0022] Further, the present invention is an operation program for a medical support device, which is an operation program for causing a computer to function as a medical support device, including an image acquisition step of acquiring a medical image including a subject image, and correspondence information in which the medical image is associated in advance with the presence or absence of a foreign object image included in the medical image and the type of foreign object forming the foreign object image when there is a foreign object image, a correspondence information acquisition step of acquiring the correspondence information, a foreign object estimation information generation step of generating foreign object estimation information for estimating the presence or absence of a foreign object image included in the medical image and the type of foreign object forming the foreign object image when there is a foreign object image based on the medical image and the correspondence information, and a notification control step of controlling notification based on the foreign object estimation information. The content of the notification is information regarding the foreign object. type is information.
Advantages of the Invention
[0023] According to the present invention, it is possible to assist medical staff in appropriately determining the presence or absence of a foreign object image included in a medical image and the type of foreign object forming the foreign object image.
Brief Description of the Drawings
[0024]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Embodiments for Carrying Out the Invention
[0025] The medical support device of the present invention is used in a scenario where medical staff acquire or interpret medical images. Medical staff refers to medical staff involved in medical images, such as radiological technologists who acquire medical images, radiologists who interpret medical images, or nurses or clinical laboratory technologists who are involved in medical images under the instructions of a doctor, etc. The medical support device is installed in an imaging examination room, a consultation room, etc. In this embodiment, it is installed in the operation room of the imaging examination room. The medical support device is, for example, a computer such as a personal computer in which an application program for executing a predetermined function is installed.
[0026] As shown in FIG. 1, the medical support device 10 includes, in addition to an output device 12 such as a display and an input device 13 such as a mouse, a microphone, or a keyboard, a CPU (Central Processing Unit) 14 which is a processor, a memory 15, a storage device 16, and a communication unit 17. These are interconnected via a data bus 18. The communication unit 17 has a function of communicating with other devices or a network 19.
[0027] The storage device 16 is a hard disk drive built into the medical support device 10, or a hard disk drive connected through a cable or a network 19, or a disk array in which a plurality of hard disk drives are installed in series. Therefore, the storage device 16 functions as a storage unit. The storage device 16 stores control programs such as an operating system, various application programs, various data associated with these programs, and databases, etc.
[0028] The memory 15 is a work memory for the CPU 14 to execute processing. The CPU 14 loads the program stored in the storage device 16 into the memory 15 and executes processing according to the program, thereby comprehensively controlling each part of the medical support device 10.
[0029] The medical support device 10 can be connected, via the communication unit 17, to an information management server such as HIS (Hospital Information System) or RIS (Radiology Information System) that registers and manages information such as patient information, medical treatment information, examination information, accounting information, and imaging instructions for diagnostic imaging on a per-patient basis, or to an image server such as PACS (Picture Archiving and Communication System for medical application) that manages, for example, captured medical images and information related to these medical images. When interconnected with these servers, mutual communication of various types of information is performed with these servers. Further, the computer of the medical support device 10 can also be used as a client terminal of these servers. Yes It can also be used as a client terminal of these servers.
[0030] As shown in FIG. 2, in the present embodiment, the medical support device 10 is installed in the operation room 20a of the imaging examination room 20, and is operated by a person in charge of reading medical images, such as a radiologic technologist RT. The imaging examination room 20 includes an operation room 20a and an examination room 20b. In the examination room 20b, for example, an X-ray imaging device 21 is installed, and imaging is performed on the patient PA.
[0031] Examples of the subject for obtaining a medical image include the patient PA1 or the patient PA2 who visit a medical examination. The patient PA1 or the patient PA2 undergo examinations other than imaging examinations in the examination room 30, and then undergo an imaging examination in the imaging examination room 20. Further, examples of the subject for obtaining a medical image include the patient PA3 who has undergone surgery by a doctor DR in the operating room 40 equipped with an operating table 42. The patient PA3 undergoes an imaging examination to confirm the postoperative state by imaging examination. Note that the patient PA is a general term for patients. Therefore, the patient PA includes the patient PA1, the patient PA2, and the patient PA3.
[0032] For example, patient PA1 who undergoes an examination has a pacemaker, which is an implantable device, implanted subcutaneously. This pacemaker is regarded as foreign object 31. Also, patient PA2 who undergoes an examination is having an examination while wearing foreign object 32, which is a metal necklace. Further, patient PA3 who has undergone surgery has had the surgery completed while having gauze, which is foreign object 41, that can be detected by X-rays in the body. Foreign objects 31 and 41 cannot be externally confirmed when acquiring a medical image. Also, foreign object 32 may not be externally confirmed during medical image acquisition depending on the examination gown or the like.
[0033] For patients PA1 having foreign object 31, PA2 having foreign object 32, and PA3 having foreign object 41, in an imaging examination room 20 or the like, for example, imaging by X-rays is performed. The radiologic technologist RT, for patients PA1 having foreign object 31, PA2 having foreign object 32, and PA3 having foreign object 41, in accordance with the imaging instructions shown on the display of the medical support device 10 which also serves as a console of RIS (not shown), uses the X-ray imaging device 21 to acquire respective medical images without noticing foreign objects 31, 32, and 41. The medical images acquired by imaging are displayed by the radiologic technologist RT on the display of the medical support device 10 in order to determine image damage and acquire successful medical images in accordance with the imaging instructions.
[0034] As shown in FIG. 3, in the medical support device 10, the storage device 16 stores an operation program 51. When the operation program 51 is started, the CPU 14, which is a processor, functions as an image acquisition unit 61, a correspondence information acquisition unit 62, a foreign object estimation unit 63, a notification control unit 64, an image damage determination unit 98, a treatment information acquisition unit 101 (see FIG. 12), an imaging instruction information generation unit 99, and an imaging instruction information acquisition unit 105 (see FIG. 12) in cooperation with the memory 15 and the like. Therefore, the medical support device 10 includes an image acquisition unit 61, a correspondence information acquisition unit 62, a foreign object estimation unit 63, a notification control unit 64, an image damage determination unit 98, a treatment information acquisition unit 101, an imaging instruction information generation unit 99, and an imaging instruction information acquisition unit 105 and the like.
[0035] The image acquisition unit 61 acquires the captured medical image. Since the medical image is taken with the patient PA as the subject, it includes a partial or entire body of the patient PA and, in some cases, a subject image with a foreign object as the subject. Therefore, the subject image may include a foreign object image in some cases. The correspondence information acquisition unit 62 acquires correspondence information in which the medical image is associated in advance with the presence or absence of a foreign object image included in the medical image and the type of foreign object that forms the foreign object image when there is a foreign object image. As the correspondence information, for example, that stored in the storage device 16 is used. The foreign object estimation unit 63 acquires the medical image from the image acquisition unit 61 and also acquires the correspondence information from the correspondence information acquisition unit 62. The foreign object estimation unit 63 generates foreign object estimation information for estimating the presence or absence of a foreign object image included in the medical image and the type of foreign object that forms the foreign object image when there is a foreign object image, based on the medical image and the correspondence information. The generated foreign object estimation information is acquired by the notification control unit 64. The notification control unit 64 controls the notification based on the foreign object estimation information acquired from the foreign object estimation unit 63. When performing notification, the output device 12 such as a display is used for notification.
[0036] Next, each part and the like included in the medical support device 10 will be described in detail. First, the medical image acquired by the image acquisition unit 61 is a medical image acquired for diagnosis, examination, or the like, and is an image taken by various modalities. The medical image includes, for example, X-ray images by computed radiography (CR), so-called CT images by computed tomography (CT), mammography images by mammography (MG), and so-called MRI images by magnetic resonance imaging (MRI), mainly images handled by the radiology department. The medical image may be image data that can be processed by a computer.
[0037] Medical images are, in this embodiment, image data conforming to the DICOM (Digital Imaging and Communications in Medicine) standard. To comply with the DICOM standard, which is the standard for medical images, inter-device communication regarding medical images and the information attached to the medical images is possible between devices inside and outside medical facilities that handle medical images. Since the medical support device 10 also serves as the console of the RIS, using the computer that is the medical support device 10, it is possible to transmit and receive medical images and the information attached to the medical images to and from the RIS. For example, the imaging instruction information transmitted to the console by the RIS includes patient information attached thereto, and in accordance with this imaging instruction information, for example, the X-ray image obtained by imaging using the X-ray imaging device 21 includes patient information attached thereto. Therefore, the obtained X-ray image, which is a medical image, is an X-ray image conforming to DICOM with the imaging instruction information and / or patient information attached. In addition to being acquired by the image acquisition unit 61, the obtained X-ray image is sent to the RIS server after imaging. Further, the obtained X-ray image is displayed on the medical support device 10 for the radiologic technologist RT to determine image damage and obtain a successful medical image in accordance with the imaging instruction.
[0038] The correspondence information acquisition unit 62 acquires, in advance, correspondence information associating medical images with the presence or absence of foreign object images included in the medical images. In the case where the medical image has a foreign object image, the correspondence information acquisition unit 62 further acquires correspondence information associating the medical image with the type of foreign object forming the foreign object image. The foreign object forming the foreign object image refers to an object included in the image of the patient PA, etc. in the medical image but not derived from the living body of the patient PA, etc. that is the subject of the medical image. Therefore, for example, lesions, etc. that the patient PA has are not included in the foreign objects. Also, for example, shadows, etc. formed by the imaging device or image processing are not included in the foreign objects.
[0039] Although not derived from the living body of the patient PA or the like who is the subject of imaging, what the patient PA has can be classified into what is inside the patient PA's body and what is outside the body. Among the things inside the body, those that require treatment include, for example, surgical intra-body residual (leftover) foreign objects such as gauze, forceps (pincers), needles, or various plugs, foreign objects such as glass or wood that remained inside the body due to accidents, etc., or foreign objects that should be detected by medical images, for example, when a foreign object is swallowed. Those that do not require treatment are, for example, things implanted inside the patient PA's body for the treatment of the patient PA, etc., when their position, function, etc. are normal, such as pacemakers, artificial joints, stents, or implants made of metal or silicone resin, etc. for fixing bones, etc., and those whose position, function, etc. are normal. However, if the position, function, etc. of these implanted things, etc. are abnormal, they may be regarded as foreign objects that require treatment. Also, among the things that the patient PA has outside the body, those that require treatment include, for example, accessories such as necklaces that the radiographer RT did not notice during imaging, or disposable hot packs, etc. Those that do not require treatment are things whose type of foreign object is clear and does not affect the image reading, for example, clothes that are clear from the shadow.
[0040] The presence or absence of a foreign object image included in a medical image refers to whether an image of a foreign object as described above is included in the medical image. Also, the type of foreign object associated with the medical image may be not only the name of the type of foreign object itself but also information regarding the type of foreign object. The correspondence information is information that associates in advance a medical image with the presence or absence of a foreign object image included in the medical image, or, when the medical image has a foreign object image, information that associates the medical image with the type of foreign object that forms the foreign object image.
[0041] For the medical images used in the correspondence information, and information on whether the medical images have foreign object images, use medical images that were acquired in the past, for which it is known whether they have foreign object images, and when they have foreign object images, the type of foreign object that forms the foreign object image is known. Also, it is possible to use medical images that have not actually been acquired in the past. For example, for images that have not actually been acquired, correspondence information in which an assumed medical image generated by image processing is associated with information on the corresponding foreign object image and the type of foreign object, or correspondence information in which an image obtained by synthesizing actually acquired images is associated with information on the corresponding foreign object image and the type of foreign object, etc. may be used.
[0042] The correspondence information only needs to be one in which a medical image is pre-associated with the presence or absence of a foreign object image included in the medical image and the type of foreign object that forms the foreign object image when there is a foreign object image, and the format, generation method, etc. are not limited. The medical image is, as described above, obtained by various modalities. On the other hand, the presence or absence of a foreign object image is information of "present" or "absent", and the type of foreign object is information regarding the foreign object. Therefore, the correspondence information can take various forms according to these medical images and information regarding foreign objects. For example, correspondence information associating information regarding the medical image with the "present" or "absent" of the foreign object image and the type name of the foreign object may be created in the form of a table.
[0043] Also, a pre-trained model may be used as the correspondence information. Note that a pre-trained model is model data in which learning in machine learning is performed on a plurality of medical images, and the medical image is associated with the presence or absence of a foreign object image included in the medical image and the type of foreign object, with weighting. It is a type of correspondence information. Note that the medical images used in the correspondence information or the types of foreign objects that form foreign object images may be plural. Therefore, for example, information such as the types of a plurality of related foreign objects may be associated with one medical image. Also, treatment correspondence information including information associating a medical image with treatment information, which is information on the result of determination or reading by a medical staff member of the medical image, stored in a database described later may be used as the correspondence information.
[0044] The correspondence information may use a plurality of pieces of correspondence information separately so that preferable foreign object estimation information can be obtained according to various conditions. Therefore, a plurality of tables may be created and used separately according to various conditions, or a plurality of learned models may be created and used separately. For example, according to the age of patient PA, preferable foreign object estimation information may be obtained by separately using a table or a learned model as the correspondence information. Note that the preferable foreign object estimation information means that information such as the presence or absence of a foreign object included in the foreign object estimation information and the type of the foreign object is close to the actual situation, and the most preferable foreign object estimation information is the one that matches the actual situation. Therefore, the medical image and / or the correspondence information for generating the foreign object estimation information are more preferable as the information such as the presence or absence of the foreign object included in the foreign object estimation information or the type of the foreign object matches the actual situation.
[0045] As shown in FIG. 4, the correspondence information 66 is information in which a medical image is associated with the presence or absence of a foreign object image included in the medical image and the type of the foreign object that forms the foreign object image when there is a foreign object image. In the correspondence information 66, the medical image is associated with the presence or absence of the foreign object image and the type of the foreign object, for example, one-to-one. The correspondence information 66 is, for example, information in which "none" is associated as the presence or absence of a foreign object image when the medical image is the medical image 66a. Also, in the case of the medical image 66b, "yes" is associated as the presence or absence of a foreign object image and "metal necklace" is associated as the type of the foreign object. Also, in the case of the medical image 66c different "yes" is associated as the presence or absence of a foreign object image and "implantable device, ABC company model: X-111" is associated as the type of the foreign object. Also, in the case of the medical image 66d different "yes" is associated as the presence or absence of a foreign object image and "foreign object in the esophagus, button-type battery" is associated as the type of the foreign object. Also, in the case of the medical image 66e different "yes" is associated as the presence or absence of a foreign object image and "surgical residual foreign object, gauze" is associated as the type of the foreign object. Note that the medical images 66a, 66b, 66c, and 66d are X-ray images obtained by computed radiography, and the medical image 66e is a CT image obtained by computed tomography.
[0046] The means by which the corresponding information acquisition unit 62 acquires the corresponding information 66 is not limited. For example, the corresponding information 66 is stored in advance in the storage device 16 or another storage device (not shown), and the corresponding information acquisition unit 62 acquires the corresponding information 66 stored in this storage device 16 or another storage device.
[0047] Based on the medical image and the corresponding information 66, the foreign object estimation unit 63 generates foreign object estimation information for estimating the presence or absence of a foreign object image included in the medical image and, if there is a foreign object image, the type of foreign object that forms the foreign object image. As described above, the foreign object estimation unit 63 is connected to the image acquisition unit 61 and receives the medical image acquired by the image acquisition unit 61. Further, the foreign object estimation unit 63 is connected to the corresponding information acquisition unit 62 and receives the corresponding information 66 acquired by the corresponding information acquisition unit 62. The foreign object estimation unit 63 estimates whether the medical image received from the image acquisition unit 61 has a foreign object image based on the medical image received from the image acquisition unit 61 and the corresponding information 66 received from the corresponding information acquisition unit 62, and if it is estimated that there is a foreign object image, generates foreign object estimation information for estimating the type of foreign object that forms the foreign object image. The foreign object estimation information may include not only information related to foreign objects such as foreign object estimation information, but also information related to the medical image including the foreign object, for example, patient data and the like. The foreign object estimation unit 63 automatically generates foreign object estimation information as soon as it receives the medical image, for example, every time it receives a medical image. The types of foreign objects to be estimated are not limited to one, and may include multiple types of foreign objects. Further, when the foreign object estimation unit 63 generates foreign object estimation information, it may be generated after weighting each piece of information of the medical image and / or the corresponding information 66 used.
[0048] As shown in FIG. 5, when generating foreign object estimation information of the medical image 65 received from the image acquisition unit 61, for example, the foreign object estimation unit 63 generates, as foreign object estimation information, foreign object estimation information 67 in which the presence or absence of a foreign object image is "present" and the type of the foreign object is estimated to be "metal necklace" based on the medical image 65 and the correspondence information 66. The foreign object estimation information 67 is sent to the notification control unit 64 and is notified, for example, by being displayed on the display of the medical support device 10, and is notified by a display with the character "estimated" to indicate that it is information on the type of the estimated foreign object and a display with the character "metal necklace" for the type of the estimated foreign object.
[0049] In addition, when the medical image includes a foreign object image, the correspondence information acquisition unit 62 may acquire correspondence information in which the medical image is associated with the position of the foreign object in addition to the type of the foreign object forming the foreign object image. That is, the information on the type of the foreign object may include the position information of the foreign object. The position of the foreign object is position information of the foreign object including the absolute position of the foreign object and / or the relative position of the foreign object. Therefore, the foreign object estimation unit 63 may generate foreign object estimation information in which the position of the foreign object is estimated based on the medical image and the correspondence information in which the position of the foreign object is associated.
[0050] As shown in FIG. 6, the correspondence information 71 is information in which the medical image is associated with the presence or absence of a foreign object image included in the medical image, and when there is a foreign object image, the type and / or position of the foreign object forming the foreign object image. In the correspondence information 71, the medical image, the presence or absence of the foreign object image, and the type and / or position of the foreign object forming the foreign object image are associated one-to-one. For example, in the case of the medical image 66b, the correspondence information 71 has "present" as the presence or absence of the foreign object image, "metal necklace" as the type of the foreign object, and "neck, outside the body" as the position of the foreign object associated therewith. Also, in the case of the medical image 66c different "present" is associated as the presence or absence of the foreign object image, "implantable device, ABC company model: X-111" as the type of the foreign object, and "in front of the left shoulder, directly under the skin" as the position of the foreign object. Also, in the case of the medical image 66d differentThe presence or absence of an object image is associated with "present", the type of foreign object is associated with "foreign object in the esophagus, button battery", and the position of the foreign object is associated with "esophagus, central". Also, in the case of the medical image 66e different The presence or absence of an object image is associated with "present", the type of foreign object is associated with "foreign object remaining after surgery, gauze", and the position of the foreign object is associated with "diaphragm, lower right".
[0051] Based on the medical image and the correspondence information 71, the foreign object estimation unit 63 generates foreign object estimation information that estimates the presence or absence of a foreign object image included in the medical image, and when there is a foreign object image, the type and / or position of the foreign object that forms the foreign object image. The foreign object estimation unit 63 estimates whether the medical image received from the image acquisition unit 61 has a foreign object image based on the medical image received from the image acquisition unit 61 and the correspondence information received from the correspondence information acquisition unit 53. When it is estimated that there is a foreign object image, the foreign object estimation unit 63 generates foreign object estimation information that estimates the type and / or position of the foreign object that forms the foreign object image.
[0052] As shown in FIG. 7, for example, when generating foreign object estimation information for the medical image 65 received from the image acquisition unit 61, the foreign object estimation unit 63 generates, as foreign object estimation information, foreign object estimation information 72 in which the presence or absence of a foreign object image is "present", the type of foreign object is "metal necklace", and the position of the foreign object is "neck, outside the body" based on the medical image 65 and the correspondence information 71. In FIG. 7, the foreign object estimation information 72 shows the mode when it is notified by display. The foreign object estimation information 72 is sent to the notification control unit 64 and is notified, for example, by being displayed on the display of the medical support device 10. To indicate that it is information on the estimated type of foreign object, it is notified by display with the character "estimated", the estimated type of foreign object is displayed with the character "metal necklace", and the estimated position of the foreign object is displayed with the character "neck, outside the body".
[0053] Further, the foreign object estimation unit 63 may assign a degree of fitness to the presence or absence of a foreign object image, and the type and / or position of the foreign object forming the foreign object image, and generate the result of the presence or absence of a foreign object image to which a degree of fitness equal to or higher than a specific value is assigned, and foreign object estimation information estimating the type and / or position of the foreign object. The degree of fitness assigned by the foreign object estimation unit 63 is a numerical value corresponding to the probability that the presence or absence of the estimated foreign object image and the type and / or position of the foreign object match the actual situation when the foreign object estimation unit 63 estimates the foreign object based on the medical image and the correspondence information. The method of assigning the degree of fitness is not limited. For example, the presence or absence of the foreign object image and the type and / or position of the foreign object may be estimated by assigning a degree of fitness thereto by a machine learning technique using a learned model as the correspondence information. Since a degree of fitness is assigned to the presence or absence of the foreign object and the type and / or position of the foreign object forming the foreign object image, foreign object estimation information may be created according to the degree of fitness. For example, foreign object estimation information may be created when the degree of fitness is set to a value equal to or higher than a specific value. The degree of fitness can be arbitrarily set.
[0054] As shown in FIG. 8, for example, the foreign object estimation unit 63 generates an estimated foreign object list 81 estimating the type of the foreign object to which a degree of fitness is assigned based on the medical image 65 received from the image acquisition unit 61 and the correspondence information 66 received from the correspondence information acquisition unit 62. The correspondence information 66 associates the medical image 66f with the presence of a foreign object image being "present" and the type of the foreign object being "foreign object in the esophagus, button battery", and associates the medical image 66g with the presence of a foreign object image being "present" and the type of the foreign object being "clothing, metal button". For example, when generating the foreign object estimation information 82 under the condition that the degree of fitness is a type of inspection of 70% or more, the foreign object estimation information 82 is generated by the "foreign object in the esophagus, button battery" having a degree of fitness of "90%" in the estimated foreign object list 81. Note that, according to the setting, the notification control unit 64 may notify the generation of the estimated foreign object list 81. As the notification, for example, the generated estimated foreign object list 81 may be displayed on the display of the medical support device 10 as a candidate for the estimated foreign object.
[0055] The notification control unit 64 controls the notification based on the foreign object estimation information. The control of the notification means determining matters for executing the notification, such as whether to perform the notification or not, the content of the notification when performing the notification, the number of times of notification when performing the notification, or the destination when performing the notification, and then executing the notification. These matters can be changed by setting. The content of the notification when performing the notification can be information regarding the foreign object, such as the presence or absence of the foreign object, the type of the foreign object, or the position of the foreign object.
[0056] In this embodiment, the notification is made to a radiological technologist RT or the like who determines the damage of the medical image using the medical support device 10. The means of the notification only needs to be able to recognize that the radiological technologist RT has been notified, and the means and the like are not limited. The notification may be by at least one of image display, sound output, and vibration generation. The notification by image display is the display of an image including characters and / or images. For example, in the case of notification by the output device 12 of the medical support device 10, the radiological technologist RT is notified by displaying characters or images on the display. The notification by sound output or the notification by vibration generation means that, for example, when the generated foreign object estimation information includes information that there is a foreign object image, the medical support device 10 uses the output device 12 that emits sound to output sound, or communicates with the medical support device 10 and uses a small portable terminal (not shown) owned by the radiological technologist RT to generate vibration.
[0057] Also, it is preferable that the notification is made to a person other than the patient PA. For example, this is to avoid disturbing the patient PA during imaging by limiting the notification to a person other than the patient PA who is the subject of the X-ray imaging. For example, during imaging, a preliminary imaging is performed to position the subject of the patient PA. If, at that time, the medical support device 10 notifies the radiological technologist RT of the notification based on the foreign object estimation information, the radiological technologist RT can perform the imaging after treating the foreign object based on the foreign object estimation information without disturbing the patient PA. Therefore, for example, in the case of notification by sound output, it may be controlled to output sound using an earphone connected to the medical support device 10 or a small portable terminal that communicates with the medical support device 10.
[0058] The notification can be performed, for example, as follows. For example, as shown in FIG. 9, when the foreign object estimation information 68 has the information "none" as the presence or absence of the estimated foreign object image, the notification control unit 64 determines the notification content as "foreign object estimation information" and the notification display 91 determined by the display in characters of "it seems that there is no foreign object", and performs control to display it on the display of the medical support device 10, for example.
[0059] Also, as shown in FIG. 10, when the foreign object estimation information 69 has the information "yes" as the presence or absence of the estimated foreign object image and has the information "foreign object in the esophagus, button battery" as the type of the estimated foreign object, the notification control unit 64 determines the notification content as "foreign object estimation information", an icon for calling attention, the characters of "it seems that there is a foreign object. Please check.", and the notification display 92 determined by the display by the button 93 described as "details", and performs control to display it on the display of the medical support device 10, for example. By designating and clicking the button 93 described as "details" in the notification display 92 with the cursor 94, the notification display 95 is displayed on the display. The notification display 95 is a display showing detailed information about the foreign object. For example, the notification content is "foreign object estimation information", an icon for calling attention, the characters of "there may be a foreign object in the esophagus, button battery", and the notification display 95 composed of the display by the button 96 shown as "confirm" is displayed on the display of the medical support device 10, for example.
[0060] As described above, the medical support device 10 of the present invention can assist medical staff including a radiological technologist RT or a radiologist in not overlooking foreign object images included in medical images. For example, when acquiring a medical image, even if a foreign object image that the radiological technologist RT does not notice is included in the medical image, foreign object estimation information is generated, and based on the foreign object estimation information, notification controlled by the notification control unit 64 is performed, so that the radiological technologist RT can be assisted in more accurately determining the presence or absence of a foreign object image included in the medical image and the type of foreign object forming the foreign object image. Further, when the foreign object estimation information includes information regarding the position of the foreign object, information regarding the position of the foreign object can be notified to the radiological technologist RT. Therefore, the radiological technologist RT can perform imaging after taking measures against the foreign object by the notification of the medical support device 10. Therefore, the radiological technologist RT can more reliably perform successful imaging in accordance with the imaging instruction and can suppress the situation of re-imaging due to imaging failure.
[0061] Also, for example, when a radiologist reads a medical image, even if a foreign object image that the radiologist does not notice is included in the medical image, for example, notification based on foreign object estimation information including information on the type of foreign object forming the foreign object image is performed, so that the foreign object remaining in the body after surgery can be quickly noticed. Further, for example, it can be used for training a radiologist who is not proficient in reading to determine whether a foreign object image is included in a medical image.
[0062] Note that, as shown in FIG. 11, the medical support device 10 may include a loss-of-image determination unit 98 that generates loss-of-image determination information for determining whether a medical image is damaged (hereinafter referred to as loss-of-image determination) based on foreign object estimation information. The loss-of-image determination unit 98 receives the foreign object estimation information generated by the foreign object estimation unit 63 for the medical image, and generates loss-of-image determination information that is the result of determining whether the medical image is damaged based on this foreign object estimation information. The loss-of-image determination unit 98 has foreign object-loss-of-image correspondence information that associates the type of foreign object with loss of image. Therefore, the loss-of-image determination unit 98 can generate loss-of-image determination information obtained by performing a loss-of-image determination on the medical image based on the type of foreign object, which is information about the foreign object included in the foreign object estimation information, and the foreign object-loss-of-image correspondence information.
[0063] The foreign object-loss-of-image correspondence information is a table that associates the type of foreign object with loss of image and is stored in advance. For example, in a medical image, if the type of foreign object included in the foreign object estimation information is " made of metal necklace", then "treatment required", which indicates loss of image, is associated with this medical image. "Treatment required" means that there is a high possibility of loss of image and treatment such as reimaging is necessary. For a medical image that requires reimaging, it is preferable to notify a radiologic technologist RT or the like. Note that the foreign object-loss-of-image correspondence information may be a learned model by machine learning.
[0064] When the loss-of-image determination unit 98 determines that there is a loss of image, a notification is sent to the person who determines the loss of image, such as a radiologic technologist RT. The notification only needs to be sent to the person who determines the loss of image. For example, the notification is sent by displaying on a display or generating sound, light, vibration, or the like.
[0065] Depending on the type of foreign object, "treatment required" may not be associated. A medical image having a type of foreign object for which "treatment required" is not associated has a low possibility of loss of image and a low necessity for reimaging. Therefore, no loss-of-image determination is made and no notification or the like is performed.
[0066] In addition, it is preferable that the image damage determination unit 98 performs an image damage determination on the foreign object estimation information estimated in consideration of the fitness. That is, in the estimated foreign object list 81, the image damage determination may be performed on the foreign object with the highest fitness, and the image damage determination may not be performed on foreign objects other than the foreign object with the highest fitness.
[0067] Specifically, when the type of the foreign object with the highest fitness in the foreign object estimation information for the medical image includes "metal necklace", the image damage determination unit 98 determines this medical image as "treatment required" based on the foreign object-image damage correspondence information. When the medical image determined as "treatment required" by the image damage determination unit 98 is displayed on the display, the character "treatment required" is also displayed. Therefore, a radiological technologist RT or the like can confirm the medical image and perform an image damage determination after it is indicated as "treatment required" on the display. The result of the image damage determination is sent via the communication unit 17 to a RIS (not shown) or the like on the network 19 to perform settings such as re-photographing settings and photographing menu settings.
[0068] In some cases, the image damage determination may be performed automatically. Performing automatically means that for a medical image for which the image damage determination unit 98 has determined that "treatment is required", the image damage is determined without the need for a radiological technologist RT or the like to perform an image damage determination. In this case, the radiological technologist RT or the like is notified that the image damage has been determined. Also, when the image damage is determined by the image damage determination unit 98, subsequent instructions for re-photographing and the like may be performed in the same manner as the determination of image damage by the radiological technologist RT, and these instructions may also be performed automatically.
[0069] Note that the medical support device may include a treatment information acquisition unit that acquires treatment information regarding the treatment corresponding to the medical image based on the notification, and a database that stores treatment correspondence information associating the medical image with the treatment information. The treatment information is information on the result of the determination or reading of the medical image by medical staff. The treatment information includes, for example, information regarding the treatment corresponding to the medical image, and the information regarding the treatment includes, for example, information regarding the necessity of treatment and the content of the treatment.
[0070] Treatment information is determined by a radiologic technologist RT, a doctor DR, etc. regarding the treatment corresponding to a medical image. For example, when the medical support device notifies that the medical image contains a foreign object image and the radiologic technologist RT confirms the shadow caused by the foreign object in the medical image, the radiologic technologist RT determines the type of the foreign object with reference to the information on the type of the estimated foreign object notified, and determines the treatment for the medical image including the foreign object image. Then, when the radiologic technologist RT determines that the taken medical image is a defective image and decides to remove the foreign object and retake the image, the fact that the diagnosis cannot be made correctly due to the foreign object image and thus it is a defective image, and the fact that the foreign object is a foreign object that requires treatment and the foreign object will be removed during retaking, etc. are determined as treatment information, and the determined content is input into the medical support device as treatment information. On the other hand, when the radiologic technologist RT determines that no retaking is required for the medical image including the foreign object image, the fact that this foreign object image is a foreign object that does not require treatment and the fact that this medical image is not a defective image are determined as treatment information, and the determined content is input into the medical support device as treatment information.
[0071] As shown in FIG. 12, the medical support device 100 includes a treatment information acquisition unit 101. The treatment information acquisition unit 101 acquires treatment information. The treatment information acquired by the treatment information acquisition unit 101 is sent to the database 102. The database 102 stores treatment correspondence information associating the medical image with the treatment information.
[0072] As shown in FIG. 13, the generated treatment response information 111 is information in which treatment information 112 is further associated with information in which the medical image included in the response information is associated with the presence or absence of a foreign object image. The treatment information 112 is, for example, information on the result of examination and determination including the content of processing by the radiologic technologist RT for the medical image 66b that is estimated to have a foreign object image and notified. Therefore, for example, for the medical image 66b in which the presence or absence of a foreign object image is "present", the type of the foreign object is "metal necklace", and the position of the foreign object is estimated to be "neck, outside the body", the treatment information 112 is determined as a result of the radiologic technologist RT's scrutiny. The treatment information 112 in this case is, for example, "abnormal, image damage, re - imaging (necklace removal)", and it is a foreign object that requires treatment. Therefore, as a treatment, the medical image 66b is regarded as having image damage, and the RIS acquires the imaging instruction for re - imaging.
[0073] Also, for example, for the medical image 66c that is estimated to have a foreign object image and notified, for the medical image 66c in which the presence or absence of a foreign object image is "present", the type of the foreign object is "implantable device", etc., and the position of the foreign object is estimated to be "in front of the left shoulder, subcutaneous", the treatment information 112 is determined to be "normal" as a result of the radiologic technologist RT's scrutiny. When the treatment information 112 includes "normal", treatment is not required, the medical image 66c is not regarded as having image damage, and re - imaging is not performed. The RIS also acquires this treatment information 112.
[0074] Note that the treatment information 112 may be information on the result of determination or reading by medical staff for a medical image with reference to the foreign object estimation information, or may be information estimated as the foreign object estimation information. Therefore, the treatment information 112 may include information different from the information estimated by the foreign object estimation information. For example, even for a medical image for which the foreign object estimation information estimates "normal", if the radiologist determines that a foreign object image is recognized, the treatment information 112 includes the information on the result determined by the radiologist. The information on the result determined by the radiologist may include at least one of the presence or absence of a foreign object image, the type of foreign object, and the position of the foreign object. Note that the treatment response information 111 may include information such as patient information included in the imaging instruction information or patient information included in the medical image when acquiring the medical image. Therefore, in FIG. 13, some patient information is also displayed in the treatment information column for the convenience of the radiological technologist RT or the like, but the display method such as which patient information to display can be set as appropriate.
[0075] The medical support device 100 includes a treatment information acquisition unit 101 and a database 102 that stores treatment response information 111 associating a medical image with treatment information, medical image enabling medical staff to make a determination medical image without leaving the determination to the device, and the treatment response information including the content determined by the medical staff can be effectively utilized for various scenarios or applications.
[0076] Note that in some cases, the treatment information acquisition unit 101 may acquire the image damage determination information by the image damage determination unit 98 as treatment information, for example, from the image damage determination unit 98 or via the communication unit 17. In this case, medical image the determination medical image can also be left to the device. In this case, the treatment information acquisition unit 101 acquires the image damage determination information as treatment information, and automatically makes a determination
[0077] Further, the notification control unit 64 may control the notification based on the treatment response information. For example, when the foreign object estimation information sent from the foreign object estimation unit 63 includes information regarding a medical image such as patient data, the notification control unit 64 uses information included in the foreign object estimation information or the like to refer to the treatment response information regarding the medical image from the treatment response information stored in the database, and controls the notification to perform the notification.
[0078] Further, the medical support device 100 may include a shooting instruction information acquisition unit 105 (FIG. 12) that acquires shooting instruction information for acquiring a medical image. When the image acquisition unit 61 acquires again a medical image including a subject image based on the shooting instruction information, the notification control unit 64 may control the notification based on the shooting instruction information and / or the treatment response information regarding the medical image. The shooting instruction information acquisition unit 105 acquires the shooting instruction information from, for example, the RIS. The shooting instruction information is information regarding a shooting instruction transmitted from a doctor or the like to the image examination room 20 or the like. The shooting instruction is managed by the RIS, and the medical support device 10 acquires the shooting instruction information from the mutually communicating RIS. Therefore, the shooting instruction information includes patient information and the like in addition to the information regarding the shooting instruction.
[0079] As shown in FIG. 14, when the shooting instruction information acquisition unit 105 acquires that the shooting of the patient PA2 is to be performed as the shooting instruction information, the notification control unit 64 uses the treatment response information 111 stored in the database 102 based on the patient data of the patient PA2 included in this shooting instruction information, and acquires the treatment information of this patient PA2. The treatment information includes patient data such as the name of the patient PA2 included in the shooting instruction information. Then, for example, based on whether information to be noted such as "abnormal" is included in the treatment information under a specific condition such as within the past one year, the notification control unit 64 controls the notification.
[0080] For example, when the patient PA2 previously obtained a medical image, the medical image was retaken because the patient had worn the foreign object 32, which was a necklace, and information indicating "abnormality" was recorded in the treatment information. Therefore, based on the imaging instruction information and treatment information for imaging the patient PA2, when imaging the same part of the patient PA2 again, before the imaging, the notification control unit 64 controls the notification so as to notify the radiological technologist RT or the like to that effect. Therefore, based on the imaging instruction information and treatment information, the radiological technologist RT or the like can perform the attention WA in advance for a patient who tends to wear a foreign object before imaging, leading to suppression of image damage or retaking.
[0081] On the other hand, for example, when there was a foreign object of a pacemaker in the medical image obtained by the patient PA1 previously and the radiological technologist RT or the like determined that the treatment information indicated normality, when imaging the same part of the patient PA1 again, before the imaging, the notification control unit 64 controls the notification so as to notify the radiological technologist RT or the like to that effect. Therefore, based on the imaging instruction information and treatment information, it is possible to correspond to normal foreign objects in advance, and for example, it is possible to prevent a decrease in work efficiency such as the determination of a medical image due to the foreign object detected by the foreign object estimation unit 63.
[0082] As shown in FIG. 12, the medical support device 100 may include an imaging instruction information generation unit 99, and the imaging instruction information generated by the imaging instruction information generation unit 99 may be sent to the imaging instruction information acquisition unit 105, or similarly, may be sent to an RIS or the like (not shown) via the communication unit 17. The imaging instruction information generation unit 99 generates imaging instruction information based on the foreign object estimation information, the treatment information, and / or the image damage determination information. In some cases, the imaging instruction information generation unit 99 automatically generates the implementation of retaking and details such as the imaging menu, and by sending them to the imaging instruction information acquisition unit 105 or the like, the implementation of retaking and the details of the imaging menu can be automatically set.
[0083] Further, the notification control unit 64 may provide guidance to a patient having a subject based on the foreign object estimation information. The guidance is a notification that needs to be informed to the patient during imaging. The guidance is to notify, in a form recognizable by the patient, the content of requesting the removal of a foreign object that the patient may wear and may cause image degradation based on the foreign object estimation information during imaging. For example, when the foreign object estimation information 82 includes " made of metal necklace", since there is a high possibility of image degradation and it is necessary to remove it without fail, the patient PA is guided by voice. Note that the guidance includes the type of the foreign object, and it is preferable to change the content of the guidance, the means of the guidance, and the number of times of the guidance according to the type of the foreign object or the necessity of removal.
[0084] In the guidance for the patient PA who is the subject of the radiographic imaging, an instruction to remove a foreign object or the like can be used as the content of the guidance. For example, when the foreign object estimation information 82 includes "metal necklace", the notification control unit 64 announces to the patient PA in the examination room 20b "Please remove your necklace", and when the foreign object estimation information includes "metal button", "Please take off your clothes", by voice or image or the like to provide guidance.
[0085] In addition to notifying the radiological technologist RT or the like, it is preferable to provide guidance to the patient, so that the foreign object can be removed more reliably and smooth imaging can be performed.
[0086] Further, the medical support system including the medical support device 10 includes the above-described medical support device 10. Furthermore, as described above, it may include other devices connected to the medical support device 10.
[0087] Next, the operation of the above configuration will be described with reference to the flowchart of FIG. 15. First, the notification control unit 64 acquires shooting instruction information from the shooting instruction information acquisition unit 105 (step ST110). Next, based on the shooting instruction information, the notification control unit 64 selects the treatment response information stored in the database 102 and controls whether to perform notification. When performing notification to display the treatment response information (YES in step ST120), the treatment response information is displayed (step ST130). When controlling not to display the treatment response information (NO in step ST120), the treatment response information is not displayed.
[0088] When the treatment response information is displayed, a radiation technician RT or the like, for example, according to the displayed treatment response information, if there is a foreign object or the like that the patient PA always wears, removes it. Also, for a patient PA having a pacemaker, considering that fact, the image acquisition unit 61 acquires a medical image for which it is desired to estimate whether it has a foreign object image or the like (step ST140). Next, the correspondence information acquisition unit 62 acquires correspondence information in which a medical image determined in advance to have a foreign object image is associated with the fact that the medical image includes a foreign object image and / or the type of foreign object forming the foreign object image determined in advance (step ST150).
[0089] Based on the acquired medical image and the correspondence information, the foreign object estimation unit 63 creates foreign object estimation information for estimating the presence or absence of a foreign object image included in the acquired medical image, as well as the type or position of the foreign object (step ST160). When the foreign object estimation information includes information indicating that there is a foreign object image (YES in step ST170), the notification control unit controls to perform notification (step ST180). On the other hand, when the foreign object estimation information includes information indicating that there is no foreign object image (NO in step ST170), the notification control unit controls not to perform notification.
[0090] Based on the notification, treatment response information 111 is input by a radiological technologist RT or the like (step ST190). Then, the treatment response information 111 is stored in the database 102 (step ST200). As another modification example, a learned model may be recreated using the treatment response information 111, and it may also be a new response information or foreign object estimation unit.
[0091] In the above embodiment, the hardware structure of a processing unit that executes various processes such as the image acquisition unit 61, the correspondence information acquisition unit 62, the foreign object estimation unit 63, the notification control unit 64, the treatment information acquisition unit 10 1 and and the imaging instruction information acquisition unit 105 is various processors as shown below. The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (program) and functions as various processing units, a programmable logic device (PLD) such as an FPGA (Field Programmable Gate Array), which is a processor whose circuit configuration can be changed after manufacture, and a dedicated electric circuit (Graphical Processing Unit: GPU), which is a processor having a circuit configuration designed specifically for executing various processes.
[0092] One processing unit may be composed of one of these various processors, or may be composed of a combination of two or more processors of the same or different types (for example, a plurality of FPGAs, a combination of a CPU and an FPGA, a combination of a GPU and a CPU). Also, a plurality of processing units may be composed of one processor. As an example of configuring a plurality of processing units with one processor, first, as represented by a computer such as a client or a server, one processor is configured by a combination of one or more CPUs and software, and this processor functions as a plurality of processing units. Second, as represented by a System On Chip (SoC), there is a form in which a processor that realizes the functions of an entire system including a plurality of processing units with one IC (Integrated Circuit) chip is used. Thus, various processing units are configured by using one or more of the above various processors as a hardware structure.
[0093] Furthermore, the hardware structure of these various processors is more specifically an electrical circuit (circuitry) in a form that combines circuit elements such as semiconductor elements. Another aspect of the present invention is a medical support device in which a processor acquires a medical image including a subject image, acquires correspondence information in which the medical image is associated in advance with the presence or absence of a foreign object image included in the medical image and the type of foreign object that forms the foreign object image when there is a foreign object image, generates foreign object estimation information for estimating the presence or absence of a foreign object image included in the medical image and the type of foreign object that forms the foreign object image when there is a foreign object image based on the medical image and the correspondence information, and controls notification based on the foreign object estimation information.
[0094] The present invention is not limited to the above embodiments, and it goes without saying that various configurations can be adopted without departing from the gist of the present invention. Furthermore, the present invention extends to a storage medium that stores a program in addition to the program.
Explanation of Reference Numerals
[0095] 10, 100 Medical support device 12 Output device 13 Input device 14 CPUs 15 Memory 16 Storage Device 17 Communication Unit 18 Data Bus 19 Network 20 Image Examination Room 20a Operation Room 20b Examination Room 21 X-ray Imaging Device 30 Diagnosis Room 31, 32, 41 Foreign Objects 40 Operating Room 42 Operating Table 51 Operating Program 61 Image Acquisition Unit 62 Corresponding Information Acquisition Unit 63 Foreign Object Estimation Unit 64 Notification Control Unit 65 Medical Image 66, 71 Corresponding Information 66a, 66b, 66c, 66d, 66e, 66f, 66g Medical Images 67, 72, 82, 68, 69 Foreign Object Estimation Information 81 Estimated Foreign Object List 91, 92, 95 Notification Display 93, 96 Buttons 94 Cursor 98 Copy Damage Judgment Unit 99 Shooting Instruction Information Generation Unit 101 Treatment Information Acquisition Unit 102 Database 105 Shooting Instruction Information Acquisition Unit 111 Treatment Corresponding Information 112 Treatment Information PA, PA1, PA2, PA3 Patients RT Radiologic Technologist DR Doctor WA Warning ST110~ST200 Steps
Claims
1. comprising a processor, wherein the processor, acquires a medical image obtained by imaging and including a subject image, acquires, from a storage device, correspondence information in which a medical image is associated in advance with the presence or absence of a foreign object image included in the medical image, and the type and position of a foreign object that forms the foreign object image when the foreign object image is present, generates foreign object estimation information for estimating the presence or absence of a foreign object image included in the medical image, and the type and position of the foreign object that forms the foreign object image when the foreign object image is present, based on the medical image and the correspondence information, controls notification based on the foreign object estimation information, and the content of the notification is information regarding the type of foreign object, a medical support device.
2. comprising a processor, wherein the processor, acquires a medical image obtained by imaging and including a subject image, acquires, from a storage device, correspondence information in which a medical image is associated in advance with the presence or absence of a foreign object image included in the medical image and the type of foreign object that forms the foreign object image when the foreign object image is present, generates foreign object estimation information for estimating the presence or absence of a foreign object image included in the medical image and the type of foreign object that forms the foreign object image when the foreign object image is present, based on the medical image and the correspondence information, controls notification based on the foreign object estimation information, the content of the notification is information regarding the type of foreign object, wherein the processor acquires treatment information regarding a treatment corresponding to the medical image by user input, and stores treatment correspondence information associating the medical image and the treatment information in a database, a medical support device.
3. The medical support device according to claim 2, wherein the processor controls notification based on the treatment correspondence information stored in the database.
4. The processor acquires imaging instruction information for acquiring the medical image from an information management server, and controls notification based on the imaging instruction information and / or the treatment correspondence information regarding the medical image when acquiring again, for the same patient, the medical image including the subject image based on the imaging instruction information. The medical support device according to claim 3.
5. The medical support device according to any one of claims 1 to 4, wherein the notification is by at least one of image display, sound output, and vibration generation.
6. The medical support device according to any one of claims 1 to 5, wherein the notification is performed to a person other than the patient having the subject forming the subject image.
7. comprising a processor, wherein the processor, Obtain a medical image obtained by imaging and including a subject image, Acquire correspondence information in which a medical image is associated in advance with the presence or absence of a foreign object image included in the medical image and the type of foreign object that forms the foreign object image when there is the foreign object image, from a storage device, Generate foreign object estimation information for estimating the presence or absence of a foreign object image included in the medical image and the type of foreign object that forms the foreign object image when there is the foreign object image, based on the medical image and the correspondence information, Control notification based on the foreign object estimation information, The content of the notification is information regarding the type of foreign object, The processor is a medical support device that provides guidance to a patient having a subject based on the foreign object estimation information.
8. The guidance includes the medical support device according to claim 7 that includes the type of foreign object.
9. The processor is the medical support device according to claim 7 or 8 that changes the content of the guidance according to the type of foreign object.
10. Comprising a processor, The processor, Obtain a medical image obtained by imaging and including a subject image, Acquire correspondence information in which a medical image is associated in advance with the presence or absence of a foreign object image included in the medical image and the type of foreign object that forms the foreign object image when there is the foreign object image, from a storage device, Generate foreign object estimation information for estimating the presence or absence of a foreign object image included in the medical image and the type of foreign object that forms the foreign object image when there is the foreign object image, based on the medical image and the correspondence information, Control notification based on the foreign object estimation information, The content of the notification is information regarding the type of foreign object, The processor is a medical support device that generates image damage determination information for determining whether the medical image is damaged, based on the foreign object estimation information.
11. Comprising a processor, The processor, Obtain a medical image obtained by imaging and including a subject image, Acquire correspondence information in which a medical image is associated in advance with the presence or absence of a foreign object image included in the medical image and the type of foreign object that forms the foreign object image when there is the foreign object image, from a storage device, Generate foreign object estimation information for estimating the presence or absence of a foreign object image included in the medical image and the type of foreign object that forms the foreign object image when there is the foreign object image, based on the medical image and the correspondence information, Control notification based on the foreign object estimation information, The content of the notification is information regarding the type of foreign object, The processor is a medical support device that generates imaging instruction information based on the foreign object estimation information.
12. A medical support system comprising the medical support device according to any one of claims 1 to 11.
13. Comprising a small portable terminal having a function of performing the notification, The medical support system according to claim 12, wherein the processor performs the notification by the small portable terminal.
14. An image acquisition step of acquiring a medical image obtained by imaging and including a subject image, A correspondence information acquisition step of acquiring, from a storage device, correspondence information in which a medical image, the presence or absence of a foreign object image included in the medical image, and the type and position of a foreign object forming the foreign object image when the foreign object image is present are associated in advance, A foreign object estimation information generation step of generating foreign object estimation information for estimating the presence or absence of a foreign object image included in the medical image and the type and position of the foreign object forming the foreign object image when the foreign object image is present, based on the medical image and the correspondence information, A notification control step of controlling the notification based on the foreign object estimation information, Comprising, The operation method of the medical support device, wherein the content of the notification is information regarding the type of the foreign object.
15. An image acquisition step of acquiring a medical image obtained by imaging and including a subject image, A correspondence information acquisition step of acquiring, from a storage device, correspondence information in which a medical image, the presence or absence of a foreign object image included in the medical image, and the type and position of a foreign object forming the foreign object image when the foreign object image is present are associated in advance, A foreign object estimation information generation step of generating foreign object estimation information for estimating the presence or absence of a foreign object image included in the medical image and the type and position of the foreign object forming the foreign object image when the foreign object image is present, based on the medical image and the correspondence information, A notification control step of controlling the notification based on the foreign object estimation information, By causing a computer to execute, causing the computer to function as a medical support device, The operation program of the medical support device, wherein the content of the notification is information regarding the type of the foreign object.
Citation Information
Patent Citations
System and method for estimating extracorporeal blood volume and counting surgically extracted samples
JP2014531570A
Classifier acquisition method, defect classification method, defect classification device, and program
JP2015038441A
Medical image diagnostic device
JP2017202315A
Inspection device and inspection method
JP2018021817A
Radiographic apparatus, radiographic system, radiographic method and program
JP2018130336A