Medical image output device, program, medical image output method and medical image output system
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- KONICA MINOLTA INC
- Filing Date
- 2025-06-17
- Publication Date
- 2026-05-01
AI Technical Summary
Existing medical image processing systems require manual adjustment by radiologists to align and crop images based on subject position and tilt, which is labor-intensive and inefficient.
A medical image output device that utilizes image recognition technology to automatically recognize structures in medical images and adjust rotation, cropping, and positioning based on recognized structures and facility-specific standards.
Reduces the workload of radiologists by automating image adjustments, improving efficiency and consistency in medical image processing.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a medical image output device, a program, a medical image output method, and a medical image output system. [Background technology]
[0002] When taking X-rays, radiologists adjust the images (rotate, crop, center) to make them easier for doctors to interpret. This adjustment requires aligning the image according to in-hospital agreements and the orientation specified by each doctor, but since adjustments must be made for each image, it places a heavy burden on radiologists. In addition, they must be mindful of patient pain and waiting times during imaging, and there are limits to what can be achieved by simply adjusting the position of the radiation field and panel.
[0003] In Patent Document 1, the image cutout position can be selected from a fixed pattern. However, Patent Document 1 assumes that each subject is photographed in a similar position, and is not necessarily suitable for various conditions such as subject position or tilt, which change with each photograph.
[0004] Patent Document 2 also makes it possible to align the crop position with that of previous images, but it also does not deal with subject position or tilt, etc., which change with each image capture.
[0005] However, it was found that there is a need to fine-tune the position and angle of the subject in the image, depending on the rules of each facility.Currently, radiologists have to recognize and position the object in the image, and then adjust the image (rotate, crop, center). [Prior art documents] [Patent documents]
[0006] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-55491 [Patent Document 2] Japanese Patent Application Laid-Open No. 2015-150072 Summary of the Invention [Problem to be solved by the invention]
[0007] However, the techniques described in Patent Documents 1 and 2 trim an image without recognizing the object shown in the image, and are unable to accommodate appropriate cropping positions and rotation angles that vary from shot to shot. In addition, it is necessary to adapt to the most appropriate standards depending on the facility (interviewer), but unless the object displayed in the image can be recognized, it is not possible to respond, so the only way to respond is by a person.
[0008] It is possible to automatically rotate or crop an image, but conventionally, humans have had to determine how to rotate or crop it after recognizing and positioning the object in the image. To automatically rotate an image, it is necessary to identify the part, position, and shape, such as which part is the elbow and what its shape is. In other words, even if you try to rotate or crop an image automatically, it is not clear how to rotate or crop it.
[0009] Therefore, an object of the present invention is to reduce the workload of the photographer by automatically adjusting the image. [Means for solving the problem]
[0010] Incidentally, in recent years, image recognition technology has been developing, and it has become possible to automatically recognize objects in an image and automatically identify target regions, for example. The inventor of the present invention came up with the idea that automatic recognition of an object would enable automatic image adjustment.
[0011] The invention described in claim 1 is a medical image output device having a recognition unit that automatically recognizes structures of a subject in a medical image, an adjustment unit that automatically adjusts the medical image based on the recognized structures, and an output unit that outputs the adjusted medical image.
[0012] The invention described in claim 2 is a medical image output device described in claim 1, wherein the automatic adjustment of the medical image includes at least one of adjusting the rotation angle of the medical image, adjusting the position of the rotation center of the medical image, adjusting the trimming of the medical image, and adjusting the position of the trimming center of the medical image.
[0013] The invention described in claim 3 is the medical image output device described in claim 1, wherein the automatic adjustment of the medical image is adjustment of the rotation angle of the medical image or adjustment of the position of the rotation center of the medical image.
[0014] The invention described in claim 4 is a medical image output device described in any one of claims 1 to 3, wherein the adjustment unit determines an automatic adjustment standard, which is a standard for automatically adjusting the medical image, based on the recognized structure or shooting order information related to the medical image.
[0015] The invention described in claim 5 is a medical image output device described in claim 4, wherein the automatic adjustment criteria for the medical image include at least one of a criteria for adjusting the rotation angle of the medical image, a criteria for adjusting the position of the rotation center of the medical image, a criteria for adjusting the trimming of the medical image, and a criteria for adjusting the position of the trimming center of the medical image.
[0016] The invention described in claim 6 is a medical image output device described in claim 4, wherein the automatic adjustment standard for the medical image is a standard for adjusting the rotation angle of the medical image, or a standard for adjusting the position of the rotation center of the medical image.
[0017] According to a seventh aspect of the present invention, in the medical image output device according to the fourth aspect, the automatic adjustment reference is information indicating a shape of a region to be photographed of a photographing subject or an anatomical region of the region to be photographed.
[0018] The invention described in claim 8 is a medical image output device described in any one of claims 1 to 3, further comprising a storage unit that stores, for each imaging part of the subject, a correspondence between the imaging part of the subject and whether or not to automatically adjust the medical image, and the adjustment unit determines whether or not to perform the automatic adjustment based on the imaging part of the subject, which is the recognized structure, or imaging order information related to the medical image.
[0019] The invention described in claim 9 is a medical image output device described in any one of claims 1 to 3, wherein the automatic adjustment has a plurality of items, and a memory unit is provided that stores, for each imaging part of the subject, a correspondence between the imaging part of the subject and whether or not to perform automatic adjustment for each of the plurality of items, and the adjustment unit determines whether or not to perform automatic adjustment for each of the items based on the imaging part of the subject, which is the recognized structure, or imaging order information related to the medical image.
[0020] The invention described in claim 10 is a medical image output device described in any one of claims 1 to 3, which includes a memory unit that stores, for each imaging part of a subject, an automatic adjustment standard that is a standard for automatically adjusting the medical image, in association with the imaging part of the subject, and the adjustment unit determines the automatic adjustment standard based on the imaging part of the subject that is the recognized structure or imaging order information related to the medical image.
[0021] The invention described in claim 11 is a medical image output device described in any one of claims 1 to 3, wherein the automatic adjustment criteria, which are criteria for automatically adjusting the medical image, have a plurality of items, and the device is provided with a memory unit that stores, for each shooting part of the subject, the shooting part of the subject in association with the automatic adjustment criteria for each of the plurality of items, and the adjustment unit determines the automatic adjustment criteria for each of the items based on the shooting part of the subject, which is the recognized structure, or shooting order information related to the medical image.
[0022] The invention described in claim 12 is the medical image output device described in any one of claims 1 to 3, wherein the medical image is a radiation image.
[0023] The invention described in claim 13 is the medical image output device described in any one of claims 1 to 3, wherein the recognition unit is a trained model obtained by machine learning.
[0024] The invention described in claim 14 is a program for causing a computer to function as a recognition unit that automatically recognizes structures of a subject in a medical image, an adjustment unit that automatically adjusts the medical image based on the recognized structures, and an output unit that outputs the adjusted medical image.
[0025] The invention described in claim 15 is the program described in claim 14, wherein the automatic adjustment of the medical image includes at least one of adjusting the rotation angle of the medical image, adjusting the position of the rotation center of the medical image, adjusting the trimming of the medical image, and adjusting the position of the trimming center of the medical image.
[0026] According to a sixteenth aspect of the present invention, in the program according to the fourteenth aspect, the automatic adjustment of the medical image is adjustment of a rotation angle of the medical image or adjustment of a position of a rotation center of the medical image.
[0027] The invention described in claim 17 is a program described in any one of claims 14 to 16, wherein the adjustment unit determines an automatic adjustment standard, which is a standard for automatically adjusting the medical image, based on the recognized structure or imaging order information related to the medical image.
[0028] The invention described in claim 18 is the program described in claim 17, wherein the automatic adjustment criteria for the medical image include at least one of a criterion for adjusting the rotation angle of the medical image, a criterion for adjusting the position of the rotation center of the medical image, a criterion for adjusting the trimming of the medical image, and a criterion for adjusting the position of the trimming center of the medical image.
[0029] The invention described in claim 19 is the program described in claim 17, wherein the automatic adjustment standard for the medical image is a standard for adjusting the rotation angle of the medical image or a standard for adjusting the position of the rotation center of the medical image.
[0030] In accordance with a twentieth aspect of the present invention, in the program according to the seventeenth aspect, the automatic adjustment reference is information indicating a shape of a region to be imaged of an imaging subject or an anatomical region of the region to be imaged.
[0031] The invention described in claim 21 is the program described in any one of claims 14 to 16, which causes the computer to function as a storage unit that stores, for each imaging part of the subject, a correspondence between the imaging part of the subject and whether or not to automatically adjust the medical image, and the adjustment unit determines whether or not to perform the automatic adjustment based on the imaging part of the subject, which is the recognized structure, or imaging order information related to the medical image.
[0032] The invention described in claim 22 is a program according to any one of claims 14 to 16, wherein the automatic adjustment has a plurality of items, and the computer is made to function as a storage unit that stores, for each imaging region of the imaging subject, an association between the imaging region of the imaging subject and whether or not to perform automatic adjustment of each of the plurality of items, and the adjustment unit determines whether or not to perform automatic adjustment of each of the items based on the imaging region of the imaging subject, which is the recognized structure, or imaging order information related to the medical image.
[0033] The invention described in claim 23 is a program described in any one of claims 14 to 16, which causes the computer to function as a storage unit that stores, for each imaging part of the subject, an automatic adjustment standard that is a standard for automatically adjusting the medical image, in association with the imaging part of the subject, and the adjustment unit determines the automatic adjustment standard based on the imaging part of the subject that is the recognized structure or imaging order information related to the medical image.
[0034] The invention described in claim 24 is a program according to any one of claims 14 to 16, wherein the automatic adjustment criteria, which are criteria for automatically adjusting the medical image, have a plurality of items, and the computer is made to function as a storage unit that stores, for each imaging part of the subject, an association between the imaging part of the subject and the automatic adjustment criteria for each of the plurality of items, and the adjustment unit determines the automatic adjustment criteria for each item based on the imaging part of the subject, which is the recognized structure, or imaging order information related to the medical image.
[0035] The invention described in claim 25 is the program described in any one of claims 14 to 16, wherein the medical image is a radiological image.
[0036] The invention described in claim 26 is the program described in any one of claims 14 to 16, wherein the recognition unit is a trained model obtained by machine learning.
[0037] The invention described in claim 27 is a medical image output method including a recognition step of automatically recognizing structures of a subject in a medical image, an adjustment step of automatically adjusting the medical image based on the recognized structures, and an output step of outputting the adjusted medical image.
[0038] The invention described in claim 28 is a medical image output system having a recognition unit that automatically recognizes structures of a subject in a medical image, an adjustment unit that automatically adjusts the medical image based on the recognized structures, and an output unit that outputs the adjusted medical image. [Effects of the Invention]
[0039] According to the present invention, the workload of the photographer can be reduced by automatically adjusting the image. [Brief explanation of the drawings]
[0040] [Figure 1] 1 is a system configuration diagram of a radiation imaging system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram showing the functional configuration of the console. [Figure 3] FIG. 10 is a diagram illustrating an example of a data configuration of a setting table. [Figure 4] FIG. 10 is a diagram for explaining a method of describing angles on an image. [Figure 5] (a) is an example of a lateral image of an elbow joint, (b) is a diagram showing an automatic rotation reference (pattern A1), and (c) is a diagram showing an automatic rotation reference (pattern A2). [Figure 6] (a) is an example of a frontal chest image, (b) is a diagram showing an automatic trimming standard (pattern B1), and (c) is a diagram showing an automatic trimming standard (pattern B2). [Figure 7] (a) is an example of a lateral image of a knee joint, (b) is a diagram showing an automatic rotation reference (pattern C1), and (c) is a diagram showing an automatic rotation reference (pattern C2). [Figure 8] FIG. 10 is a diagram illustrating automatic adjustment of an output size. [Figure 9] 10 is a flowchart showing a shooting control process executed in the console. [Figure 10] 10 is an example of an examination screen. [Figure 11] 10 is a flowchart illustrating an automatic adjustment process. [Figure 12] 10 is an example of a lateral image of an elbow joint. [Figure 13] 10 is an example of an image after automatic rotation of a lateral image of an elbow joint. [Figure 14] 10 is an example of an image after a trimming frame is moved relative to a rotated image. [Figure 15] 10 is an example of a preview display screen including an automatically adjusted lateral image of an elbow joint. [Figure 16] 10 is an example of a preview display screen including an automatically adjusted frontal chest image. [Figure 17] 10 is an example of an examination screen including a lateral image of an elbow joint automatically adjusted based on pattern A1. [Figure 18]10 is an example of an examination screen including a lateral image of an elbow joint automatically adjusted based on pattern A2. DETAILED DESCRIPTION OF THE INVENTION
[0041] Hereinafter, embodiments of the present invention will be described with reference to the drawings, but the technical scope of the present invention is not limited to the following embodiments and illustrated examples.
[0042] <Configuration of Radiography System> First, a schematic configuration of a radiation imaging system (hereinafter referred to as system 100) as a medical image output system according to this embodiment will be described. FIG. 1 is a diagram showing the system configuration of a system 100. As shown in FIG. 1, the system 100 includes a radiographic imaging device (hereinafter referred to as imaging device 1), a console 2, a radiation generating device (hereinafter referred to as generating device 3), and an image management device 4. The devices 1 to 4 are capable of communicating with each other via a communication network N such as a LAN (Local Area Network), a WAN (Wide Area Network), or the Internet.
[0043] The system 100 may be installed in an imaging room or may be configured to be movable (for example, a medical cart). Furthermore, the system 100 may be capable of communicating with a Hospital Information System (HIS), a Radiology Information System (RIS), and the like, which are not shown.
[0044] The generating device 3 includes a generator 31 , an irradiation instruction switch 32 , and a radiation source 33 . When an irradiation instruction switch 32 is operated, the generator 31 applies a voltage according to preset imaging conditions to a radiation source 33 (tube). When a voltage is applied from the generator 31, the radiation source 33 generates radiation R (for example, X-rays) at a dose corresponding to the applied voltage.
[0045] The generating device 3 generates radiation R in a manner that corresponds to the form of the radiation image to be generated. The form of the radiation image may be a still image, a dynamic image having a plurality of frames, or the like. In the case of a still image, radiation R is irradiated only once per depression of the irradiation instruction switch 32. In the case of dynamic images, each time the irradiation instruction switch 32 is pressed, the irradiation of pulsed radiation R is repeated multiple times per predetermined time (for example, 15 times per second), or the irradiation of radiation R is continued for a predetermined time.
[0046] The imaging device 1 generates digital data of a radiation image showing the imaging region of the subject. The imaging device 1 is a portable FPD (Flat Panel Detector). Specifically, the imaging device 1 includes a sensor substrate, a scanning unit, a readout unit, a control unit, a communication unit, etc. (not shown). The sensor substrate has imaging elements that generate electric charges according to the radiation dose upon receiving radiation R, and switch elements that store and release the electric charges, arranged two-dimensionally (in a matrix). The scanning unit switches each switch element ON / OFF. The readout unit reads out the amount of electric charge released from each pixel as a signal value. The control unit controls each unit and generates a radiographic image from the multiple signal values read out by the readout unit. The communication unit transmits radiographic image data and various signals to other devices (the console 2, the generator 3, the image management device 4, etc.) and receives various information and signals from other devices.
[0047] The imaging device 1 accumulates and releases electric charges and reads out signal values in synchronization with the timing of irradiation of radiation R from the generating device 3. In this way, the imaging device 1 generates image data of a still image (hereinafter referred to as still image data) or image data of a dynamic image (hereinafter referred to as dynamic image data). When still image data is generated, a radiation image is generated only once per depression of the irradiation instruction switch 32. When dynamic image data is generated, the generation of frames constituting a dynamic image is repeated multiple times per predetermined time (for example, 15 times per second) for each depression of the irradiation instruction switch 32.
[0048] The image capturing device 1 may be integrated with the generating device 3.
[0049] The console 2 sets various imaging conditions for at least one of the imaging device 1 and the generating device 3. The console 2 is composed of a PC, a dedicated device, and the like. The imaging conditions include, for example, conditions related to the subject S, conditions related to the irradiation of radiation R, and conditions related to image reading by the imaging device 1. The conditions related to the subject S include the imaging region, imaging direction, physique, etc. The conditions related to the irradiation of radiation R include tube voltage, tube current, irradiation time, current-time product (mAs value), etc. The conditions related to image reading by the imaging device 1 include frame rate, frame interval, pixel size, image size (matrix size), etc.
[0050] The console 2 may automatically set the imaging conditions based on imaging order information acquired from other systems (HIS, RIS, etc.) Alternatively, the console 2 may manually set the imaging conditions based on an operation performed by a user (e.g., a radiographer such as a radiologist) on the operation unit 25 (see FIG. 2).
[0051] The image manager 4 manages the image data generated by the image capture device 1. The image management device 4 is a picture archiving and communication system (PACS), an imaging workstation (IWS), or the like.
[0052] <Detailed console configuration> Next, the configuration of the console 2 will be described in detail. In this embodiment, the functions of the medical image output device according to the present invention are installed in the console 2. Medical image output devices include radiation image display devices, MRI image display devices, and ultrasound image display devices. Radiation image display devices include radiation image capturing devices, consoles for radiation image capturing devices, and radiation image management systems (PACS).
[0053] FIG. 2 is a block diagram showing the functional configuration of the console 2. 2, the console 2 includes a control unit 21, a storage unit 22, a communication unit 23, a display unit 24, and an operation unit 25. The units 21 to 25 are electrically connected via a bus or the like.
[0054] The control unit 21 is configured with a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), and the like. The ROM stores various programs executed by the CPU and parameters required to execute the programs. The CPU reads out various programs stored in the ROM, loads them into the RAM, executes various processes according to the loaded programs, and centrally controls the operation of each part of the console 2.
[0055] The storage unit 22 is configured by a non-volatile memory, a hard disk, or the like. The storage unit 22 also stores image data of radiographic images acquired from other devices (such as the imaging device 1 and the image management device 4).
[0056] The storage unit 22 also stores a trained model M. The trained model M is a machine learning (e.g., deep learning) process for automatically recognizing structures of subjects in medical images. The trained model M is generated by machine learning using image data of radiographic images and structures of subjects in the radiographic images (ground truth labels). When image data of a radiographic image is input, the trained model M performs inference and outputs information about the structure as output data.
[0057] The storage unit 22 also stores imaging order information transmitted from the RIS or the like.
[0058] The communication unit 23 is composed of a communication module and the like. The communication unit 23 transmits and receives various signals and various data to and from other devices (the photographing device 1, the generating device 3, the image management device 4, etc.) connected via the communication network N by wire or wirelessly.
[0059] The display unit 24 is configured by, for example, an LCD (Liquid Crystal Display), an organic EL display, etc. The display unit 24 displays a radiation image or the like in accordance with an image signal received from the control unit 21.
[0060] The operation unit 25 includes a keyboard, a pointing device, a touch panel laminated on the surface of the display unit 24, etc. The keyboard includes cursor keys, numeric input keys, various function keys, etc. The pointing device is, for example, a mouse. The operation unit 25 outputs a control signal to the control unit 21 in accordance with an operation performed by the user.
[0061] The console 2 may not include the display unit 24 and the operation unit 25, and may receive a control signal from an input device provided separately from the console 2, for example, via the communication unit 23. The console 2 may also output an image signal to a display device (monitor) provided separately from the console 2. Furthermore, if the other device (such as the image management device 4) has a display unit and an operation unit, the display unit and operation unit may be shared with the console 2. In other words, the console 2 may receive a control signal from the operation unit of the other device and output an image signal to the display unit of the other device.
[0062] The control unit 21 automatically recognizes the structure of the subject in the medical image. That is, the control unit 21 functions as a recognition unit. Specifically, for example, the control unit 21 analyzes the medical image and recognizes the objects in the image. The control unit 21 (recognition unit) may automatically recognize the structure of the subject in the medical image by image processing such as edge extraction and histogram analysis.
[0063] Medical images include radiological images, MRI images, and ultrasound images. In this embodiment, a case where the medical image is a radiological image will be described. The structure of the subject may include the target part or imaging part of the subject, and may also include a jig or marker for positioning. The structure of the subject is preferably the target part or imaging part of the subject.
[0064] The control unit 21 may automatically recognize structures of subjects in medical images using a trained model M obtained by machine learning. The trained model M includes, for example, an algorithm (program) and trained parameters. The trained model M makes it easy to automatically recognize the structures of subjects in medical images, even if, for example, the joint is an artificial joint or there is a bone defect due to a fracture, etc. As the recognition accuracy improves, the accuracy with which adjusted medical images are correctly output also improves.
[0065] The control unit 21 automatically adjusts the medical image based on the recognized structure, that is, functions as an adjustment unit. Automatic adjustment of medical images includes rotation of medical images and adjustment of display range, which includes cropping.
[0066] The automatic adjustment of the medical image includes at least one of adjusting the rotation angle of the medical image, adjusting the position of the rotation center of the medical image, adjusting the trimming of the medical image, and adjusting the position of the trimming center of the medical image. The trimming adjustment includes adjusting the trimming size and adjusting the trimming position. Adjusting the position of the cropping center refers to adjusting the position of the center in the X-axis direction (e.g., left-right direction, horizontal direction) when cropping a medical image, or adjusting the position of the center in the Y-axis direction (e.g., up-down direction, vertical direction). Adjusting the rotation angle of a medical image includes correcting the tilt of the medical image.
[0067] The control unit 21 (adjustment unit) determines an automatic adjustment standard, which is a standard for automatically adjusting a medical image, based on the recognized structure or imaging order information related to the medical image.
[0068] The automatic adjustment criteria for the medical image include at least one of a criterion for adjusting the rotation angle of the medical image, a criterion for adjusting the position of the rotation center of the medical image, a criterion for adjusting the trimming of the medical image, and a criterion for adjusting the position of the trimming center of the medical image. The criteria for adjusting the rotation angle include, for example, the display mode and shape of the imaging region of the imaging subject when the medical image is rotated, and the display mode and shape that serve as a model for adjusting the rotation angle.
[0069] The automatic adjustment criteria is information indicating the shape of the imaging region of the imaging subject or the anatomical location of the imaging region, and may also include information indicating the final display mode that serves as a basis for rotating or cropping the medical image. For example, if a predetermined rotation angle pattern (such as patterns A1 and A2 described later) is selected in the item of the standard for rotation of the medical image, the medical image is rotated so as to be displayed in the state of the rotation angle pattern, and the display image is determined. Also, for example, if the vertebral body center is selected in the item of the standard for trimming the medical image (X-axis direction), the medical image is trimmed so that the vertebral body is positioned at the center, and the display image is determined.
[0070] The storage unit 22 stores, for each imaging region of the imaging subject, whether to automatically adjust the medical image in association with the imaging region of the imaging subject. That is, the storage unit 22 stores whether to automatically adjust the medical image in association with the imaging region of the medical image. For example, when automatic adjustment is set, it is possible to further set whether to adjust rotation or trimming. In some cases, whether to automatically adjust is stored in association with each imaging region, and in other cases, whether to automatically adjust is stored in association with information on the imaging region and imaging direction.
[0071] The automatic adjustment of medical images may have multiple items. In this case, the storage unit 22 stores, for each imaging region of the imaging subject, the imaging region of the imaging subject and whether or not to perform automatic adjustment for each of the multiple items in association with each other.
[0072] The control unit 21 (adjustment unit) refers to the correspondence (photographing area - whether to perform automatic adjustment) stored in the memory unit 22, and determines whether to perform automatic adjustment based on the photographing area of the photographing target, which is a recognized structure, or the photographing order information related to the medical image.
[0073] When the automatic adjustment of a medical image has multiple items, the control unit 21 (adjustment unit) refers to the correspondence stored in the memory unit 22 and determines whether or not to automatically adjust each item based on the imaging part of the imaging subject, which is the recognized structure, or the imaging order information related to the medical image.
[0074] The storage unit 22 stores, for each imaging region of the imaging subject, an automatic adjustment standard, which is a standard for automatically adjusting a medical image, in association with the imaging region of the imaging subject. In other words, the storage unit 22 stores the automatic adjustment standard for the medical image in association with the imaging region of the medical image.
[0075] The automatic adjustment standard may include a plurality of items. In this case, the storage unit 22 stores, for each imaging region of the imaging target, the imaging region and the automatic adjustment standard for each of the plurality of items in association with each other.
[0076] The control unit 21 (adjustment unit) refers to the correspondence relationship (photographing area-automatic adjustment standard) stored in the memory unit 22, and determines the automatic adjustment standard based on the photographing area of the photographing target, which is the recognized structure, or the photographing order information related to the medical image.
[0077] When the automatic adjustment criteria have multiple items, the control unit 21 (adjustment unit) refers to the correspondence stored in the memory unit 22 and determines the automatic adjustment criteria for each item based on the imaging part of the imaging target, which is the recognized structure, or the imaging order information related to the medical image.
[0078] In one embodiment, the medical image output device includes a display unit that displays the automatically adjusted medical image. The display unit 24 of the console 2 is one embodiment of an output unit that outputs the adjusted medical image. In another embodiment, the medical image output device may include a storage unit that stores the automatically adjusted medical image and a display unit that displays the stored medical image. In this embodiment, the adjusted image is first saved and then displayed. In another embodiment, the medical image output device may include a storage unit that stores information on the angle and position of the automatic adjustment, and a display unit that displays a display image based on the information on the angle and position of the automatic adjustment. This embodiment is a pattern in which the information on the angle and position of the adjustment is saved and adjusted at the timing of display. In another embodiment, the medical image output device may be provided with an output unit that outputs at least one of the automatically adjusted medical image, the automatically adjusted and stored medical image, and the automatically adjusted angle and position information to another device.
[0079] The storage unit 22 stores a setting table 221. In the setting table 221, whether or not to automatically adjust medical images and the automatic adjustment standard for medical images are set for each imaging region. The setting table 221 can be set, for example, for each medical facility that uses the system 100. The setting table 221 may also be set for each user (a medical professional such as a doctor) or for each group to which a user belongs.
[0080] FIG. 3 shows an example of the data configuration of the setting table 221. As shown in FIG. 3, the ON / OFF of the automatic trimming function, the automatic trimming standard, the ON / OFF of the automatic rotation function, and the automatic rotation standard are associated with each imaging region. Here, the imaging region also includes the imaging direction.
[0081] The ON / OFF of the automatic trimming function is information indicating whether or not automatic adjustments regarding the trimming of medical images are to be made. "ON" is set when automatic trimming adjustments are to be made, and "OFF" is set when automatic trimming adjustments are not to be made. Note that trimming adjustments are not limited to removing parts outside a specified range of a medical image, but also include adjustments to the display range and display position of a medical image.
[0082] The automatic trimming criterion is an automatic adjustment criterion for trimming a medical image. The automatic trimming criterion includes, for example, the center position of the trimming (X-axis direction, Y-axis direction). Only one of the two directions (X-axis direction, Y-axis direction) may be specified as the center position of the trimming. Furthermore, the automatic trimming criterion may specify a positional relationship such that a predetermined structure is included in the medical image. For example, for the imaging region "front of the abdomen," a positional relationship such as "it's OK if the diaphragm is included at the top" may be specified as the automatic trimming criterion in the Y-axis direction.
[0083] The ON / OFF of the automatic rotation function is information indicating whether or not to perform automatic adjustments regarding the rotation of medical images. "ON" is set when automatic adjustments regarding rotation are performed, and "OFF" is set when automatic adjustments regarding rotation are not performed.
[0084] The automatic rotation reference is an automatic adjustment reference for the rotation of a medical image. The automatic rotation reference includes, for example, the rotation center position (X-axis direction, Y-axis direction) and a rotation angle pattern. The rotation center position is the position of the rotation axis when rotating a medical image. The rotation angle pattern is, for example, information indicating the desired positional relationship in which the image is displayed (target rotation state).
[0085] For example, in the setting table 221 shown in FIG. 3, for the imaging area "front chest," the trimming center in the X-axis direction (left-right direction) is set to "the center of the vertebral body (spine)," and the center in the Y-axis direction (up-down direction) is set to "between the sixth and seventh thoracic vertebrae." However, there is also a policy of not adjusting the position in the Y-axis direction so that the entire subject can be confirmed. Therefore, it may be possible to separately set ON / OFF for cropping (centering) in the Y-axis direction. Furthermore, for the imaging region "front of the chest," the rotation function is generally not used because it would make it difficult to determine the degree of curvature of the spine.
[0086] Regarding the automatic adjustment standard, if there are generally multiple patterns (standards) for the same imaging region, pattern options (candidates) are presented to the user when setting the standard, allowing the user to select from the options.
[0087] <Example of automatic adjustment> As an example of automatic adjustment, automatic rotation and automatic trimming of an "elbow joint lateral image" will be described. In the following explanation of angles on an image, as shown in FIG. 4, the positive direction of the X-axis is set to 0 degrees with the origin of the XY plane as the center, and angles are measured counterclockwise.
[0088] FIG. 5(a) shows an example of a side image 50 of an elbow joint. The lateral image 50 of the elbow joint shows the humerus 51, forearm bones 52 (ulna and radius), and the joint movable part on the humerus side (humeral trochlea 53). The lateral image 50 of the elbow joint is adjusted so that the humerus 51 and forearm bones 52 are at a predetermined angle around the humeral trochlea 53. There are at least two patterns for the rotation angle. For the right arm, as shown in Figure 5(b), the rotation angle when the elbow joint is bent approximately 90 degrees and the humerus direction D1 is oriented at 45 degrees and the forearm direction D2 is oriented at 315 degrees is defined as "Pattern A1." For the left arm, "Pattern A1" is a state in which the humerus direction D1 is oriented at 135 degrees and the forearm direction D2 is oriented at 225 degrees. 5(c), for the right arm, the rotation angle when the elbow joint is bent approximately 90 degrees, with the humerus direction D1 oriented 90 degrees and the forearm direction D2 oriented 0 degrees, is defined as "Pattern A2." For the left arm, "Pattern A2" is a state in which the humerus direction D1 is oriented 90 degrees and the forearm direction D2 is oriented 180 degrees. The basis for rotation can be changed in advance by setting. The image position is also adjusted so that the trochlea 53 of the humerus is at the center of the image.
[0089] An automatic adjustment method for the "side image of the elbow joint" will be described. (1) In the lateral image 50 of the elbow joint, the position of the center of the recognized trochlea 53 of the humerus (center of rotation of the image) is calculated. (2) The angular directions of the humerus 51 and forearm 52 with this center of rotation as the origin are calculated. (3) The bisector L1 of the angle between the humerus direction D1 and the forearm direction D2 is found (see Figures 5(b) and 5(c)). (4) When "Pattern A1" is set as the automatic rotation reference, the image is rotated so that the bisector L1 faces in the 0-degree direction relative to the "side image of the elbow joint" of the right arm, as shown in Figure 5(b). When "Pattern A2" is set as the automatic rotation reference, the image is rotated so that the bisector L1 faces in the 45-degree direction relative to the "side image of the elbow joint" of the right arm, as shown in Figure 5(c). In the "side image of elbow joint," if the angle at which the elbow joint is bent is not approximately 90 degrees, the image is rotated so that only the humerus direction D1 is oriented at 90 degrees.
[0090] Next, automatic trimming for a "frontal chest image" will be described. FIG. 6(a) shows an example of a frontal chest image 60. The front chest image 60 shows lung fields, vertebral bodies, etc. The position of the front chest image 60 is adjusted so that the center of the lung fields in the left-right direction (vertebral bodies) is the center of the image in the left-right direction (X-axis direction). The up-down direction (Y-axis direction) of the front chest image 60 may not be adjusted, the position of the apex of the lung (the upper end of the lung field) may be adjusted, or the position of a predetermined structure may be set as the center of the image. As shown in FIG. 6(b), the state in which the image is trimmed so that the center L2 of the lung field in the left-right direction is at the center of the image in the left-right direction is called "pattern B1." As shown in Figure 6(c), the state in which the image is trimmed so that the center L2 of the lung field in the horizontal direction is the center of the image in the horizontal direction, and the apex of the lung is a predetermined value L3 (e.g., a certain number of cm) from the top of the image area is called "Pattern B2". Although not shown, the position of the predetermined structure may be adjusted so that, for example, the space between the sixth and seventh thoracic vertebrae is at the center of the image in the vertical direction. The position of the image is adjusted in the left-right and up-down directions based on the set criteria.
[0091] An automatic adjustment method for a "frontal chest image" will be described. (1) As shown in FIG. 6(a), in a frontal chest image 60, a rectangular region 61 surrounding the recognized lung field is detected as a region of interest (ROI). (2) The position of the image is adjusted so that the center L2 in the horizontal direction of the rectangular area 61 becomes the center in the horizontal direction of the image (see FIGS. 6(b) and 6(c)). (3) When the position of the apex of the lung is specified in the vertical direction, the upper end of the rectangular area 61 is adjusted so as to be a predetermined distance L3 from the upper end of the image area, as shown in FIG. 6(c).
[0092] It is assumed here that the center L2 of the lung field in the left-right direction (the center of the rectangular region 61) coincides with the center of the vertebral body. The center position of the vertebral body may be obtained by automatically recognizing the vertebral body from the frontal chest image 60.
[0093] Next, automatic rotation and automatic trimming of the "side image of the knee joint" will be described. FIG. 7(a) shows an example of a side image 70 of a knee joint. The lateral knee joint image 70 shows a femur 71, a tibia 72 (tibia and fibula), and a femoral condyle. The lateral knee joint image 70 is adjusted so that the femur 71 and the tibia 72 form a predetermined angle around a femoral condyle center 73. Here, the femoral condyle center 73 is used as the "center of the knee joint" that is the center of rotation. There are at least two patterns for the rotation angle. As shown in FIG. 7(b), the rotation angle in which the lower leg bone direction D4 is turned in the 270 degree direction (downward) is defined as "pattern C1." 7(c), for the right knee, the rotation angle in which the bisector L4 of the angle between the thighbone direction D3 and the tibia direction D4 is oriented in the 0 degree direction is defined as "Pattern C2." For the left knee, "Pattern C2" is the state in which the bisector L4 of the angle between the thighbone direction D3 and the tibia direction D4 is oriented in the 180 degree direction. The basis for rotation can be changed in advance by setting. The image position is also adjusted so that the femoral condyle center 73 is at the center of the image.
[0094] An automatic adjustment method for the "side image of the knee joint" will be described. (1) In the lateral image 70 of the knee joint, the position of the recognized femoral condyle center 73 (center of rotation of the image) is calculated. (2) The angular directions of the femur 71 and the tibia 72 are calculated with this rotation center as the origin. (3) When "Pattern C2" is set as the automatic rotation reference, the bisector L4 of the angle between the thighbone direction D3 and the tibia direction D4 is found. (4) When "Pattern C1" is set as the automatic rotation reference, the image is rotated so that the lower leg bone direction D4 faces 270 degrees relative to the "lateral image of the knee joint," as shown in FIG. 7(b). When "Pattern C2" is set as the automatic rotation reference, the image is rotated so that the bisector L4 faces 0 degrees relative to the "lateral image of the knee joint" of the right knee, as shown in FIG. 7(c). When "Pattern C2" is set as the automatic rotation reference, the image is rotated so that the bisector L4 faces 180 degrees relative to the "lateral image of the knee joint" of the left knee.
[0095] Furthermore, in the automatic trimming adjustment, if the ROI recognized from the medical image is larger than the output size of the image, the output size may be automatically changed. For example, as shown in Fig. 8(a), assume that an ROI 81 is recognized from the entire medical image 80. The output size 82 is large (14 x 14 inches), while the height of the ROI 81 is 15 inches. In this case, as shown in Fig. 8(b), the height of the output size 82 is automatically changed to 15 inches or more.
[0096] <Console operation> Next, the operation of the console 2 will be described. 9 is a flowchart showing the shooting control process executed in the console 2. The shooting control process is executed by the CPU of the control unit 21 in cooperation with a program stored in the ROM.
[0097] First, the control unit 21 receives the selection of radiography order information for radiography to be performed (radiography region, radiography direction) through an operation on the operation unit 25 (step S1).
[0098] 10 shows an example of an examination screen 241 displayed on the display unit 24. The examination screen 241 is provided with an imaging selection area 241A, a setting area 241B, an image display area 241C, an output button 241D, and the like. The imaging selection area 241A displays the details of each imaging (portion to be imaged, imaging direction, etc.) corresponding to each piece of imaging order information. The setting area 241B is an area for setting image reading conditions and image processing conditions for photography. The captured radiographic image is displayed in the image display area 241C. At the stage of step S1, the radiographic image is not yet displayed in the image display area 241C. The output button 241D is a button for issuing an instruction to output a radiation image.
[0099] The user (radiographer such as a radiologist) operates the operation unit 25 to select any one of the pieces of imaging order information in the imaging selection area 241A on the examination screen 241.
[0100] Next, the control unit 21 sets the imaging conditions in the imaging device 1 and the generating device 3 (step S2). For example, the control unit 21 automatically sets the imaging conditions in the imaging device 1 and the generating device 3 based on the selected imaging order information. Alternatively, the control unit 21 may set the imaging conditions for the imaging to be performed in the imaging device 1 and the generating device 3 in response to an operation by the user from the operation unit 25 on the examination screen 241.
[0101] Next, the user places the subject S between the radiation source 33 of the generating device 3 and the imaging device 1, and performs positioning. When the user operates the irradiation instruction switch 32, the radiation generator 3 irradiates the region of the subject S to be imaged with the radiation R. The imaging device 1 generates a radiation image (still image, dynamic image) showing the imaging region at the timing when it receives radiation R from the generating device 3. The imaging device 1 transmits image data of the radiation image (still image data, dynamic image data) to the console 2.
[0102] The control unit 21 of the console 2 acquires image data of the radiographic image generated by imaging via the communication unit 23 (step S3).
[0103] Next, the control unit 21 analyzes the image data of the radiographic image and automatically recognizes the structures of the subject in the radiographic image (step S4). For example, the control unit 21 reads out the trained model M and automatically recognizes the structures in the radiographic image. The control unit 21 inputs the image data of the received radiographic image into the trained model M, and causes it to perform inference, thereby outputting the recognition result of the structures. The trained model M outputs, as the structure recognition results, for example, the imaging area, imaging direction, bone names and positions, organ names and positions, etc.
[0104] Next, the control unit 21 performs an automatic adjustment process on the radiographic image based on the recognized structure (step S5). Now, the automatic adjustment process will be described with reference to FIG.
[0105] The control unit 21 refers to the setting table 221 stored in the storage unit 22 and determines whether or not the automatic rotation function corresponding to the imaging region of the radiographic image is ON (step S11). The imaging region of the radiographic image may be information automatically recognized from the radiographic image in step S4, or may be information included in the radiography order information selected in step S1.
[0106] If the automatic rotation function corresponding to the imaging region of the radiographic image is ON (step S11; YES), the control unit 21 acquires the automatic rotation reference corresponding to the imaging region of the radiographic image from the setting table 221 (step S12). The automatic rotation reference includes the rotation center and rotation angle pattern of the image.
[0107] Next, the control unit 21 calculates the position within the radiographic image around which the image will be rotated (rotation center position) based on the rotation center included in the automatic rotation reference and the structure recognized within the radiographic image (step S13).
[0108] Next, the control unit 21 calculates the amount of rotation of the image so that the radiographic image conforms to the automatic rotation standard (step S14). For example, the control unit 21 calculates the amount of rotation to position the radiographic image in accordance with the rotation angle pattern based on the rotation angle pattern included in the automatic rotation standard and the structure recognized from within the radiographic image.
[0109] Next, the control unit 21 rotates the radiographic image by the calculated rotation amount around the rotation center position (step S15).
[0110] After step S15, or in step S11, if the automatic rotation function corresponding to the imaging region of the radiographic image is not ON (step S11; NO), the process proceeds to step S16.
[0111] In step S16, the control unit 21 determines whether or not the automatic trimming function corresponding to the imaging region of the radiographic image is ON.
[0112] If the automatic trimming function corresponding to the imaging region of the radiographic image is ON (step S16; YES), the control unit 21 acquires the automatic trimming standard corresponding to the imaging region of the radiographic image from the setting table 221 (step S17).
[0113] Next, the control unit 21 calculates the position in the radiographic image to be used as the center for trimming (trimming center position) based on the trimming center included in the automatic trimming criteria and the structure recognized from within the radiographic image (step S18).
[0114] Next, the control unit 21 calculates the shift amount and the trimming size of the image so that the radiographic image conforms to the automatic trimming standard (step S19). For example, the control unit 21 calculates the shift amount and the trimming size for arranging the radiographic image in accordance with the automatic trimming standard based on the automatic trimming standard and the structure recognized from within the radiographic image.
[0115] Next, the control unit 21 adjusts the trimming position of the radiographic image (step S20). The control unit 21 adjusts the trimming position in accordance with the trimming center position, the shift amount, and the trimming size.
[0116] After step S20, or in step S16, if the automatic trimming function corresponding to the imaging region of the radiographic image is not ON (step S16; NO), the automatic adjustment process ends.
[0117] Here, a specific example of automatic recognition and automatic adjustment of a structure will be described with reference to FIGS. 12 is the processing target, the control unit 21 recognizes the humerus 51, forearm bones 52, humeral trochlea 53, etc. from the elbow joint lateral image 50 in step S4. Furthermore, based on the humerus 51, forearm bones 52, humeral trochlea 53, etc. recognized in the image, the control unit 21 recognizes that the photographed site of the elbow joint lateral image 50 is the "lateral side of the elbow joint" of the "right arm."
[0118] Here, in the setting table 221, for the imaging area "lateral side of elbow joint", the automatic rotation function is set to "ON", the rotation center in the X-axis and Y-axis directions is set to "center of the trochlear of the humerus", and the rotation angle pattern is set to "Pattern A1 (see Figure 5(b))". Also, in the setting table 221, the automatic trimming function is set to "ON" for the imaging region "lateral surface of elbow joint", and the trimming center in the X-axis and Y-axis directions is set to "center of the trochlea of the humerus".
[0119] In step S15, the control unit 21 rotates the elbow joint lateral image 50 around the humerus trochlea 53 so that the bisector L1 of the angle between the humerus direction and the forearm direction points in the 0 degree direction, as shown in Figure 13, to obtain the rotated image 50A. In step S20, the control unit 21 moves the trimming frame 50B in the rotated image 50A so that the center of the trimming frame 50B coincides with the trochlea 53 of the humerus, as shown in FIG.
[0120] After the automatic adjustment process, returning to FIG. 9, the control unit 21 displays a preview of the automatically adjusted radiographic image on the display unit 24 (step S6).
[0121] 15 shows an example of a preview display screen 242 displayed on the display unit 24. The preview display screen 242 is displayed superimposed on the examination screen 241. An automatically adjusted lateral image of the elbow joint is displayed on the preview display screen 242. Specifically, the preview display screen 242 displays an automatically rotated lateral image of the elbow joint to fit the pattern A1 (see FIG. 5(b)) and automatically cropped so that the center of the trochlea of the humerus is the center of the image.
[0122] 16 shows an example of another preview display screen 243 displayed on the display unit 24. The preview display screen 243 is displayed superimposed on the examination screen 241. The preview display screen 243 displays an automatically adjusted frontal chest image (chest in an upright position). In the setting table 221, for the imaging area "front chest", the automatic trimming function is set to "ON", the trimming center in the X-axis direction is set to "center of vertebral body", and the trimming center in the Y-axis direction is set to "none". Also, in the setting table 221, the automatic rotation function is set to "OFF" for the imaging region "front chest." The preview display screen 243 displays a frontal chest image that has been automatically cropped so that the center of the vertebral body (the center L2 of the lung field in the left-right direction) is at the center of the image in the X-axis direction.
[0123] Here, when a radiographic image is captured into the console 2, the automatically adjusted image is displayed (initial display), but the control unit 21 may also perform automatic rotation adjustment and automatic trimming adjustment of the image at any timing. For example, when the radiographic image before adjustment is displayed, the automatically adjusted image may be displayed in response to a predetermined operation by the user (such as pressing an automatic adjustment button). Furthermore, the timing for displaying the automatically adjusted image may be set in advance from "initial display," "when a button is pressed," etc. This setting may also be changed for each facility and each user.
[0124] The user checks the automatically adjusted radiographic image displayed as a preview. For example, the user presses the close buttons 242A, 243A (see FIGS. 15 and 16) on the preview display screens 242, 243 by operating the operation unit 25. The control unit 21 then displays the automatically adjusted radiographic image displayed as a preview in the image display area 241C (see FIG. 10) on the examination screen 241.
[0125] 17 and 18 show display examples in which a radiation image after automatic adjustment is displayed in the image display area 241C of the examination screen 241. The screen configuration of the examination screen 241 shown in FIGS. 17 and 18 is the same as that in FIG. The image display area 241C shown in Figure 17 displays a lateral image of the elbow joint that has been automatically rotated to fit pattern A1 (see Figure 5(b)) and automatically cropped so that the center of the trochlea of the humerus is the center of the image.
[0126] In Figure 18, in the setting table 221, for the imaging area "lateral side of elbow joint", the automatic rotation function is set to "ON", the rotation center in the X-axis and Y-axis directions is set to "center of the trochlear of the humerus", and the rotation angle pattern is set to "Pattern A2 (see Figure 5(c))". Also, in the setting table 221, the automatic trimming function is set to "ON" for the imaging region "lateral surface of elbow joint", and the trimming center in the X-axis and Y-axis directions is set to "center of the trochlea of the humerus". The image display area 241C shown in Figure 18 displays a lateral image of the elbow joint that has been automatically rotated to fit pattern A2 (see Figure 5(c)) and automatically cropped so that the center of the trochlea of the humerus is the center of the image.
[0127] The user may further manually adjust the automatically adjusted radiographic image by operating the operation unit 25.
[0128] When the user presses the output button 241D (see FIGS. 17 and 18) on the examination screen 241 by operating the operation unit 25, the control unit 21 outputs the radiographic image displayed in the image display area 241C (step S7). For example, the control unit 21 stores the automatically adjusted radiographic image in the storage unit 22. The control unit 21 also transmits the automatically adjusted radiographic image to the image management device 4 via the communication unit 23. This completes the photographing control process.
[0129] As described above, the control unit 21 of the console 2 automatically recognizes the structure of the subject in the medical image and automatically adjusts the medical image based on the recognized structure. This eliminates the need for the user to manually adjust the medical image. The control unit 21 can always output images that have been adjusted to a stable level, regardless of the skill of the user (radiologist or other photographer). The control unit 21 can reduce the workload of the photographer by automatically adjusting the image. Since images with a consistent subject position can be obtained in medical facilities, etc., subsequent interpretation of the images becomes easier.
[0130] For example, the control unit 21 can adjust the rotation angle of the medical image, adjust the position of the rotation center of the medical image, adjust the trimming of the medical image, and adjust the position of the trimming center of the medical image.
[0131] Furthermore, the control unit 21 can determine the automatic adjustment standard based on the recognized structure or imaging order information related to the medical image. Specifically, the control unit 21 can determine the criteria for adjusting the rotation angle of the medical image, the criteria for adjusting the position of the rotation center of the medical image, the criteria for adjusting the trimming of the medical image, the criteria for adjusting the position of the trimming center of the medical image, etc.
[0132] For example, by using information indicating the shape of the imaging region of the imaging subject or the anatomical region of the imaging region as the automatic adjustment standard, a display mode that serves as a model for adjustment and a target arrangement state of the medical image can be set.
[0133] Furthermore, in the storage unit 22, the imaging region of the imaging subject is associated with whether or not to automatically adjust the medical image, so the control unit 21 can determine whether or not to perform automatic adjustment based on the imaging region. Here, when a structure recognized in a medical image is used as the imaging area to be used when determining whether to perform automatic adjustment, the control unit 21 can determine whether to perform automatic adjustment based on information obtained from the medical image. When the control unit 21 uses information included in the shooting order information as the shooting area to be used when determining whether to perform automatic adjustment, the control unit 21 can determine whether to perform automatic adjustment based on the information set at the time of shooting.
[0134] Furthermore, the control unit 21 can determine whether or not to perform automatic adjustment for each item such as the automatic rotation function and the automatic trimming function based on the imaging region.
[0135] Furthermore, since the region to be photographed of the subject is associated with the automatic adjustment standard in the storage unit 22, the control unit 21 can determine the automatic adjustment standard based on the region to be photographed. Here, when a structure recognized in a medical image is used as the imaging area to be used when determining the automatic adjustment standard, the control unit 21 can determine the automatic adjustment standard based on information obtained from the medical image. When using information included in the radiography order information as the radiographing region used when determining the automatic adjustment standard, the control unit 21 can determine the automatic adjustment standard based on information set at the time of radiography.
[0136] Furthermore, the control unit 21 can determine an automatic adjustment standard for each item such as an automatic rotation standard, an automatic trimming standard, etc., based on the imaging region.
[0137] Specifically, whether or not to perform automatic adjustment and the automatic adjustment standard can be set in advance in the setting table 221 for each imaging region in accordance with the arrangements within the medical facility and each doctor.
[0138] Furthermore, the control unit 21 calculates the amount of adjustment (amount of rotation, amount of shift, etc.) in accordance with the automatic adjustment standard based on the structure recognized from the medical image, so that adjustment can be made in accordance with the actual state of the image.
[0139] In addition, by using a trained model M obtained by machine learning as a recognition unit that automatically recognizes structures of subjects in medical images, structures can be automatically recognized with high accuracy.
[0140] It goes without saying that the present invention is not limited to the above-described embodiment, and that modifications can be made as appropriate without departing from the spirit of the present invention.
[0141] In the above embodiment, the case where the functions of the medical image output device according to the present invention are installed in the console 2 has been described, but the functions of the medical image output device may be installed in a device other than the console 2. Also, a dedicated device having the functions of the medical image output device may be installed.
[0142] In the above embodiment, the control unit 21 of the console 2 is described as causing the automatically adjusted image to be displayed on the display unit 24, but the image may also be displayed on a display device separate from the console 2. Furthermore, the recognition unit, adjustment unit, and output unit of the present invention may be mounted on different devices to configure a medical image output system.
[0143] Furthermore, a plurality of types of automatic adjustment standards may be prepared for the same imaging region in the setting table 221, and the automatic adjustment standard to be adopted may be switched according to the operation of the medical facility.
[0144] Furthermore, the adjustment unit of the present invention may be a trained model obtained by machine learning.
[0145] Furthermore, in the above embodiment, rotation and trimming are described as adjustments of medical images, but the control unit 21 may automatically adjust the gradation, contrast, etc. of the medical image.
[0146] The computer-readable medium for storing the program for executing each process is not limited to the above examples, and a portable recording medium such as a CD-ROM may also be used. Furthermore, a carrier wave may be used as a medium for providing program data via a communication line. [Explanation of symbols]
[0147] 1. Radiation imaging device (imaging device) 2 Console 3 Radiation Generator (Generator) 4. Image management device 21 Control section 22 Memory section 23 Communications Department 24 Display 25 Control section 31 Generator 32 Irradiation instruction switch 33 Radiation source 100 Radiography system (system) 221 Settings Table M trained models N Communication Network
Claims
1. A recognition unit that automatically recognizes the structures of a subject in a medical image, Based on the recognized structure, an adjustment unit automatically adjusts the medical image, The system includes a control unit that displays the automatically adjusted medical image on a display device, The control unit can pre-set the timing for displaying the automatically adjusted medical image. Medical image output device.
2. The medical image output device according to claim 1, wherein the control unit can select and pre-set the timing for displaying the automatically adjusted medical image from a plurality of timing candidates.
3. The medical image output device according to Claim 1, wherein the control unit can pre-set the timing for displaying the automatically adjusted medical image from the initial display when the medical image is acquired, or from the time a button is pressed in response to a predetermined operation by the user while the medical image before automatic adjustment is displayed.
4. The medical image output device according to claim 1, wherein the setting of the timing for displaying the automatically adjusted medical image can be changed for each facility or for each user.
5. The medical image output device according to claim 3, wherein the control unit, when the timing for displaying the automatically adjusted medical image is set to be when the button is pressed, displays the automatically adjusted medical image in response to receiving the predetermined operation from the user to perform the automatic adjustment while the medical image before the automatic adjustment is displayed on the display device.
6. The medical image output device according to any one of claims 1 to 5, wherein the automatic adjustment of the medical image includes at least one of adjusting the rotation angle of the medical image, adjusting the position of the rotation center of the medical image, adjusting the trimming of the medical image, and adjusting the position of the center of the trimming of the medical image.
7. The medical image output device according to any one of claims 1 to 5, wherein the control unit accepts further manual adjustments by the user to the automatically adjusted medical image displayed on the display device.
8. The medical image output device according to any one of claims 1 to 5, wherein the recognition unit automatically recognizes the structure of the subject using a trained model obtained by machine learning.
9. The aforementioned automatic adjustment has multiple items, The system includes a storage unit that stores, for each part of the target being photographed, whether or not to automatically adjust each of the multiple items, in association with the part of the target being photographed. The medical image output device according to any one of claims 1 to 5, wherein the adjustment unit determines whether or not to automatically adjust each of the items based on the recognized structure or the shooting order information related to the medical image.
10. Computers A recognition unit that automatically recognizes the structures of a subject in a medical image. Based on the recognized structure, an adjustment unit automatically adjusts the medical image. It functions as a control unit that displays the automatically adjusted medical image on a display device, The control unit can pre-set the timing for displaying the automatically adjusted medical image. program.
11. A computer, A recognition process for automatically recognizing structures in medical images, An adjustment step is performed to automatically adjust the medical image based on the recognized structure, The process involves performing a display control step to display the automatically adjusted medical image on a display device, In the display control step, the timing for displaying the automatically adjusted medical image can be set in advance. Medical image output method.
12. A recognition unit that automatically recognizes the structures of a subject in a medical image, Based on the recognized structure, an adjustment unit automatically adjusts the medical image, The system includes a control unit that displays the automatically adjusted medical image on a display device, The control unit can pre-set the timing for displaying the automatically adjusted medical image. Medical image output system.