Medical Image Output Device, Program, Medical Image Output Method, and Medical Image Output System

Automated image recognition and adjustment in medical imaging systems address the inefficiencies of manual alignment, enhancing image quality and reducing staff workload by aligning images according to facility-specific rules and patient positions.

JP7700815B2Active Publication Date: 2025-07-01KONICA MINOLTA INC
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2023074433
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-04-28
Publication Date
2025-07-01
Estimated Expiration
2043-04-28

AI Technical Summary

Technical Problem

Existing medical image processing systems require manual adjustment by radiologic technologists to align images according to specific facility rules and patient positions, leading to high workload and inefficiency.

Method used

Implementing an image recognition technology to automatically recognize objects in medical images and adjust rotation, trimming, and centering based on pre-stored adjustment information, reducing the need for manual intervention.

Benefits of technology

Automated image adjustment reduces the workload of radiologic technologists by ensuring consistent and efficient image alignment, improving image quality and reducing the burden on staff.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007700815000001
    Figure 0007700815000001
  • Figure 0007700815000002
    Figure 0007700815000002
  • Figure 0007700815000003
    Figure 0007700815000003
Patent Text Reader

Abstract

To reduce task load on a photographer by automatically adjusting images.SOLUTION: A medical image output device automatically recognizes a structure (a target part, a photography part, or the like) of a subject in a medical image (step S4). The medical image output device automatically adjusts a medical image on the basis of the recognized structure (step S5). Automatic adjustment of the medical image includes adjustment of a rotation angle of the medical image, position adjustment around a rotation center of the medical image, adjustment of medical image trimming, position adjustment of the center of the trimming of the medical image and the like. The medical image output device outputs an adjusted medical image (steps S6, S7).SELECTED DRAWING: Figure 9
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a medical image output device, a program, a medical image output method, and a medical image output system.

Background Art

[0002] In X-ray imaging, a radiologic technologist adjusts the image (rotation, trimming, centering) so that it is easy for a doctor to interpret. In this adjustment operation, it is necessary to align the images according to the arrangements within the hospital and the directions specified by each doctor. However, since it is necessary to adjust each image every time, the burden on the radiologic technologist is extremely high. In addition, it is necessary to pay attention to the patient's pain and waiting time during imaging, and there are limitations with only adjusting the irradiation field and the position of the panel.

[0003] In Patent Document 1, the cut-out position of the image can be selected from fixed patterns. However, Patent Document 1 assumes that each subject is imaged in a similar position, and it cannot necessarily be said that it is suitable for various conditions such as the subject position and inclination that change for each imaging.

[0004] Also in Patent Document 2, the cut-out position can be aligned with past imaging, but it also cannot handle the subject position and inclination that change for each imaging.

[0005] On the other hand, it has been found that there is a need to finely adjust the position and angle of the subject imaged in the image according to the rules of each facility. Currently, a radiologic technologist recognizes and positions the object shown in the image and then adjusts the image (rotation, trimming, centering).

Prior Art Documents

Patent Documents

[0006]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0007] However, the techniques described in Patent Documents 1 and 2 perform trimming without recognizing the object shown in the image, and are unable to cope with appropriate cutting positions, rotation angles, etc. that vary for each photographing. In addition, although it is necessary to conform to the most appropriate criteria by the facility (reader), it is impossible to respond without recognizing the object shown in the image, and only a human could respond.

[0008] It is conceivable to automatically rotate, trim, etc. the image. Conventionally, however, regarding how to rotate or trim, a human made a judgment after recognizing and positioning the object in the image. To automatically rotate the image, it is necessary to specify the part, position, shape, etc., such as where the elbow is and what shape it is. That is, even if one tries to automatically rotate, trim, etc., it is not known how to rotate or trim.

[0009] Therefore, an object of the present invention is to reduce the workload of the photographer by automatically adjusting the image.

Means for Solving the Problems

[0010] By the way, in recent years, image recognition technology has been developing. For example, it has become possible to automatically recognize an object in an image or automatically specify a target part. The inventor has come up with the idea that if the object can be automatically recognized, the image can be automatically adjusted, and thus the present invention has been achieved.

[0011] The invention according to claim 1 is for a subject in a medical image Imaging region recognition unit that automatically recognizes, and the recognized Imaging regionBased on the adjustment information prestored corresponding thereto, an adjustment unit that automatically adjusts the medical image, and an output unit that outputs the adjusted medical image, a medical image output device having the same. The invention according to claim 2 is the medical image output device according to claim 1, having a storage unit that stores the adjustment information, and the adjustment information can be set for each facility or user.

[0012] Claim 3 The invention according to claim 1 is the medical image output device according to claim 1, wherein the automatic adjustment of the medical image includes at least one of adjustment of the rotation angle of the medical image, adjustment of the position of the rotation center of the medical image, adjustment of the trimming of the medical image, and adjustment of the position of the center of the trimming of the medical image.

[0013] The invention according to claim 4 is the medical image output device according to claim 1, wherein the automatic adjustment of the medical image is adjustment of the rotation angle of the medical image or adjustment of the position of the rotation center of the medical image. The invention according to claim 5 is the medical image output device according to claim 1, wherein the automatic adjustment of the medical image is an adjustment of trimming of the medical image or an adjustment of the position of the center of trimming of the medical image. The invention according to claim 6 is the medical image output device according to claim 1, 2 or 4, wherein the adjustment unit adjusts the rotation angle of the medical image around the position of the rotation center provided on the imaging region of the medical image. The invention according to claim 7 is the medical image output device according to claim 1, 2 or 5, wherein the adjustment unit adjusts the trimming of the medical image around the position of the center of trimming provided on the imaging region of the medical image. The invention according to claim 8 is the medical image output device according to claim 1, 2 or 4, wherein the adjustment unit adjusts the rotation angle of the medical image based on the information of the reference for adjusting the rotation angle stored in advance corresponding to the imaging region. The invention according to claim 9 is the medical image output device according to claim 1, 2 or 4, wherein the adjustment unit adjusts the rotation angle of the medical image so that a specific structure constituting the imaging region is in a predetermined direction. The invention according to claim 10 is the medical image output device according to claim 1, 2 or 4, wherein the adjustment unit adjusts the rotation angle of the medical image with the position of the joint in the imaging region as the position of the rotation center. The invention according to claim 11 is the medical image output device according to any one of claims 1 to 5, wherein the imaging region of the subject is either the elbow joint or the knee joint.

[0014] Claim 12 The invention according to claim 1 is the medical image output device according to any one of claims 1 to 5 In the medical image output device according to any one of the above, the adjustment unit determines an automatic adjustment criterion that is a criterion for automatically adjusting the medical image based on the recognized Imaging region or the imaging order information related to the medical image.

[0015] Claim 13 The invention according to claim 1 is the claim 12In the medical image output device described in [reference], the automatic adjustment criteria for the medical image include at least one of the criteria for adjusting the rotation angle of the medical image, the criteria for adjusting the position of the rotation center of the medical image, the criteria for adjusting the trimming of the medical image, and the criteria for adjusting the position of the center of the trimming of the medical image.

[0016] Claim 14 The invention described in [reference] is, in the medical image output device described in Claim 12 wherein the automatic adjustment criteria for the medical image are the criteria for adjusting the rotation angle of the medical image or the criteria for adjusting the position of the rotation center of the medical image. The invention according to claim 15 is the medical image output device according to claim 12, wherein the automatic adjustment reference of the medical image is a reference for adjusting the trimming of the medical image or a reference for adjusting the position of the center of trimming of the medical image.

[0017] Claim 16 The invention described in [reference] is, in the medical image output device described in Claim 12 wherein the automatic adjustment criteria are information indicating the shape of the imaging region of the imaging object or the anatomical region of the imaging region.

[0018] Claim 17 The invention described in Claim is in the medical image output device described in Claims 1 and 3 , 4 or 5 and includes a storage unit that stores, for each imaging region of the imaging object, an association between the imaging region of the imaging object and whether to automatically adjust the medical image, and the adjustment unit determines whether to perform the automatic adjustment based on the recognized ta cu imaging region or the imaging order information related to the medical image.

[0019] Claim 18 The invention described in Claim is in the medical image output device described in Claims 1 and 3 , 4 or 5 wherein the automatic adjustment has a plurality of items, and for each imaging region of the imaging object, a storage unit is provided that stores an association between the imaging region of the imaging object and whether to perform automatic adjustment for each item of the plurality of items, and the adjustment unit determines whether to perform automatic adjustment for each item based on the recognized ta cu imaging region or the imaging order information related to the medical image.

[0020] Claim 19The invention described in , 4 or 5 In the medical image output device described in, for each imaging region of the imaging target, a storage unit is provided that stores, in association with each other, the imaging region of the imaging target and an automatic adjustment criterion that is a criterion for automatically adjusting the medical image. The adjustment unit determines the automatic adjustment criterion based on the recognized ta cu imaging region or the imaging order information related to the medical image.

[0021] Claim 20 The invention described in , 4 or 5 In the medical image output device described in, the automatic adjustment criterion, which is a criterion for automatically adjusting the medical image, has a plurality of items. For each imaging region of the imaging target, a storage unit is provided that stores, in association with each other, the imaging region of the imaging target and the automatic adjustment criterion for each item of the plurality of items. The adjustment unit determines the automatic adjustment criterion for each item based on the recognized ta cu imaging region or the imaging order information related to the medical image.

[0022] Claim 21 The invention described in 5 In the medical image output device according to any one of claims 1 to

[0023] Claim 22 The invention described in 5 In the medical image output device according to any one of claims 1 to

[0024] Claim 23 The invention described in is a program for causing a computer to function as a recognition unit that automatically recognizes Imaging region a subject in a medical image, an adjustment unit that automatically adjusts the medical image based on adjustment information stored in advance corresponding to the recognized Imaging region and an output unit that outputs the adjusted medical image. Claim 24 The invention described in 23In the program described in [reference], the computer functions as a storage unit that stores the adjustment information, and the adjustment information can be set for each facility or user.

[0025] Claim 25 The invention described in [reference] is 23 In the program described in [reference], the automatic adjustment of the medical image includes at least one of adjustment of the rotation angle of the medical image, adjustment of the position of the rotation center of the medical image, adjustment of the trimming of the medical image, and adjustment of the position of the center of the trimming of the medical image.

[0026] Claim 26 The invention described in [reference] is 23 In the program described in [reference], the automatic adjustment of the medical image is adjustment of the rotation angle of the medical image or adjustment of the position of the rotation center of the medical image. The invention according to claim 27 is the program according to claim 23, wherein the automatic adjustment of the medical image is an adjustment of trimming of the medical image or an adjustment of the position of the center of trimming of the medical image. The invention according to claim 28 is the program according to claim 23, 24 or 26, wherein the adjustment unit adjusts the rotation angle of the medical image around the position of the rotation center provided on the imaging region of the medical image. The invention according to claim 29 is the program according to claim 23, 24 or 27, wherein the adjustment unit performs adjustment of trimming of the medical image with the center of the position of trimming provided on the imaging region of the medical image as the center. The invention according to claim 30 is the program according to claim 23, 24 or 26, wherein the adjustment unit performs adjustment of the rotation angle of the medical image based on information on the reference for adjustment of the rotation angle prestored corresponding to the imaging region. The invention according to claim 31 is the program according to claim 23, 24 or 26, wherein the adjustment unit performs adjustment of the rotation angle of the medical image so that a specific structure constituting the imaging region is in a predetermined direction. The invention according to claim 32 is the program according to claim 23, 24 or 26, wherein the adjustment unit performs adjustment of the rotation angle of the medical image with the position of the joint in the imaging region as the position of the rotation center. The invention according to claim 33 is the program according to any one of claims 23 to 27, wherein the imaging region of the subject is either the elbow joint or the knee joint.

[0027] Claim 34 The invention described in [reference] is 23 to 27 In the program according to any one of [references], the adjustment unit determines an automatic adjustment criterion that is a criterion for automatically adjusting the medical image based on the recognized Imaging region or the imaging order information related to the medical image.

[0028] Claim 35 The invention described in [reference] is 34 In the program described in [reference], the automatic adjustment criterion of the medical image includes at least one of a criterion for adjusting the rotation angle of the medical image, a criterion for adjusting the position of the rotation center of the medical image, a criterion for adjusting the trimming of the medical image, and a criterion for adjusting the position of the center of the trimming of the medical image.

[0029] Claim 36 The invention described in claim 34 In the program described in the above, the automatic adjustment criterion for the medical image is a criterion for adjusting a rotation angle of the medical image, or a criterion for adjusting a position of a rotation center of the medical image. The invention according to claim 37 is the program according to claim 34, wherein the automatic adjustment reference of the medical image is a reference for adjustment of trimming of the medical image or a reference for adjustment of the position of the center of trimming of the medical image.

[0030] Claim 38 The invention described in claim 34 In the program described in the above, the automatic adjustment reference is information indicating a shape of a region to be imaged of an imaging subject or an anatomical region of the region to be imaged.

[0031] Claim 39 The invention described in claim 23, 25, 26 or 27 In the program according to the present invention, the computer is caused to function as a storage unit that stores, for each imaging part of an imaging object, information on whether or not to automatically adjust the medical image in association with the imaging part of the imaging object, and the adjustment unit Ta cuo Whether or not to perform the automatic adjustment is determined based on the shadow area or imaging order information related to the medical image.

[0032] Claim 40 The invention described in claim 23, 25, 26 or 27 In the program according to the present invention, the automatic adjustment has a plurality of items, and the computer is caused to function as a storage unit that stores, for each imaging part of an imaging subject, whether or not to automatically adjust each of the plurality of items in association with the imaging part of the imaging subject, and the adjustment unit is configured to Ta cuo Based on the shadow area or the imaging order information related to the medical image, it is determined whether or not to automatically adjust each of the items.

[0033] Claim 41 The invention described in claim 23, 25, 26 or 27 In the program according to the present invention, the computer is caused to function as a storage unit that stores, for each imaging part of an imaging object, an automatic adjustment standard that is a standard for automatically adjusting the medical image in association with the imaging part of the imaging object, and the adjustment unit isTa cuo Based on the imaging region or the imaging order information related to the medical image, determine the automatic adjustment criteria.

[0034] Claim 42 The invention described in claim 23, 25, 26 or 27 In the program described in claim Ta cuo Based on the imaging region or the imaging order information related to the medical image, determine the automatic adjustment criteria for each item.

[0035] Claim 43 The invention described in claim 23 to 27 In the program according to any one of claims

[0036] Claim 44 The invention described in claim 23 to 27 In the program according to any one of claims

[0037] Claim 45 The invention described in claim Imaging region An automatic recognition step of automatically recognizing a subject in a medical image, an adjustment step of automatically adjusting the medical image based on adjustment information prestored corresponding to the recognized Imaging region and an output step of outputting the adjusted medical image. Claim 46 The invention described in claim 45 In the medical image output method described in claim

[0038] Claim 47 The invention described in claim Imaging regionA recognition unit that automatically recognizes, and based on adjustment information prestored corresponding to the recognized Imaging region a medical image output system having an adjustment unit that automatically adjusts the medical image, and an output unit that outputs the adjusted medical image. Claim 48 The invention according to claim 47 In the medical image output system according to claim

Effect of the Invention

[0039] According to the present invention, the workload of the photographer can be reduced by automatically adjusting the image.

Brief Description of the Drawings

[0040]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Mode for Carrying Out the Invention

[0041] Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the technical scope of the present invention is not limited to the following embodiments and illustrated examples.

[0042] <Configuration of the Radiographic Imaging System> First, a schematic configuration of a radiographic imaging system (hereinafter, system 100) as a medical image output system according to the present embodiment will be described. FIG. 1 is a system configuration diagram of system 100. As shown in FIG. 1, the system 100 includes a radiation imaging device (hereinafter referred to as imaging device 1), a console 2, a radiation generator (hereinafter referred to as generator 3), and an image management device 4. Each of the devices 1 to 4 can communicate with each other via a communication network N such as a LAN (Local Area Network), a WAN (Wide Area Network), or the Internet.

[0043] Note that the system 100 may be installed in the imaging room or may be configured to be movable (e.g., a mobile cart). Also, the system 100 may be able to communicate with a hospital information system (HIS) or a radiology information system (RIS), etc., not shown in the figure.

[0044] The generator 3 includes a generator 31, an irradiation instruction switch 32, and a radiation source 33. Based on the operation of the irradiation instruction switch 32, the generator 31 applies a voltage corresponding to preset imaging conditions to the radiation source 33 (X-ray tube). When a voltage is applied from the generator 31, the radiation source 33 generates radiation R (e.g., X-rays, etc.) with a dose corresponding to the applied voltage.

[0045] Also, the generator 3 generates radiation R in a manner corresponding to the form of the radiation image to be generated. The forms of the radiation image include still images, dynamic images having a plurality of frames, etc. In the case of a still image, radiation R is irradiated only once for each press of the irradiation instruction switch 32. In the case of a dynamic image, pulsed radiation R is irradiated a plurality of times per predetermined time (e.g., 15 times per second) or the irradiation of radiation R is continued for a predetermined time for each press of the irradiation instruction switch 32.

[0046] The imaging device 1 generates digital data of a radiation image in which the imaging region of the subject is shown. The imaging device 1 is a portable FPD (Flat Panel Detector). Specifically, although not shown in the figures, the imaging device 1 includes a sensor substrate, a scanning unit, a reading unit, a control unit, a communication unit, etc. The sensor substrate has an imaging element that generates charges according to the dose by receiving radiation R, and switch elements that accumulate and discharge charges arranged two-dimensionally (in a matrix). The scanning unit switches the ON / OFF of each switch element. The reading unit reads the amount of charges released from each pixel as a signal value. The control unit controls each unit and generates a radiation image from a plurality of signal values read by the reading unit. The communication unit transmits data of the radiation image, various signals, etc. to other devices (such as the console 2, the generator 3, the image management device 4, etc.), and receives various information and various signals from other devices.

[0047] The imaging device 1 accumulates and discharges charges and reads signal values in synchronization with the timing when the radiation R is irradiated from the generator 3. In this way, the imaging device 1 generates still image data (hereinafter, still image data) or moving image data (hereinafter, moving image data). When generating still image data, the generation of a radiation image is performed only once for each press of the irradiation instruction switch 32. When generating moving image data, the generation of frames constituting the moving image is repeated a plurality of times (for example, 15 times per second) per predetermined time for each press of the irradiation instruction switch 32.

[0048] Note that the imaging device 1 may be integrated with the generator 3.

[0049] The console 2 sets various imaging conditions for at least one of the imaging device 1 and the generator 3. The console 2 is composed of a PC, a dedicated device, etc. The imaging conditions include, for example, conditions related to the subject S, conditions related to the irradiation of the radiation R, and conditions related to the image reading of the imaging apparatus 1. The conditions related to the subject S include the imaging site, imaging direction, physique, etc. The conditions related to the irradiation of the radiation R include tube voltage, tube current, irradiation time, current-time product (mAs value), etc. The conditions related to the image reading of the imaging apparatus 1 include frame rate, frame interval, pixel size, image size (matrix size), etc.

[0050] The console 2 may automatically set the imaging conditions based on the imaging order information acquired from other systems (such as HIS, RIS, etc.). Further, the console 2 may manually set the imaging conditions based on the operations performed on the operation unit 25 (see FIG. 2) by the user (such as a radiographer, etc.).

[0051] The image management apparatus 4 manages the image data generated by the imaging apparatus 1. The image management apparatus 4 is a Picture Archiving and Communication System (PACS), an Image Diagnostic Workstation (IWS), or the like.

[0052] <Detailed Configuration of Console> Next, the configuration of the console 2 will be described in detail. In the present embodiment, the functions of the medical image output apparatus according to the present invention are mounted on the console 2. The medical image output apparatus includes a radiation image display device, an MRI image display device, an ultrasonic image display device. The radiation image display device includes a radiation image imaging device, a console of the radiation image imaging device, a radiation image management apparatus (PACS).

[0053] FIG. 2 is a block diagram showing the functional configuration of the console 2. As shown in FIG. 2, the console 2 includes a control unit 21, a storage unit 22, a communication unit 23, a display unit 24, and an operation unit 25. Each of the units 21 to 25 is electrically connected by a bus or the like.

[0054] The control unit 21 is composed of a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), etc. The ROM stores various programs executed by the CPU and parameters necessary for the execution of the programs. The CPU reads out various programs stored in the ROM, expands them in the RAM, executes various processes according to the expanded programs, and centrally controls the operations of each part of the console 2.

[0055] The storage unit 22 is composed of a non-volatile memory, a hard disk, etc. In addition, the storage unit 22 stores the image data of the radiation image acquired from other devices (the imaging device 1, the image management device 4, etc.).

[0056] In addition, the storage unit 22 stores the learned model M. The learned model M is obtained by performing machine learning (for example, deep learning, etc.) on the process of automatically recognizing the structures of the subjects in medical images. The learned model M is generated by performing machine learning using the image data of the radiation image and the structures (correct labels) of the subjects in the radiation image. When the image data of the radiation image is input, the learned model M makes an inference and outputs the information of the structure as output data.

[0057] In addition, the storage unit 22 stores the imaging order information transmitted from the RIS or the like.

[0058] The communication unit 23 is composed of a communication module, etc. The communication unit 23 transmits and receives various signals and various data to and from other devices (the imaging device 1, the generating device 3, the image management device 4, etc.) connected by wire or wirelessly via the communication network N.

[0059] The display unit 24 is composed of, for example, an LCD (Liquid Crystal Display), an organic EL display, etc. The display unit 24 displays a radiation image or the like according to the image signal received from the control unit 21.

[0060] The operation unit 25 includes a keyboard, a pointing device, a touch panel laminated on the surface of the display unit 24, etc. The keyboard includes cursor keys, numeric input keys, various function keys, etc. The pointing device is, for example, a mouse or the like. The operation unit 25 outputs a control signal corresponding to the operation made by the user to the control unit 21.

[0061] Note that the console 2 may not include the display unit 24 and the operation unit 25, and may receive a control signal from an input device provided separately from the console 2 via, for example, the communication unit 23 or the like. Also, the console 2 may output an image signal to a display device (monitor) provided separately from the console 2. Also, when another device (such as the image management device 4 etc.) includes a display unit and an operation unit, this display unit and operation unit may be shared with the console 2. That is, the console 2 may receive a control signal from the operation unit of another device and output an image signal to the display unit of another device.

[0062] The control unit 21 automatically recognizes the structure of the subject in the medical image. That is, the control unit 21 functions as a recognition unit. Specifically, for example, the control unit 21 analyzes the medical image to recognize the object shown in it. The control unit 21 (recognition unit) may automatically recognize the structure of the subject in the medical image by image processing such as edge extraction and histogram analysis.

[0063] Medical images include radiation images, MRI images, ultrasonic images. In this embodiment, the case where the medical image is a radiation image will be described. The structure of the subject may include the target part / imaging part of the subject, and may also include jigs or markers for positioning. The structure of the subject preferably includes the target part / imaging part of the subject.

[0064] The control unit 21 may automatically recognize the structure of the subject in the medical image by using the learned model M obtained by machine learning. The learned model M includes, for example, an algorithm (program) and learned parameters. According to the learned model M, for example, even if the joint is an artificial joint or the bone is missing due to a fracture or the like, it is easy to automatically recognize the structure of the subject in the medical image. Since the recognition accuracy is improved, the accuracy of correctly outputting the adjusted medical image is also improved.

[0065] The control unit 21 automatically adjusts the medical image based on the recognized structure. That is, it functions as an adjustment unit. The automatic adjustment of the medical image includes the rotation of the medical image and the adjustment of the display range. The adjustment of the display range includes trimming.

[0066] The automatic adjustment of the medical image includes at least one of the adjustment of the rotation angle of the medical image, the adjustment of the position of the rotation center of the medical image, the adjustment of the trimming of the medical image, and the adjustment of the position of the center of the trimming of the medical image. The adjustment of trimming is the adjustment of the trimming size and the adjustment of the trimming position. The adjustment of the position of the center of trimming is the adjustment of the position that is the center in the X-axis direction (for example, the left-right direction. The horizontal direction) when trimming the medical image or the adjustment of the position that is the center in the Y-axis direction (for example, the up-down direction. The vertical direction). The adjustment of the rotation angle of the medical image includes correcting the inclination of the medical image.

[0067] The control unit 21 (adjustment unit) determines an automatic adjustment criterion, which is a criterion for automatically adjusting the medical image, based on the recognized structure or the shooting order information related to the medical image.

[0068] The automatic adjustment criteria for medical images include at least one of the criteria for adjusting the rotation angle of medical images, the criteria for adjusting the position of the rotation center of medical images, the criteria for adjusting the trimming of medical images, and the criteria for adjusting the position of the center of trimming of medical images. The criteria for adjusting the rotation angle include, for example, the display mode and shape of the imaging site of the imaging object when the medical image is rotated. In addition, the criteria for adjusting the rotation angle include the display mode and shape that serve as a reference for adjusting the rotation angle.

[0069] The automatic adjustment criteria are information indicating the shape of the imaging site of the imaging object or the anatomical site of the imaging site. In addition, the automatic adjustment criteria may include information indicating the final display mode that serves as a reference when rotating or trimming a medical image. For example, when a predetermined rotation angle pattern (patterns A1, A2, etc. described later) is selected in the item of the rotation criteria of a medical image, the display image is determined by rotating the medical image so as to be displayed in the state of the rotation angle pattern. Also, for example, when the vertebral body center is selected in the item of the trimming criteria (X-axis direction) of a medical image, the medical image is trimmed so that the vertebral body is located at the center, and the display image is determined.

[0070] The storage unit 22 stores, for each imaging site of the imaging object, the imaging site of the imaging object and whether to automatically adjust the medical image in association with each other. That is, in the storage unit 22, whether to automatically adjust the medical image is set in association with the imaging site of the medical image. For example, in the case of the automatic adjustment setting, it is possible to further set whether to perform rotation adjustment or whether to perform trimming adjustment. There may be a case where whether to automatically adjust is stored in association with each imaging site, or a case where whether to automatically adjust is stored in association with the information of the imaging site and the imaging direction.

[0071] The automatic adjustment of medical images may have a plurality of items. In that case, the storage unit 22 stores, for each imaging site of the imaging object, the imaging site of the imaging object and whether to perform automatic adjustment for each of the plurality of items in association with each other.

[0072] The control unit 21 (adjustment unit) refers to the correspondence relationship (imaging site - whether to perform automatic adjustment) stored in the storage unit 22, and determines whether to perform automatic adjustment based on the imaging site of the imaging target, which is a recognized structure, or the imaging order information related to the medical image.

[0073] When the automatic adjustment of the medical image has a plurality of items, the control unit 21 (adjustment unit) refers to the correspondence relationship stored in the storage unit 22, and determines whether to perform automatic adjustment for each item based on the imaging site of the imaging target, which is a recognized structure, or the imaging order information related to the medical image.

[0074] The storage unit 22 stores, for each imaging site of the imaging target, the imaging site of the imaging target and the automatic adjustment criteria, which are the criteria for automatically adjusting the medical image, in association with each other. That is, in the storage unit 22, the automatic adjustment criteria for the medical image are set in association with the imaging site of the medical image.

[0075] The automatic adjustment criteria may have a plurality of items. In that case, the storage unit 22 stores, for each imaging site of the imaging target, the imaging site of the imaging target and the automatic adjustment criteria for each of the plurality of items in association with each other.

[0076] The control unit 21 (adjustment unit) refers to the correspondence relationship (imaging site - automatic adjustment criteria) stored in the storage unit 22, and determines the automatic adjustment criteria based on the imaging site of the imaging target, which is a recognized structure, or the imaging order information related to the medical image.

[0077] When the automatic adjustment criteria have a plurality of items, the control unit 21 (adjustment unit) refers to the correspondence relationship stored in the storage unit 22, and determines the automatic adjustment criteria for each item based on the imaging site of the imaging target, which is a recognized structure, or the imaging order information related to the medical image.

[0078] In one embodiment, the medical image output device includes a display unit that displays the automatically adjusted medical image. The display unit 24 of the console 2 is an embodiment of an output unit that outputs the adjusted medical image. In another embodiment, the medical image output device may include a storage unit that stores automatically adjusted medical images, and a display unit that displays the stored medical images. This embodiment is a pattern in which the adjusted image is saved first and then the adjusted image is displayed. In another embodiment, the medical image output device may include a storage unit that stores information on the angle and position of automatic adjustment, and a display unit that displays a display image based on the information on the angle and position of automatic adjustment. This embodiment is a pattern in which the information on the adjustment angle and position is saved and adjusted at the display timing. In another embodiment, the medical image output device may include an output unit that outputs at least one of the automatically adjusted medical image, the automatically adjusted and stored medical image, and the information on the angle and position of automatic adjustment to another device.

[0079] A setting table 221 is stored in the storage unit 22. In the setting table 221, for each imaging site, whether to automatically adjust the medical image and the automatic adjustment criteria for the medical image are set. The setting table 221 can be set, for example, for each medical facility using the system 100. Further, the setting table 221 may be set for each user (medical staff such as a doctor) or for each group to which the user belongs.

[0080] FIG. 3 shows an example of the data configuration of the setting table 221. In the setting table 221 shown in FIG. 3, for each imaging site, the ON / OFF of the automatic trimming function, the automatic trimming criteria, the ON / OFF of the automatic rotation function, and the automatic rotation criteria are associated. Here, the imaging site includes the imaging direction.

[0081] The ON / OFF of the automatic trimming function is information indicating whether to perform automatic adjustment related to trimming of the medical image. When performing automatic adjustment related to trimming, "ON" is set, and when not performing automatic adjustment related to trimming, "OFF" is set. Note that the trimming adjustment is not limited to removing the outside of a predetermined range of the medical image, and includes adjustment of the display range and display position of the medical image.

[0082] The automatic trimming criteria are the automatic adjustment criteria for trimming medical images. The automatic trimming criteria include, for example, the center position of trimming (in the X-axis direction and Y-axis direction). As the center position of trimming, only one of the two directions (X-axis direction and Y-axis direction) may be specified. Also, as the automatic trimming criteria, a positional relationship may be specified such that a predetermined structure enters the medical image. For example, for the imaging region "front of abdomen", as the automatic trimming criteria in the Y-axis direction, a positional relationship such as "it is okay if the diaphragm enters at the top" may be specified.

[0083] The ON / OFF of the automatic rotation function is information indicating whether to perform automatic adjustment regarding the rotation of medical images. When performing automatic adjustment regarding rotation, "ON" is set, and when not performing automatic adjustment regarding rotation, "OFF" is set.

[0084] The automatic rotation criteria are the automatic adjustment criteria for rotating medical images. The automatic rotation criteria include, for example, the center position of rotation (in the X-axis direction and Y-axis direction) and the rotation angle pattern. The center position of rotation is the position of the rotation axis when rotating the medical image. The rotation angle pattern is information indicating, for example, in what positional relationship the image is desired to be displayed (the target rotation state).

[0085] For example, in the setting table 221 shown in FIG. 3, for the imaging region "front of chest", the trimming center in the X-axis direction (left-right direction) is set to "the center of the vertebral body (spine)", and the center in the Y-axis direction (up-down direction) is set to "between the 6th thoracic vertebra and the 7th thoracic vertebra". However, regarding the Y-axis direction, there is also a policy of not performing position adjustment in order to be able to confirm all the subjects shown. Therefore, separate ON / OFF setting may be possible for trimming (centering) in the Y-axis direction. Also, for the imaging region "front of chest", it is common not to use the rotation function because the degree of curvature of the spine and the like cannot be understood.

[0086] Regarding the automatic adjustment criteria, when there are generally multiple patterns (criteria) for the same imaging site, present options (candidates) for pattern selection to the user when setting, and enable selection from among the options.

[0087] <Example of Automatic Adjustment> As an example of automatic adjustment, automatic rotation and automatic trimming for a "lateral elbow joint image" will be described. In the following description of the angle on the image, as shown in FIG. 4, with the origin of the XY plane as the center, the positive direction of the X axis is set as 0 degrees, and the angle is taken counterclockwise.

[0088] FIG. 5(a) shows an example of a lateral elbow joint image 50. In the lateral elbow joint image 50, the humerus 51, the forearm bones 52 (ulna and radius), and the joint movable part on the humerus side (humeral trochlea 53) are shown. The lateral elbow joint image 50 is adjusted so that the humerus 51 and the forearm bones 52 form a predetermined angle around the humeral trochlea 53. There are at least two patterns for the rotation angle. In the case of the right arm, as shown in FIG. 5(b), the rotation angle with the elbow joint bent approximately 90 degrees and the humerus direction D1 in the 45-degree direction and the forearm bone direction D2 in the 315-degree direction is defined as "Pattern A1". In the case of the left arm, "Pattern A1" is a state where the humerus direction D1 is in the 135-degree direction and the forearm bone direction D2 is in the 225-degree direction. Also, in the case of the right arm, as shown in FIG. 5(c), the rotation angle with the elbow joint bent approximately 90 degrees and the humerus direction D1 in the 90-degree direction and the forearm bone direction D2 in the 0-degree direction is defined as "Pattern A2". In the case of the left arm, "Pattern A2" is a state where the humerus direction D1 is in the 90-degree direction and the forearm bone direction D2 is in the 180-degree direction. Allow the criterion for rotation to be changeable by presetting. Also, the image position is adjusted so that the humeral trochlea 53 becomes the center of the image.

[0089] An automatic adjustment method for a "lateral elbow joint image" will be described. (1) Calculate the position of the center (rotation center of the image) of the humeral trochlea 53 recognized in the lateral elbow joint image 50. (2) Calculate the angular direction between the humerus 51 and the forearm bone 52 with this rotation center as the origin. (3) Obtain the angle bisector L1 of the angle formed between the humerus direction D1 and the forearm bone direction D2 (see FIGS. 5(b) and 5(c)). (4) When "Pattern A1" is set as the automatic rotation reference, as shown in FIG. 5(b), rotate the "lateral elbow joint image" of the right arm so that the angle bisector L1 faces the 0-degree direction. When "Pattern A2" is set as the automatic rotation reference, as shown in FIG. 5(c), rotate the "lateral elbow joint image" of the right arm so that the angle bisector L1 faces the 45-degree direction. Note that in the "lateral elbow joint image", when the angle at which the elbow joint is bent is not approximately 90 degrees, rotate the image so that only the humerus direction D1 becomes the 90-degree direction.

[0090] Next, the automatic trimming for the "front chest image" will be described. FIG. 6(a) shows an example of the front chest image 60. The front chest image 60 shows the lung field, vertebral body, etc. The position of the front chest image 60 is adjusted so that the center (vertebral body) in the left-right direction of the lung field becomes the center in the left-right direction (X-axis direction) of the image. Regarding the up-down direction (Y-axis direction) of the image of the front chest image 60, there are cases where it is not adjusted, cases where the position of the lung apex (the upper end of the lung field) is aligned, cases where the position of a predetermined structure is centered in the image, etc. As shown in FIG. 6(b), the trimmed state where the center L2 in the left-right direction of the lung field becomes the center in the left-right direction of the image is defined as "Pattern B1". As shown in FIG. 6(c), the trimmed state where the center L2 in the left-right direction of the lung field becomes the center in the left-right direction of the image and the lung apex becomes a predetermined value L3 (such as several cm) from the upper end of the image region is defined as "Pattern B2". Also, although not shown in the figure, as the position of the predetermined structure, for example, it may be adjusted so that the position between the 6th thoracic vertebra and the 7th thoracic vertebra becomes the center in the up-down direction of the image. The positions in the horizontal and vertical directions of the image are adjusted based on the set criteria respectively.

[0091] An automatic adjustment method for the "front chest image" will be described. (1) As shown in Fig. 6(a), in the front chest image 60, a rectangular region 61 surrounding the recognized lung field is detected as the region of interest (ROI). (2) The position of the image is adjusted so that the horizontal center L2 of the rectangular region 61 becomes the horizontal center of the image (see Fig. 6(b) and Fig. 6(c)). (3) When the position of the apex of the lung is specified in the vertical direction, as shown in Fig. 6(c), the upper end of the rectangular region 61 is adjusted to a position of a predetermined value L3 from the upper end of the image region.

[0092] Here, it is assumed that the horizontal center L2 (the center of the rectangular region 61) of the lung field coincides with the center of the vertebral body. The center position of the vertebral body may be obtained by automatically recognizing the vertebral body from the front chest image 60.

[0093] Next, the automatic rotation and automatic trimming for the "lateral knee joint image" will be described. Fig. 7(a) shows an example of the lateral knee joint image 70. In the lateral knee joint image 70, the femur 71, the lower leg bone 72 (tibia and fibula), and the femoral condyle are shown. The lateral knee joint image 70 is adjusted so that the femur 71 and the lower leg bone 72 form a predetermined angle around the center 73 of the femoral condyle. Here, the center 73 of the femoral condyle is used as the "center of the knee joint" of the rotation center. There are at least two patterns for the rotation angle. As shown in Fig. 7(b), the rotation angle with the lower leg bone direction D4 facing the 270-degree direction (downward) is defined as "pattern C1". Also, in the case of the right knee, as shown in FIG. 7(c), the rotation angle with the bisector L4 of the angle formed by the femur direction D3 and the tibia direction D4 facing the 0-degree direction is defined as "Pattern C2". In the case of the left knee, for "Pattern C2", the bisector L4 of the angle formed by the femur direction D3 and the tibia direction D4 is in a state facing the 180-degree direction. The criterion for rotation can be changed in advance through settings. Also, the image position is adjusted so that the center 73 of the femoral condyle becomes the center of the image.

[0094] An automatic adjustment method for the "knee joint lateral image" will be described. (1) In the knee joint lateral image 70, calculate the position of the recognized center 73 of the femoral condyle (the rotation center of the image). (2) Calculate the angular directions of the femur 71 and the tibia 72 with this rotation center as the origin. (3) When "Pattern C2" is set as the automatic rotation criterion, obtain the bisector L4 of the angle formed by the femur direction D3 and the tibia direction D4. (4) When "Pattern C1" is set as the automatic rotation criterion, as shown in FIG. 7(b), rotate the "knee joint lateral image" so that the tibia direction D4 faces the 270-degree direction. When "Pattern C2" is set as the automatic rotation criterion, as shown in FIG. 7(c), for the "knee joint lateral image" of the right knee, rotate the image so that the bisector L4 faces the 0-degree direction. When "Pattern C2" is set as the automatic rotation criterion, for the "knee joint lateral image" of the left knee, rotate the image so that the bisector L4 faces the 180-degree direction.

[0095] Also, in automatic trimming adjustment, when the ROI recognized from the medical image is larger than the output size of the image, the output size may be automatically changed. For example, as shown in FIG. 8(a), it is assumed that the ROI 81 has been recognized from the entire medical image 80. The output size 82 is a large angle (14×14 inches), while the height of the ROI 81 is 15 inches. In this case, as shown in FIG. 8(b), the height of the output size 82 is automatically changed to 15 inches or more.

[0096] <Operation of the Console> Next, the operation of the console 2 will be described. FIG. 9 is a flowchart showing the imaging control process executed on the console 2. The imaging control process is executed in cooperation with the CPU of the control unit 21 and the program stored in the ROM.

[0097] First, the control unit 21 receives the selection of imaging order information for the imaging (imaging site, imaging direction) to be performed by an operation from the operation unit 25 (step S1).

[0098] FIG. 10 shows an example of the inspection screen 241 displayed on the display unit 24. The inspection screen 241 is provided with an imaging selection area 241A, a setting area 241B, an image display area 241C, an output button 241D, etc. In the imaging selection area 241A, the details of each imaging (imaging site, imaging direction, etc.) corresponding to each imaging order information are displayed. The setting area 241B is an area for setting the image reading conditions and image processing conditions for imaging. The radiation image taken is displayed in the image display area 241C. Note that at the stage of step S1, no radiation image is yet displayed in the image display area 241C. The output button 241D is a button for instructing the output of the radiation image.

[0099] The user (the imager such as a radiologic technologist) operates the operation unit 25 to select any imaging order information in the imaging selection area 241A of the inspection screen 241.

[0100] Next, the control unit 21 sets imaging conditions for the imaging device 1 and the generating device 3 (step S2). For example, the control unit 21 automatically sets imaging conditions for the imaging device 1 and the generating device 3 based on the selected imaging order information. Alternatively, the control unit 21 may set the imaging conditions for the imaging to be performed on the imaging device 1 and the generating device 3 according to the operation from the user operation unit 25 on the inspection screen 241.

[0101] Next, the user places the subject S between the radiation source 33 of the generating device 3 and the imaging device 1 and performs positioning. Then, when the user operates the irradiation instruction switch 32, the generating device 3 irradiates the imaging part of the subject S with radiation R. The imaging device 1 generates a radiation image (still image, moving image) in which the imaging part appears at the timing of receiving the radiation R from the generating device 3. The imaging device 1 transmits the image data (still image data, moving image data) of the radiation image to the console 2.

[0102] The control unit 21 of the console 2 acquires the image data of the radiation image generated by imaging via the communication unit 23 (step S3).

[0103] Next, the control unit 21 analyzes the image data of the radiation image and automatically recognizes the structure of the subject in the radiation image (step S4). For example, the control unit 21 reads out the learned model M and automatically recognizes the structure in the radiation image. The control unit 21 inputs the image data of the received radiation image into the learned model M and makes it perform inference to output the recognition result of the structure. The learned model M outputs, as the recognition result of the structure, for example, the imaging part, the imaging direction, the name and position of the bone, the name and position of the organ, etc.

[0104] Next, the control unit 21 performs automatic adjustment processing on the radiation image based on the recognized structure (step S5). Here, with reference to FIG. 11, the automatic adjustment processing will be described.

[0105] The control unit 21 refers to the setting table 221 stored in the storage unit 22, and determines whether the automatic rotation function corresponding to the imaging region of the radiation image is ON (step S11). The imaging region of the radiation image may be information automatically recognized from the radiation image in step S4, or may be information included in the imaging order information selected in step S1.

[0106] When the automatic rotation function corresponding to the imaging region of the radiation image is ON (step S11; YES), the control unit 21 acquires an automatic rotation reference corresponding to the imaging region of the radiation image from the setting table 221 (step S12). The automatic rotation reference includes the rotation center of the image and the rotation angle pattern.

[0107] Next, the control unit 21 calculates at which position in the radiation image to rotate (rotation center position) based on the rotation center included in the automatic rotation reference and the structure recognized from within the radiation image (step S13).

[0108] Next, the control unit 21 calculates the amount of rotation of the image so that the radiation image matches the automatic rotation reference (step S14). For example, the control unit 21 calculates the amount of rotation for arranging the radiation image along the rotation angle pattern based on the rotation angle pattern included in the automatic rotation reference and the structure recognized from within the radiation image.

[0109] Next, the control unit 21 rotates the radiation image by the calculated amount of rotation about the rotation center position (step S15).

[0110] After step S15, or when in step S11 the automatic rotation function corresponding to the imaging region of the radiation image is not ON (step S11; NO), the process proceeds to step S16.

[0111] In step S16, the control unit 21 determines whether the automatic trimming function corresponding to the imaging region of the radiation image is ON.

[0112] When the automatic trimming function corresponding to the imaging region of the radiographic image is ON (step S16; YES), the control unit 21 acquires the automatic trimming criteria corresponding to the imaging region of the radiographic image from the setting table 221 (step S17).

[0113] Next, the control unit 21 calculates at which position within the radiographic image to perform trimming (trimming center position) based on the trimming center included in the automatic trimming criteria and the structure recognized from within the radiographic image (step S18).

[0114] Next, the control unit 21 calculates the shift amount and trimming size of the image so that the radiographic image conforms to the automatic trimming criteria (step S19). For example, the control unit 21 calculates the shift amount and trimming size for arranging the radiographic image along the automatic trimming criteria based on the automatic trimming criteria and the structure recognized from within the radiographic image.

[0115] Next, the control unit 21 adjusts the trimming position of the radiographic image (step S20). The control unit 21 adjusts the trimming position according to the trimming center position, shift amount, and trimming size.

[0116] After step S20, or when the automatic trimming function corresponding to the imaging region of the radiographic image is not ON in step S16 (step S16; NO), the automatic adjustment process ends.

[0117] Here, with reference to FIGS. 12 to 14, specific examples of automatic recognition and automatic adjustment of structures will be described. When the lateral elbow joint image 50 shown in FIG. 12 is the processing target, the control unit 21 recognizes the humerus 51, radius 52, trochlea of the humerus 53, etc. from the lateral elbow joint image 50 in step S4. Further, the control unit 21 recognizes that the imaging region of the lateral elbow joint image 50 is the "lateral side of the elbow joint" of the "right arm" based on the humerus 51, radius 52, trochlea of the humerus 53, etc. recognized from within the image.

[0118] Here, in the setting table 221, it is assumed that for the imaging site "lateral aspect of the elbow joint", the automatic rotation function is "ON", the rotation centers in the X-axis direction and the Y-axis direction are the "center of the trochlea of the humerus", and the rotation angle pattern is set to "pattern A1 (see Fig. 5(b))". Also, in the setting table 221, it is assumed that for the imaging site "lateral aspect of the elbow joint", the automatic trimming function is "ON", and the trimming centers in the X-axis direction and the Y-axis direction are set to the "center of the trochlea of the humerus".

[0119] In step S15, as shown in FIG. 13, the control unit 21 rotates the lateral aspect image 50 of the elbow joint so that the bisector L1 of the angle formed by the humerus direction and the forearm direction faces the 0-degree direction around the trochlea of the humerus 53, and obtains a rotated image 50A. In step S20, as shown in FIG. 14, the control unit 21 moves the trimming frame 50B so that the center of the trimming frame 50B coincides with the trochlea of the humerus 53 for the rotated image 50A.

[0120] After the automatic adjustment process, returning to FIG. 9, the control unit 21 previews and displays the automatically adjusted radiographic image on the display unit 24 (step S6).

[0121] FIG. 15 shows an example of a preview display screen 242 displayed on the display unit 24. The preview display screen 242 is displayed superimposed on the inspection screen 241. An automatically adjusted lateral aspect image of the elbow joint is displayed on the preview display screen 242. Specifically, on the preview display screen 242, a lateral aspect image of the elbow joint that has been automatically rotated to match pattern A1 (see Fig. 5(b)) and automatically trimmed so that the center of the trochlea of the humerus is the center of the image is displayed.

[0122] FIG. 16 shows an example of another preview display screen 243 displayed on the display unit 24. The preview display screen 243 is displayed superimposed on the inspection screen 241. An automatically adjusted frontal chest image (chest upright position) is displayed on the preview display screen 243. In the setting table 221, it is assumed that for the imaging region "front of chest", the automatic trimming function is set to "ON", the trimming center in the X-axis direction is set to "center of the vertebral body", and the trimming center in the Y-axis direction is set to "none". Also, in the setting table 221, it is assumed that for the imaging region "front of chest", the automatic rotation function is set to "OFF". On the preview display screen 243, an automatically trimmed front chest image is displayed such that the center of the vertebral body (center L2 in the left-right direction of the lung field) is the center in the X-axis direction of the image.

[0123] Here, when a radiation image is captured in the console 2, the automatically adjusted image is displayed (initial display), but the control unit 21 may perform automatic rotation adjustment and automatic trimming adjustment of the image at an arbitrary timing. For example, in a state where the radiation image before adjustment is displayed, an automatically adjusted image may be displayed in response to a predetermined operation by the user (such as pressing an automatic adjustment button). Also, regarding the timing of displaying the automatically adjusted image, it may be possible to preset it from "initial display", "when button is pressed", etc. This setting can also be changed for each facility and each user.

[0124] The user checks the automatically adjusted radiation image displayed in the preview. For example, when the user operates the operation unit 25 to press the close buttons 242A, 243A (see FIGS. 15 and 16) of the preview display screens 242, 243. Then, the control unit 21 causes the automatically adjusted radiation image that was being previewed to be displayed in the image display area 241C (see FIG. 10) of the inspection screen 241.

[0125] FIGS. 17 and 18 show display examples when an automatically adjusted radiation image is displayed in the image display area 241C of the inspection screen 241. The screen configuration of the inspection screen 241 shown in FIGS. 17 and 18 is the same as that in FIG. 10. In the image display area 241C shown in FIG. 17, an elbow joint side image that has been automatically rotated to match pattern A1 (see FIG. 5(b)) and automatically trimmed so that the center of the trochlea of the humerus is the center of the image is displayed.

[0126] In FIG. 18, in the setting table 221, it is assumed that for the imaging site "elbow joint side", the automatic rotation function is "ON", the rotation centers in the X-axis direction and the Y-axis direction are the "center of the trochlea of the humerus", and the rotation angle pattern is "pattern A2 (see FIG. 5(c))". Also, in the setting table 221, it is assumed that for the imaging site "elbow joint side", the automatic trimming function is "ON", and the trimming centers in the X-axis direction and the Y-axis direction are set to the "center of the trochlea of the humerus". In the image display area 241C shown in FIG. 18, an elbow joint side image that has been automatically rotated to match pattern A2 (see FIG. 5(c)) and automatically trimmed so that the center of the trochlea of the humerus is the center of the image is displayed.

[0127] The user may further manually adjust the automatically adjusted radiographic image by operating the operation unit 25.

[0128] When the user presses the output button 241D (see FIGS. 17 and 18) of the inspection screen 241 by operating the operation unit 25, the control unit 21 outputs the radiographic image displayed in the image display area 241C (step S7). For example, the control unit 21 causes the storage unit 22 to store the radiographic image after automatic adjustment. Also, the control unit 21 transmits the radiographic image after automatic adjustment to the image management device 4 via the communication unit 23. Thus, the imaging control process ends.

[0129] As described above, the control unit 21 of the console 2 automatically recognizes the structure of the subject in the medical image, and automatically adjusts the medical image based on the recognized structure. As a result, it becomes unnecessary for the user to manually adjust the medical image. The control unit 21 can output an image adjusted at a stable level at all times regardless of the skill level of the user (a photographer such as a radiological technologist). According to the control unit 21, the workload of the photographer can be reduced by automatically adjusting the image. In a medical facility or the like, since an image with a unified subject arrangement can be obtained, subsequent image reading becomes easier.

[0130] For example, the control unit 21 can perform adjustments such as adjusting the rotation angle of the medical image, adjusting the position of the rotation center of the medical image, adjusting the trimming of the medical image, and adjusting the position of the center of the trimming of the medical image.

[0131] In addition, the control unit 21 can determine an automatic adjustment criterion based on the recognized structure or the imaging order information related to the medical image. Specifically, the control unit 21 can determine criteria for adjusting the rotation angle of the medical image, criteria for adjusting the position of the rotation center of the medical image, criteria for adjusting the trimming of the medical image, criteria for adjusting the position of the center of the trimming of the medical image, and the like.

[0132] For example, as an automatic adjustment criterion, by using information indicating the shape of the imaging part of the imaging object or the anatomical part of the imaging part, a display mode serving as a sample for adjustment and a target arrangement state of the medical image can be set.

[0133] In addition, in the storage unit 22, since the imaging part of the imaging object is associated with whether to automatically adjust the medical image, the control unit 21 can determine whether to automatically adjust based on the imaging part. Here, when the control unit 21 uses the structure recognized in the medical image as the imaging part used when determining whether to automatically adjust, it can determine whether to automatically adjust based on the information obtained from the medical image. When the control unit 21 uses the information included in the imaging order information as the imaging site used when determining whether to perform automatic adjustment, it can determine whether to perform automatic adjustment based on the information set at the time of imaging.

[0134] In addition, the control unit 21 can determine whether to perform automatic adjustment for each item such as the automatic rotation function and the automatic trimming function based on the imaging site.

[0135] Also, in the storage unit 22, since the imaging site of the imaging object is associated with the automatic adjustment standard, the control unit 21 can determine the automatic adjustment standard based on the imaging site. Here, when the control unit 21 uses the structure recognized in the medical image as the imaging site used when determining the automatic adjustment standard, it can determine the automatic adjustment standard based on the information obtained from the medical image. When the control unit 21 uses the information included in the imaging order information as the imaging site used when determining the automatic adjustment standard, it can determine the automatic adjustment standard based on the information set at the time of imaging.

[0136] In addition, the control unit 21 can determine the automatic adjustment standard for each item such as the automatic rotation standard and the automatic trimming standard based on the imaging site.

[0137] Specifically, according to the agreements within the medical facility and each doctor, it is possible to preset in the setting table 221 whether to perform automatic adjustment and the automatic adjustment standard for each imaging site.

[0138] In addition, since the control unit 21 calculates the adjustment amount (rotation amount, shift amount, etc.) according to the automatic adjustment standard based on the structure recognized from the medical image, it is possible to perform adjustment according to the actual situation of the image.

[0139] Also, as a recognition unit that automatically recognizes the structure of the subject in the medical image, by using the learned model M obtained by machine learning, the structure can be automatically recognized with high accuracy.

[0140] Note that the present invention is not limited to the above-described embodiments, and it goes without saying that it can be appropriately modified without departing from the spirit of the present invention.

[0141] In the above embodiment, the case where the functions of the medical image output device according to the present invention are mounted on the console 2 has been described. However, the functions of the medical image output device may be mounted on a device different from the console 2. Further, a dedicated device having the functions of the medical image output device may be installed.

[0142] In the above embodiment, the control unit 21 of the console 2 has been described as causing the display unit 24 to display the automatically adjusted image. However, it may be displayed on a display device separate from the console 2. Further, the recognition unit, adjustment unit, and output unit of the present invention may be mounted on different devices to configure a medical image output system.

[0143] Further, a plurality of types of automatic adjustment criteria may be prepared in the setting table 221 for the same imaging site, and the automatic adjustment criteria to be adopted may be switched according to the operation of the medical facility.

[0144] Further, the adjustment unit of the present invention may be a learned model obtained by machine learning.

[0145] In the above embodiment, rotation and trimming have been described as adjustments of medical images. However, the control unit 21 may automatically adjust the gradation, contrast, etc. of medical images.

[0146] The computer-readable medium for storing the program for executing each process is not limited to the above example, and a portable recording medium such as a CD-ROM can also be applied. Further, a carrier wave may be applied as a medium for providing the program data via a communication line.

Explanation of Reference Numerals

[0147] 1 Radiation image imaging device (imaging device) 2 Console 3 Radiation Generator (Generator) 4 Image Management Device 21 Control Unit 22 Memory Unit 23 Communication Unit 24 Display Unit 25 Operation Unit 31 Generator 32 Irradiation Instruction Switch 33 Radiation Source 100 Radiation Imaging System (System) 221 Setting Table M Trained Model N Communication Network

Claims

1. A recognition unit that automatically recognizes the imaging site of the subject in a medical image, An adjustment unit that automatically adjusts the medical image based on adjustment information stored in advance corresponding to the recognized imaging site, An output unit that outputs the adjusted medical image, A medical image output device having the above.

2. Having a storage unit that stores the adjustment information, The medical image output device according to claim 1, wherein the adjustment information can be set for each facility or user.

3. The automatic adjustment of the medical image includes at least one of adjustment of the rotation angle of the medical image, adjustment of the position of the rotation center of the medical image, adjustment of the trimming of the medical image, and adjustment of the position of the center of the trimming of the medical image. The medical image output device according to claim 1.

4. The automatic adjustment of the medical image is adjustment of the rotation angle of the medical image or adjustment of the position of the rotation center of the medical image. The medical image output device according to claim 1.

5. The automatic adjustment of the medical image is adjustment of the trimming of the medical image or adjustment of the position of the center of the trimming of the medical image. The medical image output device according to claim 1.

6. The adjustment unit adjusts the rotation angle of the medical image around the position of the rotation center provided on the imaging site of the medical image. The medical image output device according to claim 1, 2 or 4.

7. The adjustment unit adjusts the trimming of the medical image around the position of the center of the trimming provided on the imaging site of the medical image. The medical image output device according to claim 1, 2 or 5.

8. The adjustment unit adjusts the rotation angle of the medical image based on information on the reference for adjusting the rotation angle stored in advance corresponding to the imaging site. The medical image output device according to claim 1, 2 or 4.

9. The adjustment unit adjusts the rotation angle of the medical image so that a specific structure constituting the imaging site is in a predetermined direction. The medical image output device according to claim 1, 2 or 4.

10. The adjustment unit adjusts the rotation angle of the medical image with the position of the joint in the imaging site as the position of the rotation center. The medical image output device according to claim 1, 2 or 4.

11. The imaging site of the subject is either the elbow joint or the knee joint. The medical image output device according to any one of claims 1 to 5.

12. The adjustment unit determines an automatic adjustment criterion, which is a criterion for automatically adjusting the medical image, based on the recognized imaging region or imaging order information related to the medical image, and the medical image output device according to any one of claims 1 to 5.

13. The automatic adjustment criterion of the medical image includes at least one of a criterion for adjusting the rotation angle of the medical image, a criterion for adjusting the position of the rotation center of the medical image, a criterion for adjusting the trimming of the medical image, and a criterion for adjusting the position of the center of the trimming of the medical image, and the medical image output device according to claim 12.

14. The automatic adjustment criterion of the medical image is a criterion for adjusting the rotation angle of the medical image or a criterion for adjusting the position of the rotation center of the medical image, and the medical image output device according to claim 12.

15. The automatic adjustment criterion of the medical image is a criterion for adjusting the trimming of the medical image or a criterion for adjusting the position of the center of the trimming of the medical image, and the medical image output device according to claim 12.

16. The automatic adjustment criterion is information indicating the shape of the imaging region of the imaging object or the anatomical region of the imaging region, and the medical image output device according to claim 12.

17. A storage unit is provided for storing, for each imaging region of the imaging object, the imaging region of the imaging object and whether to automatically adjust the medical image in association with each other. The adjustment unit determines whether to perform the automatic adjustment based on the recognized imaging region or imaging order information related to the medical image, and the medical image output device according to claim 1, 3, 4 or 5.

18. The automatic adjustment has a plurality of items. A storage unit is provided for storing, for each imaging region of the imaging object, the imaging region of the imaging object and whether to perform automatic adjustment for each of the plurality of items in association with each other. The adjustment unit determines whether to perform automatic adjustment for each item based on the recognized imaging region or imaging order information related to the medical image, and the medical image output device according to claim 1, 3, 4 or 5.

19. A storage unit is provided for storing, for each imaging region of the imaging object, the imaging region of the imaging object and an automatic adjustment criterion, which is a criterion for automatically adjusting the medical image, in association with each other. The adjustment unit determines the automatic adjustment criterion based on the recognized imaging region or imaging order information related to the medical image, and the medical image output device according to claim 1, 3, 4 or 5.

20. The automatic adjustment criteria, which are the criteria for automatically adjusting the medical image, have a plurality of items. A storage unit is provided for associating and storing, for each imaging region of the imaging object, the imaging region of the imaging object and the automatic adjustment criteria for each item of the plurality of items. The adjustment unit determines the automatic adjustment criteria for each item based on the recognized imaging region or the imaging order information related to the medical image. The medical image output device according to claim 1, 3, 4 or 5.

21. The medical image is a radiation image. The medical image output device according to any one of claims 1 to 5.

22. The recognition unit is a learned model obtained by machine learning. The medical image output device according to any one of claims 1 to 5.

23. A computer, A recognition unit that automatically recognizes the imaging region of the subject in the medical image, An adjustment unit that automatically adjusts the medical image based on adjustment information prestored corresponding to the recognized imaging region, An output unit that outputs the adjusted medical image, A program for functioning as such.

24. The computer functions as a storage unit for storing the adjustment information, The adjustment information can be set for each facility or user. The program according to claim 23.

25. The automatic adjustment of the medical image includes at least one of adjustment of the rotation angle of the medical image, adjustment of the position of the rotation center of the medical image, adjustment of the trimming of the medical image, and adjustment of the position of the center of the trimming of the medical image. The program according to claim 23.

26. The automatic adjustment of the medical image is adjustment of the rotation angle of the medical image or adjustment of the position of the rotation center of the medical image. The program according to claim 23.

27. The automatic adjustment of the medical image is adjustment of the trimming of the medical image or adjustment of the position of the center of the trimming of the medical image. The program according to claim 23.

28. The adjustment unit adjusts the rotation angle of the medical image around the position of the rotation center provided on the imaging region of the medical image. The program according to claim 23, 24 or 26.

29. The adjustment unit adjusts the trimming of the medical image around the position of the center of the trimming provided on the imaging region of the medical image. The program according to claim 23, 24 or 27.

30. The adjustment unit adjusts the rotation angle of the medical image based on information on the reference for adjusting the rotation angle prestored corresponding to the imaging site, according to the program described in Claim 23, 24 or 26.

31. The adjustment unit adjusts the rotation angle of the medical image so that a specific structure constituting the imaging site is in a predetermined direction, according to the program described in Claim 23, 24 or 26.

32. The adjustment unit adjusts the rotation angle of the medical image with the position of the joint in the imaging site as the position of the rotation center, according to the program described in Claim 23, 24 or 26.

33. The imaging site of the subject is either the elbow joint or the knee joint, according to the program described in any one of Claims 23 to 27.

34. The adjustment unit determines an automatic adjustment reference, which is a reference for automatically adjusting the medical image, based on the recognized imaging site or the imaging order information related to the medical image, according to the program described in any one of Claims 23 to 27.

35. The automatic adjustment reference of the medical image includes at least one of a reference for adjusting the rotation angle of the medical image, a reference for adjusting the position of the rotation center of the medical image, a reference for adjusting the trimming of the medical image, and a reference for adjusting the position of the center of the trimming of the medical image, according to the program described in Claim 34.

36. The automatic adjustment reference of the medical image is a reference for adjusting the rotation angle of the medical image or a reference for adjusting the position of the rotation center of the medical image, according to the program described in Claim 34.

37. The automatic adjustment reference of the medical image is a reference for adjusting the trimming of the medical image or a reference for adjusting the position of the center of the trimming of the medical image, according to the program described in Claim 34.

38. The automatic adjustment reference is information indicating the shape of the imaging site of the imaging object or the anatomical site of the imaging site, according to the program described in Claim 34.

39. Function the computer as a storage unit that stores, for each imaging site of the imaging object, an association between the imaging site of the imaging object and whether to automatically adjust the medical image, The adjustment unit determines whether to perform the automatic adjustment based on the recognized imaging site or the imaging order information related to the medical image, according to the program described in Claim 23, 25, 26 or 27.

40. The automatic adjustment has a plurality of items. function the computer as a storage unit that stores, for each imaging part of the imaging subject, in association with the imaging part of the imaging subject, whether to automatically adjust each of the plurality of items The adjustment unit determines whether to automatically adjust each item based on the recognized imaging part or the imaging order information related to the medical image. The program according to claim 23, 25, 26, or 27

41. function the computer as a storage unit that stores, for each imaging part of the imaging subject, in association with the imaging part of the imaging subject, an automatic adjustment criterion that is a criterion for automatically adjusting the medical image The adjustment unit determines the automatic adjustment criterion based on the recognized imaging part or the imaging order information related to the medical image. The program according to claim 23, 25, 26, or 27

42. The automatic adjustment criterion for automatically adjusting the medical image has a plurality of items function the computer as a storage unit that stores, for each imaging part of the imaging subject, in association with the imaging part of the imaging subject, the automatic adjustment criterion for each of the plurality of items The adjustment unit determines the automatic adjustment criterion for each item based on the recognized imaging part or the imaging order information related to the medical image. The program according to claim 23, 25, 26, or 27

43. The medical image is a radiation image. The program according to any one of claims 23 to 27

44. The recognition unit is a learned model obtained by machine learning. The program according to any one of claims 23 to 27

45. A recognition step of automatically recognizing the imaging part of the subject in the medical image An adjustment step of automatically adjusting the medical image based on adjustment information stored in advance corresponding to the recognized imaging part An output step of outputting the adjusted medical image A medical image output method including

46. Including a storage step of storing the adjustment information in a storage unit The adjustment information can be set for each facility or user. The medical image output method according to claim 45

47. A recognition unit that automatically recognizes the imaging part of the subject in the medical image An adjustment unit that automatically adjusts the medical image based on adjustment information stored in advance corresponding to the recognized imaging part An output unit that outputs the adjusted medical image A medical image output system having

48. It has a storage unit that stores the adjustment information, The medical image output system according to claim 47, wherein the adjustment information can be set for each facility or user.

Citation Information

Patent Citations

  • Method and system for automatically extracting magnetic resonance image corpus callosum

    CN104083170A

  • Image processing selecting method, image selecting method, and image processor

    JP2001351092A

  • Image processing apparatus, image processing method, and recording medium which stores program according to which computer perform pertinent image processing

    JP2004174217A

  • X-ray radiographing apparatus and method for outputting x-ray image

    JP2012055491A

  • Magnetic resonance imaging apparatus

    JP2012110688A