Moving image processing device, moving image processing method, and program

Abstract

The invention relates to a moving image processing apparatus, a moving image processing method, and a program. Teaching file information can be constructed more easily. A moving image processing device (diagnostic console 3) is provided with: a moving image acquisition unit (control unit 31) that acquires a moving image; a disease determination unit (control unit 31) that determines disease candidates on the basis of the moving image; and a storage location determination unit (control unit 31) that determines the storage location of the moving image on the basis of the disease candidates.

Description

Technical Field

[0001] The present invention relates to a dynamic image processing device, a dynamic image processing method and a program. Background Art

[0002] In the past, case collections (teaching documents) were produced with the purpose of improving the knowledge of students and trainee doctors.

[0003] In addition, case collections are often created using mainly still images.

[0004] Currently, dynamic images are also being used in case series.

[0005] In addition, Patent Document 1 describes searching for similar case images from moving images.

[0006] Prior art literature

[0007] Patent Literature

[0008] Patent Document 1: Japanese Patent Application Publication No. 2023-27550 Summary of the invention

[0009] However, since dynamic images contain more information than still images, it is difficult to efficiently organize dynamic images, and it takes time and effort to create teaching documents.

[0010] An object of the present invention is to more easily construct teaching document information using dynamic images.

[0011] In order to solve the above-mentioned problems, the dynamic image processing device according to the present invention comprises:

[0012] A dynamic image acquisition unit, which acquires a dynamic image;

[0013] a disease determination unit that determines a disease candidate based on the dynamic image; and

[0014] The storage location determining unit determines a storage location of the moving image based on the disease candidates.

[0015] In order to solve the above-mentioned problem, a dynamic image processing method according to the present invention includes: in a dynamic image processing device for processing dynamic images,

[0016] A dynamic image acquisition step of acquiring a dynamic image;

[0017] A disease determination step of determining a disease candidate based on the dynamic image; and

[0018] A storage location determination step of determining a storage location of the moving image based on the disease candidates.

[0019] In order to solve the above-mentioned problems, the program according to the present invention causes a computer of a moving image processing device that processes moving images to function as the following components:

[0020] A dynamic image acquisition unit, which acquires a dynamic image;

[0021] a disease determination unit that determines a disease candidate based on the dynamic image; and

[0022] The storage location determining unit determines a storage location of the moving image based on the disease candidates.

[0023] According to the present invention, teaching document information can be constructed more easily. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 It is a diagram showing the overall configuration of a moving image processing system in an embodiment of the present invention.

[0025] Figure 2 : is a flowchart showing the disease candidate determination process.

[0026] (Explanation of symbols)

[0027] 100: dynamic image processing system; 1: imaging device; 11: radiation source; 12: radiation irradiation control device; 13: radiation detection unit; 14: reading control device; 2: imaging console; 21: control unit; 22: storage unit; 23: operation unit; 24: display unit; 25: communication unit; 26: bus; 3: diagnostic console (dynamic image processing device); 31: control unit; 32: storage unit; 33: operation unit; 34: display unit; 35: communication unit (transmission unit); 36: bus; 4: case management server; 41: control unit; 42: storage unit; 42A: storage location; 42B: storage location; 43: communication unit. DETAILED DESCRIPTION

[0028] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the scope of the present invention is not limited to the examples in the drawings.

[0029] [Structure of dynamic image processing system 100]

[0030] Figure 1 The overall configuration of a moving image processing system 100 in this embodiment is shown.

[0031] like Figure 1As shown, the imaging device 1 and the imaging console 2 are connected by a communication cable or the like, and the imaging console 2, the diagnostic console 3 as a dynamic image processing device, and the case management server 4 are connected via a communication network NT such as a LAN (Local Area Network), thereby forming a dynamic image processing system 100.

[0032] [Structure of the photographing device 1]

[0033] The imaging device 1 is imaging means for imaging the dynamics of a subject having periodicity, such as changes in the shape of the lungs expanding and contracting due to respiratory movement and the beating of the heart.

[0034] Dynamic imaging refers to repeatedly irradiating a subject with radiation such as X-rays at predetermined time intervals in a pulsed manner (pulse irradiation), or continuously irradiating a subject with radiation such as X-rays at a low dose rate (continuous irradiation), thereby obtaining multiple images. In other words, dynamic imaging refers to continuously performing radiation imaging along the time axis for the dynamics of a periodic target part.

[0035] In addition, regarding dynamic photography, not only radiation such as X-rays but also ultrasound or magnetism can be used for photography. Dynamic photography includes animation photography, but does not include photography of still images while displaying animation.

[0036] In addition, a series of images obtained by dynamic photography is called a dynamic image.

[0037] In addition, for example, a moving image can be acquired by photographing using a semiconductor image sensor such as a FPD (Flat Panel Detector).

[0038] The moving image includes animation, but does not include an image obtained by photographing a still image while displaying the animation.

[0039] In addition, each of the multiple images constituting the dynamic image is referred to as a frame image. In addition, in the following embodiments, the case of dynamic photography by pulse irradiation is described as an example. In addition, in the following embodiments, the case of setting the subject M to the chest of the subject is described as an example, but it is not limited to this.

[0040] The radiation source 11 is disposed at a position facing the radiation detection unit 13 across the subject M, and irradiates the subject M with radiation (X-rays) in accordance with the control of the radiation irradiation control device 12 .

[0041] The radiation irradiation control device 12 is connected to the radiography console 2 , and controls the radiation source 11 to perform radiography based on the radiation irradiation conditions input from the radiography console 2 .

[0042] The radiation irradiation conditions include, for example, a pulse rate, a pulse width, a pulse interval, the number of imaging frames per imaging, a value of an X-ray tube current, a value of an X-ray tube voltage, a type of additional filter, and the like.

[0043] The pulse rate is the number of radiation irradiations per second, which is consistent with the frame rate described below. The pulse width is the radiation irradiation time per radiation irradiation. The pulse interval is the time from the start of one radiation irradiation to the start of the next radiation irradiation, which is consistent with the frame interval described below.

[0044] The radiation detection unit 13 is composed of a semiconductor image sensor such as an FPD.

[0045] The FPD has, for example, a glass substrate, on which a plurality of detection elements (pixels) are arranged in a matrix at predetermined positions. The plurality of detection elements (pixels) detect radiation irradiated from a radiation source 11 and at least transmitted through a subject M according to its intensity, and convert the detected radiation into electrical signals for storage.

[0046] Each pixel is configured to include a switch unit such as a TFT (Thin Film Transistor), for example.

[0047] FPDs include an indirect conversion type that converts X-rays into electric signals by a photoelectric conversion element via a scintillator and a direct conversion type that directly converts X-rays into electric signals, and either one can be used.

[0048] In the present embodiment, the pixel value (signal value) of the image data generated in the radiation detection unit 13 is a density value, and the density value becomes higher as the amount of transmitted radiation increases.

[0049] The radiation detection section 13 is provided so as to face the radiation source 11 with the subject M interposed therebetween.

[0050] The reading control device 14 is connected to the imaging console 2 .

[0051] The reading control device 14 controls the switch section of each pixel of the radiation detection unit 13 according to the image reading conditions input from the imaging console 2, switches the reading of the electrical signal accumulated in each pixel, reads the electrical signal accumulated in the radiation detection unit 13, and obtains image data. The image data is a frame image.

[0052] Then, the reading control device 14 assigns an identification ID and a frame number, and outputs the acquired frame image to the photographing console 2 .

[0053] The image reading conditions include, for example, a frame rate, a frame interval, a pixel size, an image size (matrix size), and the like.

[0054] The frame rate is the number of frame images acquired per second, and is consistent with the pulse rate. The frame interval is the time from the start of the acquisition operation of one frame image to the start of the acquisition operation of the next frame image, and is consistent with the pulse interval.

[0055] Here, the radiation irradiation control device 12 and the reading control device 14 are connected to each other, and exchange synchronization signals with each other to coordinate the radiation irradiation operation and the image reading operation.

[0056] [Structure of the photography console 2]

[0057] The radiography console 2 outputs radiation irradiation conditions and image reading conditions to the radiography device 1 , and controls radiography and radiological image reading operations performed by the radiography device 1 .

[0058] Photography console 2 Figure 1 As shown, the system includes a control unit 21 , a storage unit 22 , an operation unit 23 , a display unit 24 , and a communication unit 25 , and each unit is connected via a bus 26 .

[0059] The control unit 21 is composed of a CPU (Central Processing Unit), a RAM (Random Access Memory), etc. The CPU of the control unit 21 reads out the system program and various processing programs stored in the storage unit 22 according to the operation of the operation unit 23 and expands them in the RAM, executes various processes including the imaging control process according to the expanded programs, and centrally controls the operations of the various parts of the imaging console 2, the radiation irradiation operation of the imaging device 1, and the reading operation.

[0060] The storage unit 22 is composed of a nonvolatile semiconductor memory, a hard disk, etc. The storage unit 22 stores various programs executed by the control unit 21, parameters required for processing by the program, or data such as processing results. For example, the storage unit 22 stores a program for executing photography control processing. Various programs are stored in the form of readable program codes, and the control unit 21 sequentially executes operations according to the program codes.

[0061] Specifically, the storage unit 22 stores a series of frame images (moving images) output from the imaging device 1 and to which identification IDs and frame numbers are assigned.

[0062] The storage unit 22 also stores photographing instruction information. The photographing instruction information is attached to a series of frame images (moving images) and stored in the storage unit 22 .

[0063] The imaging instruction information refers to radiation irradiation conditions (described above), image reading conditions (described above), subject information, examination information, and the like.

[0064] The subject information includes, for example, the subject's name, height, weight, age, gender, etc.

[0065] The examination information includes, for example, the imaging part (chest, etc.), the diagnosis object (ventilation, pulmonary blood flow, etc.), the purpose of the examination (lung cancer, pneumonia, etc.), and the like.

[0066] The operation unit 23 is configured to include a keyboard having cursor keys, numeric input keys, and various function keys, and a pointing device such as a mouse, and outputs a pointing signal input by operating a key on the keyboard or operating the mouse to the control unit 21. Alternatively, the display screen of the display unit 24 may include a touch panel, in which case the operation unit 23 outputs a pointing signal input via the touch panel to the control unit 21.

[0067] The person who performs photography inputs the above-mentioned photography instruction information using the operation unit 23 .

[0068] The display unit 24 is composed of a monitor such as an LCD (Liquid Crystal Display) or a CRT (Cathode Ray Tube), and displays input instructions and data from the operation unit 23 in accordance with instructions of a display signal input from the control unit 21 .

[0069] The communication unit 25 includes a LAN adapter, a modem, a TA (Terminal Adapter), and the like, and controls data transmission and reception with each device connected to the communication network NT.

[0070] [Structure of diagnostic console 3]

[0071] The diagnostic console 3 (moving image processing device) acquires and displays moving images from the imaging console 2. As described above, the moving images are accompanied by imaging instruction information.

[0072] Diagnostic console 3 Figure 1 As shown, the system includes a control unit 31 , a storage unit 32 , an operation unit 33 , a display unit 34 , and a communication unit 35 , and each unit is connected via a bus 36 .

[0073] The control unit 31 is composed of a CPU, a RAM, etc. The CPU of the control unit 31 reads out the system program and various processing programs stored in the storage unit 32 and expands them in the RAM according to the operation of the operation unit 33, and executes various processes according to the expanded programs. In addition, the CPU of the control unit 31 reads out the program 32a stored in the storage unit 32 and expands it in the RAM, and executes the image display process described later according to the expanded program 32a.

[0074] In addition, the control unit 31 functions as a moving image acquisition unit that acquires moving images.

[0075] Furthermore, the control unit 31 functions as a disease determination unit that determines disease candidates based on moving images.

[0076] Furthermore, the control unit 31 functions as a storage location determination unit that determines a storage location of the moving image based on the disease candidates.

[0077] The storage unit 32 is composed of a nonvolatile semiconductor memory, a hard disk, etc. The storage unit 32 stores a program 32a for executing image display processing by the control unit 31, various programs, parameters required for executing processing by the program, or data such as processing results. These various programs are stored in the form of readable program codes, and the control unit 31 sequentially executes operations according to the program codes.

[0078] Furthermore, the storage unit 32 stores moving images acquired from the imaging console 2 and accompanying imaging instruction information.

[0079] The operation unit 33 is configured to include a keyboard having cursor keys, numeric input keys, and various function keys, and a pointing device such as a mouse, and outputs a pointing signal input by operating a key on the keyboard or operating the mouse to the control unit 31. In addition, the operation unit 33 may include a touch panel on the display screen of the display unit 34, in which case the pointing signal input via the touch panel is output to the control unit 31.

[0080] The display unit 34 is composed of a monitor such as an LCD or a CRT, and performs various displays in accordance with instructions of a display signal input from the control unit 31 .

[0081] The display unit 34 functions as a display unit that displays the first moving image and the second moving image including the supplementary image in a comparable manner.

[0082] The communication unit 35 includes a LAN adapter, a modem, a TA, and the like, and controls data transmission and reception with each device connected to the communication network NT.

[0083] The communication unit 35 functions as a transmission unit that transmits moving images to the outside.

[0084] [Structure of Case Management Server 4]

[0085] The case management server 4 is a device that stores and manages the moving images (cases) transmitted from the diagnostic console 3. As described above, the moving images are accompanied by imaging instruction information.

[0086] Case management server 4 Figure 1As shown, the system includes a control unit 41 , a storage unit 42 , and a communication unit 43 , and each unit is connected via a bus 44 .

[0087] The control unit 41 is composed of a CPU, a RAM, etc. The CPU of the control unit 41 reads out the system program and various processing programs stored in the storage unit 42 and expands them in the RAM, and executes various processes according to the expanded programs.

[0088] The storage unit 42 is composed of a nonvolatile semiconductor memory, a hard disk, etc. The storage unit 42 stores various programs, parameters required for executing processing by the program, or data such as processing results. These various programs are stored in the form of readable program codes, and the control unit 41 sequentially executes actions according to the program codes.

[0089] In the storage unit 42, the dynamic images sent from the diagnostic console 3 are stored in the storage locations (storage location 42A, storage location 42B, ...) determined by the control unit 31. For example, the dynamic image of "disease candidate: lung cancer" is stored in the storage location 42A, and the dynamic image of "disease candidate: pneumonia" is stored in the storage location 42B.

[0090] The communication unit 43 includes a LAN adapter, a modem, a TA, and the like, and controls data transmission and reception with each device connected to the communication network NT.

[0091] [Disease candidate determination processing]

[0092] Next, use Figure 2 , the disease candidate determination process in the diagnosis console 3 is described.

[0093] The disease candidate determination process is a process of determining disease candidates based on moving images.

[0094] It is assumed that the moving image has already been stored in the storage unit 32 of the diagnostic console 3 .

[0095] First, the control unit 31 acquires a moving image from the storage unit 32 (step S1 ).

[0096] As described above, the moving image is accompanied by shooting instruction information.

[0097] Note that after step S2, when the photographing instruction information is not used, the control unit 31 does not need to acquire the photographing instruction information.

[0098] Next, the control unit 31 determines disease candidates based on the moving image (step S2 ).

[0099] For example, the control unit 31 extracts feature quantities from the moving image using machine learning, and determines disease candidates for disease names having a similarity greater than or equal to a predetermined value.

[0100] Furthermore, for example, the control unit 31 may use machine learning to extract not only the feature amount from the moving image but also the imaging site, the diagnosis target, and the purpose of the examination included in the imaging order information, and determine the disease candidate.

[0101] In addition, for example, the control unit 31 may refer to the examination purpose included in the imaging order information and add the disease information included in the examination purpose to the disease candidates.

[0102] Furthermore, it is assumed that before the disease candidate determination process, the storage unit 32 stores a learning model used in machine learning.

[0103] In addition, in the above, the disease candidates are determined using machine learning, but the present invention is not limited to this.

[0104] Next, the control unit 31 determines a storage location of the moving image based on the disease candidates (step S3 ). After determining the storage location, the control unit 31 transmits the moving image to the storage location via the communication unit 35 (step S4 ).

[0105] For example, the control unit 31 determines the same storage location for the dynamic images of the same disease candidate. If a storage location corresponding to the disease candidate is created in advance, the storage location is used as the storage location. If a storage location corresponding to the disease candidate is not created, a new storage location is created in the storage unit 42 and the storage location is used as the storage location.

[0106] 〔other〕

[0107] In the above description, the disease candidate determination process is executed by the control unit 31 of the diagnostic console 3 , but may be executed by the control unit 41 of the case management server 4 .

[0108] In addition, the diagnosis console 3 and the case management server 4 are not limited to one, and may be multiple. In addition, the diagnosis console 3 and the case management server 4 are not limited to the case where they are arranged in the hospital, and may be arranged outside the hospital.

[0109] 〔Effect〕

[0110] As described above, the dynamic image processing device (diagnostic console 3) includes: a dynamic image acquisition unit (control unit 31) for acquiring dynamic images; a disease determination unit (control unit 31) for determining disease candidates based on the dynamic images; and a storage location determination unit (control unit 31) for determining a storage location for the dynamic images based on the disease candidates.

[0111] Therefore, teaching document information can be constructed more easily.

[0112] Recently, machine learning including AI has made remarkable progress. Therefore, it is believed that the number of disease candidates determined based on dynamic images has increased. Therefore, it is assumed that if the user manually determines the storage location for each disease candidate that may increase and creates a teaching file, it will be very time-consuming. The diagnostic console 3 can prevent such a situation.

[0113] In addition, the disease determination unit (control unit 31 ) determines disease candidates based on the analysis results of the moving images.

[0114] Therefore, teaching document information can be constructed more easily.

[0115] Furthermore, the disease determination unit (control unit 31 ) determines disease candidates based on the imaging order information.

[0116] Therefore, teaching document information can be constructed more easily.

[0117] That is, when a specific disease is examined, it does not necessarily mean that the specific disease has occurred in the patient. For example, when a patient is examined for "lung cancer", there is a possibility that the patient does not have "lung cancer". On the other hand, based on the dynamic image, "pneumonia" may be determined as a disease candidate for the patient. In such a case, "lung cancer" as the examination purpose can also be added as a disease candidate.

[0118] In addition, the disease determination unit (control unit 31 ) determines disease candidates using machine learning.

[0119] Therefore, teaching document information can be constructed more easily.

[0120] Furthermore, the moving image processing device (diagnostic console 3 ) includes a transmission unit (communication unit 35 ) for transmitting the moving image to the outside, and the storage location determination unit determines a destination to transmit the moving image based on the disease candidates.

[0121] Therefore, even when a plurality of diagnostic consoles 3 are connected to the dynamic image processing system 100 , the teaching file information can be constructed more easily.

[0122] In addition, the dynamic image processing method includes: in a dynamic image processing device that processes dynamic images, a dynamic image acquisition step (step S1) of acquiring a dynamic image, a disease determination step (step S2) of determining a disease candidate based on the dynamic image, and a storage location determination step (step S3) of determining a storage location of the dynamic image based on the disease candidate.

[0123] Therefore, teaching document information can be constructed more easily.

[0124] In addition, the program causes the computer of the dynamic image processing device (diagnostic console 3) that processes dynamic images to function as the following components: a dynamic image acquisition unit (control unit 31) that acquires dynamic images; a disease determination unit (control unit 31) that determines disease candidates based on the dynamic images; and a storage location determination unit (control unit 31) that determines the storage location of the dynamic images based on the disease candidates.

[0125] Therefore, teaching document information can be constructed more easily.

[0126] In addition, the description in this embodiment is an example of a preferred moving image processing system involved in the present invention, and is not limited to this.

[0127] For example, the above description discloses an example of constructing teaching file information, but it is also possible to perform remote image reading and request image reading to a professional doctor by determining an external network folder as the storage location of the dynamic image and saving the dynamic image in the folder.

[0128] In addition, in the above description, an example of using a hard disk, a semiconductor nonvolatile memory, etc. as a computer-readable medium of the program involved in the present invention is disclosed, but the present invention is not limited to this example. As other computer-readable media, removable recording media such as CD-ROM can be used. In addition, as a medium for providing data of the program involved in the present invention via a communication line, a carrier wave is also used.

[0129] Furthermore, the detailed configuration and detailed operation of each device constituting the moving image processing system 100 can be appropriately changed without departing from the gist of the present invention.

Claims

1. A dynamic image processing device, comprising: A dynamic image acquisition unit, which acquires a dynamic image; a disease determination unit that determines a disease candidate based on the dynamic image; and The storage location determining unit determines a storage location of the moving image based on the disease candidates.

2. The dynamic image processing device according to claim 1, wherein: The disease determination unit determines the disease candidate based on the analysis result of the moving image.

3. The dynamic image processing device according to claim 2, wherein: The disease determination unit determines the disease candidates based on imaging instruction information.

4. The dynamic image processing device according to claim 1, wherein: The disease determination unit determines the disease candidates using machine learning.

5. The dynamic image processing device according to claim 1, wherein: The storage location determination unit determines moving images of the same disease candidate to be stored in the same location.

6. The dynamic image processing device according to claim 1, wherein: The dynamic image processing device includes a transmission unit for transmitting the dynamic image to the outside. The storage location determination unit determines a destination to which the moving image is to be transmitted based on the disease candidates.

7. A dynamic image processing method, comprising: In a dynamic image processing device for processing dynamic images, A dynamic image acquisition step of acquiring a dynamic image; A disease determination step of determining a disease candidate based on the dynamic image; as well as A storage location determination step of determining a storage location of the moving image based on the disease candidates.

8. A program for causing a computer of a moving image processing device for processing moving images to function as the following means: A dynamic image acquisition unit, which acquires a dynamic image; a disease determination unit that determines a disease candidate based on the dynamic image; and The storage location determining unit determines a storage location of the moving image based on the disease candidates.

Images