Dynamic image processing device, dynamic image processing method and program

Abstract

To make it possible to build teaching file information more easily.SOLUTION: A dynamic image processing device (a diagnostic console 3) includes: a dynamic image acquisition part (a control part 31) acquiring a dynamic image; a disease determination part (the control part 31) determining disease candidates on the basis of the dynamic image; and a storage place determination part (the control part 31) determining a storage place of the dynamic image on the basis of the disease candidates.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a moving image processing apparatus, a moving image processing method, and a program.

Background Art

[0002] Conventionally, case collections (teaching files) are created for the purpose of improving the knowledge of students and trainee doctors. In addition, case collections are often created mainly using still images.

[0003] Currently, moving images are also beginning to be used in case collections. In addition, Patent Document 1 describes searching for similar case images from moving images.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, since moving images have a larger amount of information than still images, it is not possible to efficiently organize moving images, and it takes time to create a teaching file.

[0006] An object of the present invention is to more easily construct teaching file information using moving images.

Means for Solving the Problems

[0007] To solve the above problems, a moving image processing apparatus according to the present invention includes: a moving image acquisition unit that acquires a moving image; a disease determination unit that determines disease candidates based on the moving image; A storage location determination unit that determines the storage location of the dynamic image based on the disease candidate; is provided.

[0008] Also, in order to solve the above problems, a dynamic image processing method according to the present invention includes: in a dynamic image processing apparatus that processes a dynamic image, a dynamic image acquisition step of acquiring a dynamic image, a disease determination step of determining a disease candidate based on the dynamic image, a storage location determination step of determining the storage location of the dynamic image based on the disease candidate. is included.

[0009] Also, in order to solve the above problems, a program according to the present invention causes a computer of a dynamic image processing apparatus that processes a dynamic image to function as: a dynamic image acquisition unit that acquires a dynamic image, a disease determination unit that determines a disease candidate based on the dynamic image, a storage location determination unit that determines the storage location of the dynamic image based on the disease candidate. and function as such.

Advantages of the Invention

[0010] According to the present invention, teaching file information can be constructed more easily.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Embodiments for Carrying Out the Invention

[0012] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.

[0013] 〔Configuration of the Moving Image Processing System 100〕 Fig. 1 shows the overall configuration of the moving image processing system 100 in this embodiment. As shown in Fig. 1, in the moving image processing system 100, a photographing device 1 and a photographing console 2 are connected by a communication cable or the like, and the photographing console 2, a diagnostic console 3 as a moving image processing device, and a case management server 4 are connected via a communication network NT such as a LAN (Local Area Network).

[0014] 〔Configuration of the Photographing Device 1〕 The photographing device 1 is, for example, photographing means for photographing the dynamic state of a subject having periodicity, such as the morphological changes of the lungs during breathing movement and the expansion and contraction, and the pulsation of the heart. Dynamic photographing means irradiating a subject with radiation such as X-rays in a pulsed manner at predetermined time intervals (pulse irradiation) or continuously irradiating at a low dose rate without interruption (continuous irradiation) to obtain a plurality of images. That is, dynamic photographing is continuously performing radiation photographing of the dynamic state of a target part having periodicity along the time axis. Note that dynamic photographing may be performed not only using radiation such as X-rays but also using ultrasonic waves or magnetism. Dynamic photographing includes video photographing, but does not include photographing a still image while displaying a video. Also, a series of images obtained by dynamic photographing is called a moving image. Also, a moving image can be obtained, for example, by photographing using a semiconductor image sensor such as an FPD (Flat Panel Detector). Also, a moving image includes a video, but does not include an image obtained by photographing a still image while displaying a video. Each of the plurality of images constituting the moving image is called a frame image. In the following embodiments, the case of performing dynamic photographing by pulse irradiation will be taken as an example for explanation. Also, in the following embodiments, the case where the subject M is the chest of a subject will be taken as an example for explanation, but it is not limited thereto.

[0015] The radiation source 11 is disposed at a position facing the radiation detection unit 13 with the subject M interposed therebetween, and irradiates the subject M with radiation (X-rays) according to the control of the radiation irradiation control device 12. The radiation irradiation control device 12 is connected to the imaging console 2, and controls the radiation source 11 based on the radiation irradiation conditions input from the imaging console 2 to perform radiation imaging. The radiation irradiation conditions are, for example, pulse rate, pulse width, pulse interval, number of imaging frames per imaging, value of X-ray tube current, value of X-ray tube voltage, additional filter type, etc. The pulse rate is the number of radiation irradiations per second, and is consistent with the frame rate described later. The pulse width is the radiation irradiation time per radiation irradiation. The pulse interval is the time from the start of one radiation irradiation to the start of the next radiation irradiation, and is consistent with the frame interval described later.

[0016] The radiation detection unit 13 is composed of a semiconductor image sensor such as an FPD. The FPD has, for example, a glass substrate, etc., and at a predetermined position on the substrate, a plurality of detection elements (pixels) that detect the radiation irradiated from the radiation source 11 and transmitted through at least the subject M according to its intensity, convert the detected radiation into an electrical signal, and accumulate it are arranged in a matrix. Each pixel is configured to include a switching unit such as a TFT (Thin Film Transistor). The FPD has an indirect conversion type that converts X-rays into an electrical signal by a photoelectric conversion element via a scintillator, and a direct conversion type that directly converts X-rays into an electrical signal, and either one can be used. In the present embodiment, the pixel value (signal value) of the image data generated in the radiation detection unit 13 is a density value, and the higher the radiation transmission amount, the higher the value. The radiation detection unit 13 is provided so as to face the radiation source 11 with the subject M interposed therebetween.

[0017] The reading control device 14 is connected to the imaging console 2. The reading control device 14 controls the switching units of the respective pixels of the radiation detection unit 13 based on the image reading conditions input from the imaging console 2, switches the reading of the electrical signals accumulated in the respective pixels, and reads the electrical signals accumulated in the radiation detection unit 13 to acquire image data. This image data is a frame image. Then, the reading control device 14 assigns an identification ID and a frame number, and outputs the acquired frame image to the imaging console 2. The image reading conditions are, for example, frame rate, frame interval, pixel size, image size (matrix size), etc. The frame rate is the number of frame images acquired per second and matches the pulse rate. The frame interval is the time from the start of the acquisition operation of one frame image to the start of the acquisition operation of the next frame image and matches the pulse interval.

[0018] Here, the radiation irradiation control device 12 and the reading control device 14 are connected to each other and exchange synchronization signals to synchronize the radiation irradiation operation and the image reading operation.

[0019] 〔Configuration of Imaging Console 2〕 The imaging console 2 outputs radiation irradiation conditions and image reading conditions to the imaging device 1 to control the radiation imaging and the radiation image reading operation by the imaging device 1. As shown in FIG. 1, the imaging console 2 includes a control unit 21, a storage unit 22, an operation unit 23, a display unit 24, and a communication unit 25, and each unit is connected by a bus 26.

[0020] The control unit 21 is composed of a CPU (Central Processing Unit), a RAM (Random Access Memory), etc. The CPU of the control unit 21 reads out the system program and various processing programs stored in the storage unit 22 according to the operation of the operation unit 23, expands them in the RAM, and executes various processes including shooting control processing according to the expanded programs, and centrally controls the operations of each part of the shooting console 2, and the radiation irradiation operation and reading operation of the imaging device 1.

[0021] The storage unit 22 is composed of a non-volatile semiconductor memory, a hard disk, etc. The storage unit 22 stores various programs executed by the control unit 21, parameters necessary for executing the processes by the programs, or data such as processing results. For example, the storage unit 22 stores a program for executing shooting control processing. The various programs are stored in the form of readable program codes, and the control unit 21 sequentially executes operations according to the program codes. Specifically, the storage unit 22 stores a series of frame images (moving images) with identification IDs and frame numbers attached, output from the imaging device 1. In addition, the storage unit 22 stores shooting order information. The shooting order information is attached to a series of frame images (moving images) and stored in the storage unit 22. The shooting order information is radiation irradiation conditions (described above), image reading conditions (described above), subject information, examination information, etc. The subject information is, for example, the subject's name, height, weight, age, gender, etc. The examination information is, for example, the imaging site (such as the chest), the diagnosis target (ventilation, pulmonary blood flow, etc.), the examination purpose (lung cancer, pneumonia, etc.), etc.

[0022] The operation unit 23 includes a keyboard having cursor keys, numeric input keys, various function keys, etc., and a pointing device such as a mouse, and outputs an instruction signal input by a key operation or a mouse operation on the keyboard to the control unit 21. Further, the operation unit 23 may include a touch panel on the display screen of the display unit 24. In this case, the instruction signal input through the touch panel is output to the control unit 21. The imaging performer inputs the above imaging order information using the operation unit 23.

[0023] The display unit 24 is composed of a monitor such as an LCD (Liquid Crystal Display) or a CRT (Cathode Ray Tube), and displays an input instruction, data, etc. from the operation unit 23 according to an instruction of a display signal input from the control unit 21.

[0024] The communication unit 25 includes a LAN adapter, a modem, a TA (Terminal Adapter), etc., and controls data transmission and reception with each device connected to the communication network NT.

[0025] 〔Configuration of the diagnostic console 3〕 The diagnostic console 3 (dynamic image processing device) acquires and displays a dynamic image from the imaging console 2. As described above, imaging order information is attached to the dynamic image. As shown in FIG. 1, the diagnostic console 3 includes a control unit 31, a storage unit 32, an operation unit 33, a display unit 34, and a communication unit 35, and each unit is connected by a bus 36.

[0026] The control unit 31 is composed of a CPU, a RAM, etc. The CPU of the control unit 31 reads out a system program and various processing programs stored in the storage unit 32 according to an operation of the operation unit 33, expands them in the RAM, and executes various processes according to the expanded programs. Further, the CPU of the control unit 31 reads out a program 32a stored in the storage unit 32, expands it in the RAM, and executes image display processing described later according to the expanded program 32a. Further, the control unit 31 functions as a moving image acquisition unit that acquires a moving image. Further, the control unit 31 functions as a disease determination unit that determines a disease candidate based on the moving image. Further, the control unit 31 functions as a storage location determination unit that determines a storage location of the moving image based on the disease candidate.

[0027] The storage unit 32 is composed of a non-volatile semiconductor memory, a hard disk, or the like. The storage unit 32 stores a program 32a for executing image display processing by the control unit 31, various programs, parameters necessary for executing processing by the programs, or data such as processing results. These various programs are stored in the form of readable program codes, and the control unit 31 sequentially executes operations according to the program codes. In addition, the storage unit 32 stores the moving image acquired from the imaging console 2 and the accompanying imaging order information.

[0028] The operation unit 33 includes a keyboard having cursor keys, numeric input keys, and various function keys, and a pointing device such as a mouse, and outputs an instruction signal input by a key operation on the keyboard or a mouse operation to the control unit 31. Further, the operation unit 33 may include a touch panel on the display screen of the display unit 34. In this case, the instruction signal input via the touch panel is output to the control unit 31.

[0029] The display unit 34 is composed of a monitor such as an LCD or a CRT, and performs various displays according to an instruction of a display signal input from the control unit 31. The display unit 34 functions as a display unit that can display and compare a first moving image and a second moving image including a complementary image.

[0030] The communication unit 35 includes a LAN adapter, a modem, a TA, or the like, and controls data transmission and reception with each device connected to the communication network NT. The communication unit 35 functions as a transmission unit that transmits the moving image to the outside.

[0031] 〔Configuration of Case Management Server 4〕 The case management server 4 is a device that stores and manages the dynamic images (cases) transmitted from the diagnostic console 3. As described above, the shooting order information is attached to the dynamic images. As shown in FIG. 1, the case management server 4 includes a control unit 41, a storage unit 42, and a communication unit 43, and each unit is connected by a bus 44.

[0032] The control unit 41 is composed of a CPU, a RAM, etc. The CPU of the control unit 41 reads out the system program and various processing programs stored in the storage unit 42, expands them in the RAM, and executes various processes according to the expanded programs.

[0033] The storage unit 42 is composed of a non-volatile semiconductor memory, a hard disk, etc. The storage unit 42 stores various programs, parameters necessary for executing processes by the programs, or data such as processing results. These various programs are stored in the form of readable program codes, and the control unit 41 sequentially executes operations according to the program codes. Also, in the storage unit 42, the dynamic images transmitted from the diagnostic console 3 are stored in the storage locations (storage location 42A, storage location 42B,...) determined by the control unit 31. For example, the dynamic image of "disease candidate; lung cancer" is stored in storage location 42A, and the dynamic image of "disease candidate; pneumonia" is stored in storage location 42B.

[0034] The communication unit 43 includes a LAN adapter, a modem, a TA, etc., and controls data transmission and reception with each device connected to the communication network NT.

[0035] 〔Disease Candidate Judgment Process〕 Next, with reference to FIG. 2, the disease candidate judgment process in the diagnostic console 3 will be described. The disease candidate judgment process is a process of judging disease candidates from dynamic images. It is assumed that the dynamic images are already stored in the storage unit 32 of the diagnostic console 3.

[0036] First, the control unit 31 acquires a moving image from the storage unit 32 (step S1). As described above, shooting order information is attached to the moving image. Note that in steps S2 and later, if the shooting order information is not used, the control unit 31 does not have to acquire the shooting order information.

[0037] Next, the control unit 31 determines disease candidates from the moving image (step S2). For example, the control unit 31 extracts feature amounts from the moving image using machine learning, and determines disease names with a similarity equal to or higher than a predetermined value as disease candidates. Also, for example, the control unit 31 may extract the shooting site, diagnosis target, and examination purpose included in the shooting order information in addition to the feature amounts from the moving image using machine learning, and determine disease candidates. Also, for example, the control unit 31 may refer to the examination purpose included in the shooting order information, and add the disease information included in the examination purpose to the disease candidates. Note that the learning model used for machine learning is assumed to be stored in the storage unit 32 before the disease candidate determination process. Also, in the above, the disease candidates are determined using machine learning, but the present invention is not limited to this.

[0038] Next, the control unit 31 determines the storage location of the moving image based on the disease candidates (step S3). When the control unit 31 determines the storage location, it transmits the moving image to the storage location via the communication unit 35 (step S4). For example, the control unit 31 determines the moving images of the same disease candidate as the same storage location. If a storage location corresponding to the disease candidate has been created in advance, that storage location is used as the storage location. If a storage location corresponding to the disease candidate has not been created, a new storage location is created in the storage unit 42, and that storage location is used as the storage location.

[0039] 〔Others〕 In the above description, the disease candidate determination process is executed by the control unit 31 of the diagnostic console 3, but it may also be executed by the control unit 41 of the case management server 4.

[0040] Also, the diagnostic console 3 and the case management server 4 are not limited to one, and there may be a plurality of them. Further, the diagnostic console 3 and the case management server 4 are not limited to being arranged within the hospital, and may be arranged outside the hospital.

[0041] 〔Effect〕 As described above, the dynamic image processing device (diagnostic console 3) includes a dynamic image acquisition unit (control unit 31) that acquires a dynamic image, a disease determination unit (control unit 31) that determines disease candidates based on the dynamic image, and a storage location determination unit (control unit 31) that determines the storage location of the dynamic image based on the disease candidates. Therefore, it is possible to more easily construct teaching file information. Recently, the progress of machine learning including AI has been remarkable. Therefore, it is considered that the number of disease candidates determined from dynamic images will increase. Thus, if the user manually determines the storage location and creates a teaching file for each increasing disease candidate, it is assumed to be very time-consuming. The diagnostic console 3 can prevent such a situation.

[0042] Also, the disease determination unit (control unit 31) determines disease candidates based on the analysis result of the dynamic image. Therefore, it is possible to more easily construct teaching file information.

[0043] In addition, the disease determination unit (control unit 31) also determines disease candidates based on the imaging order information. Therefore, it is possible to more easily construct teaching file information. That is, when performing an examination for a specific disease, it is not necessarily the case that the patient has the specific disease. For example, when performing an examination for "lung cancer" on a certain patient, there is a possibility that the patient does not have "lung cancer". On the other hand, from the dynamic image, "pneumonia" may also be determined as a disease candidate for that patient. In such a case, "lung cancer", which is the examination objective, can also be added as a disease candidate.

[0044] Also, the disease determination unit (control unit 31) determines disease candidates using machine learning. Therefore, teaching file information can be constructed more easily.

[0045] In addition, the dynamic image processing apparatus (diagnostic console 3) includes a transmission unit (communication unit 35) that transmits the dynamic image externally, and the storage location determination unit determines the transmission destination for transmitting the dynamic image based on the disease candidates. Therefore, even when a plurality of diagnostic consoles 3 are connected to the dynamic image processing system 100, teaching file information can be constructed more easily.

[0046] The dynamic image processing method also includes a dynamic image acquisition step (step S1) of acquiring a dynamic image in a dynamic image processing apparatus that processes the dynamic image, a disease determination step (step S2) of determining disease candidates based on the dynamic image, and a storage location determination step (step S3) of determining the storage location of the dynamic image based on the disease candidates. Therefore, teaching file information can be constructed more easily.

[0047] The program also causes the computer of the dynamic image processing apparatus (diagnostic console 3) that processes the dynamic image to function as a dynamic image acquisition unit (control unit 31) that acquires the dynamic image, a disease determination unit (control unit 31) that determines disease candidates based on the dynamic image, and a storage location determination unit (control unit 31) that determines the storage location of the dynamic image based on the disease candidates. Therefore, teaching file information can be constructed more easily.

[0048] Note that the description in this embodiment is an example of a suitable moving image processing system according to the present invention and is not limited thereto. For example, in the above description, an example of constructing teaching file information was disclosed. However, as a storage location for moving images, an external network folder can be determined, and the moving images can be stored in the folder, so that it is also possible to request a specialist such as a remote radiologist for reading.

[0049] Also, in the above description, an example of using a hard disk, a semiconductor non-volatile memory, etc. as a computer-readable medium for the program according to the present invention was disclosed, but it is not limited to this example. As other computer-readable media, portable recording media such as CD-ROM can be applied. Also, a carrier wave is applied as a medium for providing the data of the program according to the present invention via a communication line.

[0050] In addition, regarding the detailed configuration and detailed operations of each device constituting the moving image processing system 100, they can be appropriately changed within the scope not departing from the gist of the present invention.

Explanation of Reference Numerals

[0051] 100 Moving image processing system 1 Imaging device 11 Radiation source 12 Radiation irradiation control device 13 Radiation detection unit 14 Reading control device 2 Imaging console 21 Control unit 22 Storage unit 23 Operation unit 24 Display unit 25 Communication unit 26 Bus 3 Diagnostic console (moving image processing device) 31 Control unit 32 Storage unit 33 Operation unit 34 Display unit 35 Communication unit (transmission unit) 36 buses 4 case management servers 41 Control Unit 42 Memory Unit 42A Storage Location 42B Storage Location 43 Communication Unit

Claims

1. A moving image acquisition unit that acquires a moving image, A disease determination unit that determines a disease candidate based on the moving image, A storage location determination unit that determines the storage location of the moving image based on the disease candidate, A moving image processing apparatus comprising the above.

2. The moving image processing apparatus according to claim 1, wherein the disease determination unit determines the disease candidate based on an analysis result of the moving image.

3. The moving image processing apparatus according to claim 2, wherein the disease determination unit determines the disease candidate based on imaging order information.

4. The moving image processing apparatus according to claim 1, wherein the disease determination unit determines the disease candidate using machine learning.

5. The moving image processing apparatus according to claim 1, wherein the storage location determination unit determines the same storage location for moving images of the same disease candidate.

6. Comprising a transmission unit that transmits the moving image to the outside, The moving image processing apparatus according to claim 1, wherein the storage location determination unit determines a transmission destination for transmitting the moving image based on the disease candidate.

7. In a moving image processing apparatus that processes a moving image, A moving image acquisition step of acquiring a moving image, A disease determination step of determining a disease candidate based on the moving image, A storage location determination step of determining the storage location of the moving image based on the disease candidate, A moving image processing method including the above.

8. A computer of a moving image processing apparatus that processes a moving image, A moving image acquisition unit that acquires a moving image, A disease determination unit that determines a disease candidate based on the moving image, A storage location determination unit that determines the storage location of the dynamic image based on the disease candidate. A program that functions as such.

Images