Medical image processing device, and medical image processing method

Abstract

To reduce burden in searching an event contained in a video.SOLUTION: A medical image processing device according to an embodiment includes: an acquiring part; a setting part; a detection part; an image generation part; and a display control part. The acquiring part acquires a medical video which is a video for medical purpose. The setting part sets a detection target of the medical video. The detection part detects the event related to the detection target contained in the medical video. The image generation part generates an operation image on which an icon is arranged that receives an operation of displaying the event detected by the detection part on a slider bar containing a start point and an end point of the change of the detection target. The display control part displays he medical video and the operation image on the display part.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The embodiments disclosed in this specification and the drawings relate to a medical image processing apparatus and a medical image processing method.

[0002] BACKGROUND ART Conventionally, medical image processing apparatuses may display moving images having a plurality of frames, such as CT fluoroscopic images captured by an X-ray CT (Computed Tomography) apparatus.

[0003] The medical image processing apparatus can then fast forward the video and display frames at timings specified by a slider bar.

[0004] However, in order to display characteristic events contained in the video, medical personnel have had to fast-forward the video or search for the events using a slider bar. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 2018-050768 Summary of the Invention [Problem to be solved by the invention]

[0006] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to reduce the effort required to search for events included in a video. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problem. Problems corresponding to the effects of the configurations described in the embodiments below can also be considered as other problems. [Means for solving the problem]

[0007] A medical image processing apparatus according to an embodiment includes an acquisition unit, a setting unit, a detection unit, an image generation unit, and a display control unit. The acquisition unit acquires a medical video, which is a medical video. The setting unit sets a detection target for the medical video. The detection unit detects an event related to the detection target included in the medical video. The image generation unit generates an operation image in which icons for accepting operations to display the event detected by the detection unit are arranged on a slider bar that includes start and end points of a change in the detection target. The display control unit displays the medical video and the operation image on a display unit. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an X-ray CT apparatus according to the first embodiment. [Figure 2] FIG. 2 is a diagram showing an example of an operation image. [Figure 3] FIG. 3 is a flowchart showing an example of display processing executed by the X-ray CT apparatus according to the first embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a superimposed image. [Figure 5] FIG. 5 is a diagram showing an example of the configuration of an X-ray CT apparatus according to the second embodiment. [Figure 6] FIG. 6 is a diagram showing an example of a superimposed image. [Figure 7] FIG. 7 is a diagram showing an example of a superimposed image. [Figure 8] FIG. 8 is a diagram showing an example of the configuration of an X-ray CT apparatus according to the third embodiment. [Figure 9] FIG. 9 is a diagram showing an example of the configuration of an X-ray CT apparatus according to the fourth embodiment. [Figure 10] FIG. 10 is a diagram showing an example of a superimposed image. [Figure 11] FIG. 11 is a diagram showing an example of a superimposed image. [Figure 12] FIG. 12 is a diagram showing an example of an operation image. [Figure 13]FIG. 13 is a diagram showing an example of the progress image. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, a medical image processing apparatus and a medical image processing method according to the present embodiment will be described with reference to the drawings. In the following embodiments, parts with the same reference numerals perform similar operations, and redundant explanations will be omitted as appropriate.

[0010] (First embodiment) 1 is a diagram showing an example of the configuration of an X-ray CT apparatus 1 according to the first embodiment. As shown in FIG. 1, the X-ray CT apparatus 1 according to the first embodiment includes a gantry device 10, a bed device 30, and a console device 40.

[0011] 1, the rotation axis of the rotating frame 13 in a non-tilted state or the longitudinal direction of the tabletop 33 of the bed device 30 is defined as the Z-axis direction. The axial direction that is perpendicular to the Z-axis direction and horizontal to the floor surface is defined as the X-axis direction. The axial direction that is perpendicular to the Z-axis direction and the X-axis direction and perpendicular to the floor surface is defined as the Y-axis direction. For the sake of explanation, FIG. 1 depicts the gantry device 10 from multiple directions, and shows a case where the X-ray CT device 1 has one gantry device 10.

[0012] The gantry 10 includes an X-ray tube 11, an X-ray detector 12, a rotating frame 13, an X-ray high voltage device 14, a control device 15, a wedge 16, a collimator 17, and a DAS (Data Acquisition System) 18. The gantry 10 is also called a gantry.

[0013] The X-ray tube 11 is a vacuum tube having a cathode (filament) that generates thermoelectrons and an anode (target) that generates X-rays upon impact of the thermoelectrons. The X-ray tube 11 generates X-rays to be irradiated onto the subject P by irradiating thermoelectrons from the cathode toward the anode when a high voltage is applied from the X-ray high voltage device 14. That is, the X-ray tube 11 generates X-rays according to the tube voltage and tube current applied from the X-ray high voltage device 14. For example, the X-ray tube 11 may be a rotating anode type X-ray tube that generates X-rays by irradiating a rotating anode with thermoelectrons.

[0014] The X-ray detector 12 detects X-rays emitted from the X-ray tube 11 and passing through the subject P, and outputs a signal corresponding to the detected X-ray dose to the DAS 18. The X-ray detector 12 has, for example, a plurality of detector element rows in which a plurality of detector elements are arranged in a channel direction (channel direction) along an arc centered on the focal point of the X-ray tube 11. The X-ray detector 12 has, for example, a structure in which a plurality of detector element rows in which a plurality of detector elements are arranged in the channel direction are arranged in a row direction (slice direction, row direction).

[0015] For example, the X-ray detector 12 is an indirect conversion type detector having a grid, a scintillator array, and a photosensor array. The scintillator array has multiple scintillators. The scintillator has scintillator crystals that output light with a photon amount corresponding to the amount of incident X-rays. The grid is arranged on the X-ray incident side of the scintillator array and has an X-ray shielding plate that absorbs scattered X-rays. The grid is sometimes called a collimator (one-dimensional collimator or two-dimensional collimator). The photosensor array has a function of converting the amount of light from the scintillator into an electrical signal corresponding to the amount of light, and has a photosensor such as a photodiode. The X-ray detector 12 may also be a direct conversion type detector having a semiconductor element that converts incident X-rays into an electrical signal.

[0016] The rotating frame 13 is an annular frame that supports the X-ray tube 11 and the X-ray detector 12 so that they face each other and rotates the X-ray tube 11 and the X-ray detector 12 using the control device 15. For example, the rotating frame 13 is an aluminum casting. In addition to the X-ray tube 11 and the X-ray detector 12, the rotating frame 13 can also support an X-ray high-voltage device 14, a wedge 16, a collimator 17, a DAS 18, etc. The rotating frame 13 can also support various components not shown in FIG. 1 . The various components supported by the rotating frame 13 will be described later. The rotating frame 13 is also referred to as a rotating base, a rotating body, etc. In addition, the rotating frame 13 and the parts of the gantry device 10 that rotate together with the rotating frame 13 are also referred to as a rotating part.

[0017] X-ray high voltage device 14 has electrical circuits such as a transformer and a rectifier, and includes a high-voltage generator that generates a high voltage to be applied to X-ray tube 11, and an X-ray control device that controls the output voltage according to the X-rays generated by X-ray tube 11. That is, X-ray high voltage device 14 controls the tube voltage and tube current applied to X-ray tube 11. The high-voltage generator may be of a transformer type or an inverter type. X-ray high voltage device 14 may be provided on rotating frame 13 or on a fixed frame (not shown).

[0018] The control device 15 has a processing circuit having a CPU (Central Processing Unit) and the like, and a driving mechanism such as a motor and an actuator. The control device 15 receives input signals from the input interface 43 and controls the operation of the gantry device 10 and the bed device 30. For example, the control device 15 controls the rotation of the rotating frame 13, the tilt of the gantry device 10, the operation of the bed device 30 and the tabletop 33, etc. The control device 15 may be provided in the gantry device 10 or in the console device 40.

[0019] The wedge 16 is a filter for adjusting the amount of X-rays irradiated from the X-ray tube 11. Specifically, the wedge 16 is a filter that transmits and attenuates the X-rays irradiated from the X-ray tube 11 so that the distribution of X-rays irradiated from the X-ray tube 11 to the subject P becomes a predetermined distribution. For example, the wedge 16 is a wedge filter or a bow-tie filter, which is a filter made of aluminum or the like processed to have a predetermined target angle and a predetermined thickness.

[0020] The collimator 17 is a lead plate or the like for narrowing the irradiation range of the X-rays that have passed through the wedge 16, and a slit is formed by combining a plurality of lead plates or the like. The collimator 17 is also sometimes called an X-ray aperture. Although FIG. 1 shows a case where the wedge 16 is disposed between the X-ray tube 11 and the collimator 17, the collimator 17 may also be disposed between the X-ray tube 11 and the wedge 16. In this case, the wedge 16 transmits and attenuates the X-rays that are irradiated from the X-ray tube 11 and whose irradiation range has been limited by the collimator 17.

[0021] The DAS 18 collects X-ray signals detected by each detection element of the X-ray detector 12. For example, the DAS 18 has an amplifier that amplifies the electrical signal output from each detection element, and an A / D converter that converts the electrical signal into a digital signal, and generates detection data.

[0022] The data generated by the DAS 18 is transmitted by optical communication from a transmitter having a light emitting diode (LED) provided on the rotating frame 13 to a receiver having a photodiode provided on a non-rotating part of the gantry 10 (for example, a fixed frame, etc., not shown in FIG. 1 ), and then transferred to the console device 40. Here, the non-rotating part is, for example, a fixed frame that rotatably supports the rotating frame 13. Note that the method of transmitting data from the rotating frame 13 to the non-rotating part of the gantry 10 is not limited to optical communication, and any non-contact data transmission method or a contact data transmission method may be employed.

[0023] The bed device 30 is a device on which the subject P to be imaged is placed and moved, and includes a base 31, a bed driving device 32, a top plate 33, and a support frame 34. The base 31 is a housing that supports the support frame 34 so that it can move in the vertical direction. The bed driving device 32 is a drive mechanism that moves the top plate 33, on which the subject P is placed, in the longitudinal direction of the top plate 33, and includes a motor, an actuator, etc. The top plate 33, which is provided on the upper surface of the support frame 34, is a plate on which the subject P is placed. Note that the bed driving device 32 may move the support frame 34 in addition to the top plate 33 in the longitudinal direction of the top plate 33.

[0024] The console device 40 has a memory 41, a display 42, an input interface 43, and a processing circuit 44. Although the console device 40 will be described as being separate from the gantry device 10, the gantry device 10 may include the console device 40 or some of the components of the console device 40.

[0025] The memory 41 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory), a flash memory, a hard disk, an optical disk, etc. The memory 41 stores, for example, projection data and CT image data. Furthermore, for example, the memory 41 stores programs that enable circuits included in the X-ray CT apparatus 1 to realize various functions. The memory 41 may also be realized by a group of servers (cloud) connected to the X-ray CT apparatus 1 via a network.

[0026] The display 42 displays various types of information. For example, the display 42 displays various images generated by the processing circuitry 44, or displays a GUI (Graphical User Interface) for receiving various operations from the operator. For example, the display 42 is a liquid crystal display or a CRT (Cathode Ray Tube) display. The display 42 may be a desktop type, or may be configured as a tablet terminal or the like capable of wireless communication with the console device 40 main body.

[0027] The input interface 43 may be realized by a mouse, keyboard, trackball, switch, button, joystick, touchpad that performs input operations by touching the operation surface, a touchscreen that integrates a display screen and a touchpad, a non-contact input circuit using an optical sensor, a voice input circuit, etc. The input interface 43 may be provided in the gantry device 10. The input interface 43 may also be configured as a tablet terminal or the like that is capable of wireless communication with the console device 40 main body. The input interface 43 is not limited to those that have physical operation components such as a mouse and keyboard. For example, an example of the input interface 43 includes an electrical signal processing circuit that receives an electrical signal corresponding to an input operation from an external input device provided separately from the console device 40 and outputs the electrical signal to the processing circuit 44.

[0028] The processing circuitry 44 controls the overall operation of the X-ray CT apparatus 1. For example, the processing circuitry 44 executes a system control function 441, a pre-processing function 442, a reconstruction processing function 443, an image acquisition function 444, a target setting function 445, an event detection function 446, an image generation function 447, and a display control function 448. For example, the processing functions executed by the system control function 441, the pre-processing function 442, the reconstruction processing function 443, the image acquisition function 444, the target setting function 445, the event detection function 446, the image generation function 447, and the display control function 448, which are components of the processing circuitry 44 shown in FIG. 1, are recorded in the memory 41 in the form of a computer-executable program. The processing circuitry 44 is, for example, a processor, which reads and executes each program from the memory 41 to realize a function corresponding to the read program. In other words, the processing circuitry 44 in a state in which each program has been read has each function shown in the processing circuitry 44 of FIG. 1.

[0029] 1 has been described as realizing the processing functions performed by the system control function 441, preprocessing function 442, reconstruction processing function 443, image acquisition function 444, target setting function 445, event detection function 446, image generation function 447, and display control function 448 using a single processor, but it is also possible to combine multiple independent processors to configure the processing circuit 44 and have each processor execute a program to realize the function. Also, it is also possible to configure the processing circuit 44 to store a program corresponding to each processing function using a single memory 41, but it is also possible to disperse multiple memories 41 and have the processing circuit 44 read out the corresponding program from each memory 41.

[0030] The term "processor" used in the above description refers to circuits such as a CPU (Central Processing Unit), a GPU (Graphical Processing Unit), an Application Specific Integrated Circuit (ASIC), a programmable logic device (e.g., a Simple Programmable Logic Device (SPLD), a Complex Programmable Logic Device (CPLD), and a Field Programmable Gate Array (FPGA)). The processor realizes its functions by reading and executing a program stored in memory 41. Note that instead of storing a program in memory 41, the processor may be configured so that the program is directly embedded in its circuitry. In this case, the processor realizes its functions by reading and executing the program embedded in its circuitry.

[0031] The system control function 441 controls various functions of the processing circuit 44 based on an input operation received from an operator via the input interface 43. The system control function 441 is an example of a control unit.

[0032] The pre-processing function 442 generates data by performing pre-processing such as logarithmic conversion, offset correction, inter-channel sensitivity correction, and beam hardening correction on the detection data output from the DAS 18. Note that the data before pre-processing (detection data) and the data after pre-processing may be collectively referred to as projection data. The pre-processing function 442 is an example of a pre-processing unit.

[0033] The reconstruction processing function 443 performs reconstruction processing using a filtered back projection method, an iterative reconstruction method, or the like on the projection data generated by the preprocessing function 442 to generate CT image data. The reconstruction processing function 443 is also an example of a reconstruction processing unit. Based on an input operation received from an operator via the input interface 43, the reconstruction processing function 443 converts the CT image data generated by the reconstruction processing function 443 into tomographic image data of an arbitrary cross section or three-dimensional image data using a known method. The generation of three-dimensional image data may also be performed directly by the reconstruction processing function 443. The reconstruction processing function 443 is also an example of an image processing unit.

[0034] The image acquisition function 444 acquires a medical video, which is a medical video. The image acquisition function 444 is an example of an acquisition unit. A medical video has multiple frames. A frame is a still image and is a medical image. For example, a medical image is a cross-sectional image of CT image data generated by the reconstruction processing function 443 in CT fluoroscopy. That is, the image acquisition function 444 acquires a medical video in which the cross-sectional images included in the CT image data generated by the reconstruction processing function 443 in CT fluoroscopy are switched every time a period according to the frame rate elapses. In addition, the medical video includes, for example, a video generated from multiple fluoroscopic images obtained by continuously irradiating X-rays onto the subject P, a video generated from four-dimensional CT images obtained by continuously performing CT imaging, a video obtained by imaging the subject P with an optical camera, etc.

[0035] The target setting function 445 sets a detection target in the medical video. In other words, the target setting function 445 sets a video display axis to be displayed as an axis of the medical video. The target setting function 445 is an example of a setting unit. More specifically, the target setting function 445 sets a detection target to be detected as a tracking target in the medical video.

[0036] For example, when a needle such as a trocar, a biopsy needle, or a puncture needle is inserted into the subject P, the target setting function 445 sets the tip of the needle as the detection target. The target setting function 445 also sets the outer periphery of the ablation area in percutaneous radiofrequency ablation therapy as the detection target. The target setting function 445 may also set the following as detection targets: the placement position of a drain or coil, percutaneous marking, the state of abscess drainage, the state of percutaneous transhepatic biliary / gallbladder drainage, the state of no change after tumor coagulation in tumor treatment such as percutaneous radiofrequency ablation therapy, the state of bone cement injection being filled with cement after the start of bone cement injection, and the state of no change after a change in the target tumor due to an accident such as bleeding. The target setting function 445 may also set targets other than these as detection targets. The target setting function 445 may also set multiple detection targets, rather than just one.

[0037] The event detection function 446 detects an event related to a detection target included in the medical video acquired by the image acquisition function 444. The event detection function 446 is an example of a detection unit. An event is a state of a detection target included in the medical video. For example, an event is a state of a detection target that is set in advance in a treatment on a subject P in the medical video. That is, the event detection function 446 detects a state of a detection target that is set in advance from the medical video acquired by the image acquisition function 444.

[0038] For example, the event detection function 446 detects an event corresponding to the position of the tip of a needle inserted into the subject P in the medical video. More specifically, when a needle such as a trocar, biopsy needle, or puncture needle is inserted into the subject P, the event detection function 446 detects that the tip of the needle is at a predetermined position. Note that the event detection function 446 may detect other states in addition to the position of the tip of the needle. For example, the event detection function 446 may detect events such as placement of a drain or coil, percutaneous marking, and abscess drainage, as well as percutaneous transhepatic biliary and gallbladder drainage, a state in which tumor coagulation has occurred and no further change has occurred in tumor treatment such as percutaneous radiofrequency ablation therapy, a state in which bone cement injection has started and the target tumor has been filled with cement, and a state in which a change in the target tumor due to an accident such as bleeding has occurred and no further change has occurred.

[0039] Furthermore, the event detection function 446 generates detection information indicating the detection result. For example, the event detection function 446 generates detection information indicating a frame in which the position of the tip of the needle is at a predetermined position. Then, the event detection function 446 associates the detection information with the medical video. For example, the event detection function 446 may add detection information indicating whether or not an event is included in each frame included in the medical video, or may add detection information indicating a frame in which an event is included to the medical video.

[0040] The image generation function 447 generates an operation image G1 in which an icon for accepting an operation to display an event detected by the event detection function 446 is arranged on a slider bar G11 including the start and end points of a change in the detection target set by the target setting function 445. The image generation function 447 is an example of an image generation unit. That is, the image generation function 447 generates the operation image G1 based on the detection information generated by the event detection function 446.

[0041] FIG. 2 is a diagram showing an example of an operation image G1. The operation image G1 is an image that accepts an operation to specify a time point to display in a medical video. The operation image G1 has a close button G16, a slider bar G11, a first detection icon G12a, a second detection icon G12b, a third detection icon G12c, a fourth detection icon G12d, a fifth detection icon G12e, a reverse play button G13, a stop button G14, and a play button G15. The close button G16 is a button that accepts an operation to close the operation image G1. When the first detection icon G12a, the second detection icon G12b, the third detection icon G12c, the fourth detection icon G12d, and the fifth detection icon G12e are not distinguished from each other, they are referred to as detection icons G12.

[0042] The slider bar G11 is an image indicating the timing of the display of the medical video. The slider bar G11 includes a start time and an end time of the change of the detection target set by the target setting function 445. For example, the left end of the slider bar G11 indicates the start time of the change of the detection target, and the right end indicates the end time of the change of the detection target. For example, if the tip of a needle is set as the detection target, the start of the change of the detection target is when the tip of the needle is detected from the medical video, and the end of the change of the detection target is when the tip of the needle included in the medical video reaches the destination point. The detection icon G12 is an icon indicating an event detected by the event detection function 446 in the medical video. The detection icon G12 is placed on the slider bar G11 identified by the timing detected by the event detection function 446. As a result, the detection icon G12 becomes an icon indicating the timing of the occurrence of an event detected by the event detection function 446. When the detection icon G12 is selected, it is highlighted, for example, by changing its color, to notify the user that it has been selected. The operation image G1 shown in FIG. 2 notifies that an event corresponding to the fifth detection icon G12e is being displayed.

[0043] The reverse play button G13 is a button that accepts an operation to play the medical moving image in the reverse order of frame display. The stop button G14 is a button that accepts an operation to stop playback of the medical moving image. The play button G15 is a button that accepts an operation to play the medical moving image in the order of frame display.

[0044] The display control function 448 displays the medical moving image acquired by the image acquisition function 444 and the operation image G1 generated by the image generation function 447 on the display 42. The display control function 448 is an example of a display control unit. More specifically, the display control function 448 displays the medical moving image and the operation image G1 in which a detection icon G12 is added to a slider bar G11 indicating the timing of the medical moving image being displayed. The display control function 448 may superimpose the operation image G1 on the medical moving image, or may display it on the display 42 without superimposing it.

[0045] The display control function 448 also accepts an operation to press the detection icon G12 of the operation image G1. When the detection icon G12 of the operation image G1 is pressed, the display control function 448 displays a frame at the timing specified by the pressed detection icon G12. That is, the display control function 448 plays the medical video from the timing specified by the pressed detection icon G12.

[0046] Next, the display processing executed by the X-ray CT apparatus 1 will be described.

[0047] FIG. 3 is a flowchart showing an example of the display process executed by the X-ray CT apparatus 1 according to the first embodiment.

[0048] The image acquisition function 444 acquires a medical video (step S1).

[0049] The target setting function 445 sets a detection target in the medical video (step S2).

[0050] The event detection function 446 detects an event included in the medical video (step S3).

[0051] The image generating function 447 generates an operation image G1 based on the detection information generated by the event detecting function 446 (step S4).

[0052] The display control function 448 displays the acquired medical video and the generated operation image G1 on the display 42 (step S5).

[0053] The display control function 448 accepts an operation to press the detection icon G12 of the operation image G1 (step S6).

[0054] The display control function 448 displays the frame of the event corresponding to the detection icon G12 from among the medical moving images (step S7).

[0055] With the above, the X-ray CT apparatus 1 ends the display processing.

[0056] As described above, the X-ray CT apparatus 1 according to the first embodiment sets a detection target in a medical video, which is a medical video. The X-ray CT apparatus 1 also detects an event related to the detection target included in the medical video. The X-ray CT apparatus 1 also generates an operation image G1 in which a detection icon G12, which accepts an operation to display an event related to the detection target, is arranged on a slider bar G221 including a start time and an end time of a change in the detection target. The X-ray CT apparatus 1 then displays the medical video and the operation image G1 on the display 42. In this way, the X-ray CT apparatus 1 displays the event included in the medical video, which is specified by the operation image G1. Therefore, the X-ray CT apparatus 1 can reduce the effort required to search for an event included in the video.

[0057] (Variation 1) The X-ray CT apparatus 1 of the first modification example according to the first embodiment may superimpose an operation image G21 on the medical moving image. Fig. 4 is a diagram showing an example of the superimposed image G2. The superimposed image G2 is an image in which the operation image G21 is superimposed on the medical moving image.

[0058] The medical video is a CT fluoroscopic video capturing an image of a needle such as a trocar, a biopsy needle, or a puncture needle being inserted into the subject P. Therefore, the medical video includes a needle image G22 showing the needle inserted into the subject P.

[0059] The operation image G21 has a slider bar G221, a start icon G222, an end icon G223, a first detection icon G224a, a second detection icon G224b, a third detection icon G224c, a fourth detection icon G224d, and a fifth detection icon G224e. When the first detection icon G224a, the second detection icon G224b, the third detection icon G224c, the fourth detection icon G224d, and the fifth detection icon G224e are not distinguished from one another, they are referred to as the detection icons G224. When a detection icon G224 is selected, it is highlighted, for example by changing its color, to indicate that it has been selected. The operation image G21 shown in FIG. 4 indicates that an event corresponding to the fifth detection icon G224e is being displayed.

[0060] The slider bar G221 is a bar that indicates the time point at which the medical video is currently being displayed. The start icon G222 is an icon that indicates the start of the slider bar G221. In other words, the start icon G222 is an icon that indicates the start time point of a change in the detection target. The end icon G223 is an icon that indicates the end of the slider bar G221. In other words, the end icon G223 is an icon indicating the end point of the change in the detection target. The detection icon G224 is an icon that accepts an operation to display a frame of an event detected by the event detection function 446 in the medical video. The detection icon G224 is placed on the slider bar G221 that is specified by the timing detected by the event detection function 446. As a result, the detection icon G224 becomes an icon that indicates the timing when the event detected by the event detection function 446 occurred.

[0061] The event detection function 446 detects an event corresponding to at least one change in the position of the tip of the needle inserted into the subject P in the medical video and the position of the drain or coil. For example, the event detection function 446 detects whether the progress of the needle relative to the arrival point of the needle inserted into the subject P is a preset degree, such as in increments of 20%, where the arrival point is 100%. Specifically, the event detection function 446 detects whether the progress of the needle inserted into the subject P is 20%, 40%, 60%, 80%, or 100%. In this embodiment, an example in which the progress is in increments of 20% will be described. However, the progress degree is not limited to increments of 20%, and may be increments of 10%, 15%, or other intervals.

[0062] The image generation function 447 generates an operation image G21 based on detection information indicating the detection result detected by the event detection function 446. That is, the image generation function 447 generates a detection icon G224 indicating the timing at which an event detected by the event detection function 446 occurred. More specifically, the image generation function 447 superimposes the detection icon G224, which accepts an operation to display a frame corresponding to the progress degree of the hand, on the slider bar G221 specified by the timing at which the progress degree of the hand reaches a preset value.

[0063] For example, the image generation function 447 superimposes a first detection icon G224a, which accepts an operation to display a frame when the needle progresses to 20%, on the slider bar G221 corresponding to the timing when it is detected that the needle progress is 20%. Similarly, the image generation function 447 superimposes a second detection icon G224b, which accepts an operation to display a frame when the needle progress is 40%, on the slider bar G221 corresponding to the timing when it is detected that the needle progress is 40%. Similarly, the image generation function 447 superimposes a third detection icon G224c, which accepts an operation to display a frame when the needle progress is 60%, on the slider bar G221 corresponding to the timing when it is detected that the needle progress is 60%. Similarly, the image generation function 447 superimposes a fourth detection icon G224d, which accepts an operation to display a frame when the needle progresses to 80%, on the slider bar G221 corresponding to the timing when it is detected that the needle progress is 80%. Similarly, the image generation function 447 superimposes a fifth detection icon G224e, which accepts an operation to display a frame when the needle progress is 100%, on the slider bar G221 corresponding to the timing when it is detected that the needle progress is 100%.

[0064] The display control function 448 displays the medical video acquired by the image acquisition function 444 and the operation image G21 generated by the image generation function 447 on the display 42. When the detection icon G224 is pressed, the display control function 448 displays a frame of the medical video corresponding to the pressed detection icon G224.

[0065] (Second embodiment) The X-ray CT apparatus 1a according to the second embodiment detects events relating to a region that changes over time, and then generates an image that accepts an operation to display a frame of the detected event.

[0066] 5 is a diagram showing an example of the configuration of an X-ray CT apparatus 1a according to the second embodiment. A processing circuitry 44a of a console device 40a included in the X-ray CT apparatus 1a has an event detection function 446a, an image generation function 447a, and a display control function 448a as characteristic functions in the second embodiment.

[0067] The event detection function 446a detects events in the medical video according to the degree of expansion of at least one region that changes over time, including percutaneous marking, abscess drainage and percutaneous transhepatic biliary and gallbladder drainage, tumor treatment status such as percutaneous radiofrequency ablation, bone cement injection status, and tumor change status due to an accidental event. That is, the event detection function 446a detects whether the progress of expansion of the region that changes over time reaches a predetermined level. For example, the event detection function 446a detects whether the progress of expansion of the ablation region in percutaneous radiofrequency ablation is 20%, 40%, 60%, 80%, or 100%. In this embodiment, an example in 20% increments will be described. However, the progress may not be limited to 20% increments, but may be 10%, 15%, or other intervals.

[0068] The image generating function 447a generates the first operation image G31 and the second operation image G32 based on the detection information indicating the detection result detected by the event detecting function 446a.

[0069] 6 is a diagram showing an example of a superimposed image G3. The superimposed image G3 is an image in which a first operation image G31 and a second operation image G32 are superimposed on a medical video. The first operation image G31 has a slider bar G311, a start icon G312, an end icon G313, a first detection icon G314a, a second detection icon G314b, a third detection icon G315c, a fourth detection icon G314d, and a fifth detection icon G314e. The first detection icon G314a, the second detection icon G314b, the third detection icon G315c, the fourth detection icon G314d, and the fifth detection icon G314e have the same functions as the detection icon G224. When the first detection icon G314a, the second detection icon G314b, the third detection icon G315c, the fourth detection icon G314d, and the fifth detection icon G314e are not distinguished from one another, they are referred to as the detection icons G314. When a detection icon G314 is selected, it is highlighted by, for example, changing color to notify the user that it has been selected. The first operation image G31 shown in FIG. 6 notifies the user that an event corresponding to the fifth detection icon G314e is being displayed.

[0070] The first detection icon G314a accepts an operation to display a frame when the degree of spread of the ablation region reaches 20%. The second detection icon G314b accepts an operation to display a frame when the degree of spread of the ablation region reaches 40%. The third detection icon G314c accepts an operation to display a frame when the degree of spread of the ablation region reaches 60%. The fourth detection icon G314d accepts an operation to display a frame when the degree of spread of the ablation region reaches 80%. The fifth detection icon G314e accepts an operation to display a frame when the degree of spread of the ablation region reaches 100%.

[0071] The image generation function 447a generates a second operation image G32 indicating the shape of the area at the time when an event detected by the event detection function 446a occurs, for example. The second operation image G32 has the shape of the ablation area of ​​the subject P and is an image superimposed on the ablation area. The second operation image G32 also accepts an operation to display a frame of an event detected by the event detection function 446a from the medical video. The second operation image G32 also includes a first detection area line G321a, a second detection area line G321b, a third detection area line G321c, a fourth detection area line G321d, and a fifth detection area line G321e. The first detection area line G321a, the second detection area line G321b, the third detection area line G321c, the fourth detection area line G321d, and the fifth detection area line G321e have the same function as the detection icon G224. When the first detection area line G321a, the second detection area line G321b, the third detection area line G321c, the fourth detection area line G321d, and the fifth detection area line G321e are not distinguished from one another, they are referred to as the detection area lines G321. When a detection area line G321 is selected, it is highlighted, for example by changing color, to notify the user that it has been selected. The second operation image G32 shown in FIG. 6 notifies the user that an event corresponding to the fifth detection area line G321e is being displayed.

[0072] The first detection area line G321a is a line indicating an ablation area with a progress level of 20%. The first detection area line G321a accepts an operation to display a frame at the timing when the progress level of the expansion of the ablation area reaches 20%. The second detection area line G321b is a line indicating an ablation area with a progress level of 40%. The second detection area line G321b accepts an operation to display a frame at the timing when the progress level of the expansion of the ablation area reaches 40%. The third detection area line G321c is a line indicating an ablation area with a progress level of 60%. The third detection area line G321c accepts an operation to display a frame at the timing when the progress level of the expansion of the ablation area reaches 60%. The fourth detection area line G321d is a line indicating an ablation area with a progress level of 80%. The fourth detection area line G321d accepts an operation to display a frame at the timing when the degree of progress of the expansion of the ablation area reaches 80%. The fifth detection area line G321e is a line indicating a ablation area at a progress level of 100%. The fifth detection area line G321e also accepts an operation to display a frame at the timing when the degree of progress of the expansion of the ablation area reaches 100%.

[0073] The display control function 448a displays the medical moving image acquired by the image acquisition function 444 and the first operation image G31 and the second operation image G32 generated by the image generation function 447a on the display 42. For example, the display control function 448a displays the second operation image G32 superimposed on a region that changes over time. That is, the display control function 448a displays the second operation image G32 superimposed on the cauterization region.

[0074] In addition, when the first detection icon G314a, the second detection icon G314b, the third detection icon G314c, the fourth detection icon G314d, the fifth detection icon G314e, the first detection area line G321a, the second detection area line G321b, the third detection area line G321c, the fourth detection area line G321d, or the fifth detection area line G321e is pressed, the display control function 448a displays a frame of the medical video corresponding to the pressed target.

[0075] As described above, the X-ray CT apparatus 1a according to the second embodiment detects events according to the degree of expansion of a region that changes over time. Therefore, the X-ray CT apparatus 1a can reduce the effort required to search for events according to the degree of expansion of a region that changes over time.

[0076] (Variation 1) The X-ray CT apparatus 1a of the first modification according to the second embodiment may superimpose an operation image G41 in which the progress of the expansion of the region is expressed by a graph on the medical video.

[0077] FIG. 7 is a diagram showing an example of a superimposed image G4. The superimposed image G4 is an image in which an operation image G41 and a region image G42 are superimposed on a medical video. The operation image G41 is an image that graphically represents the progress of the expansion of the region. In the operation image G41 shown in FIG. 7, the horizontal axis indicates the elapsed time, and the vertical axis indicates information indicating the size of the region. For example, in percutaneous radiofrequency ablation therapy, the horizontal axis of the operation image G41 indicates the elapsed time from the start of ablation, and the vertical axis indicates the size of the ablation region.

[0078] The operation image G41 also includes a first detection area point G412a, a second detection area point G412b, a third detection area point G412c, a fourth detection area point G412d, a fifth detection area point G412e, and a connecting line G411. When the first detection area point G412a, the second detection area point G412b, the third detection area point G412c, the fourth detection area point G412d, and the fifth detection area point G412e are not distinguished from one another, they are referred to as the detection area point G412. When the detection area point G412 is selected, it is highlighted, for example by changing its color, to indicate that it has been selected. The operation image G41 shown in FIG. 7 indicates that an event corresponding to the fifth detection area point G412e is being displayed. The detection area point G412 corresponds to the elapsed time when an event corresponding to the progress of the expansion of the ablation area was detected and to the size of the ablation area. The detection area point G412 accepts an operation to display a frame when the corresponding event is detected. A connection line G411 is a line that connects the detection area points G412.

[0079] The region image G42 is an image showing the ablation region, and is superimposed on the ablation region of the medical video.

[0080] The image generation function 447a generates an operation image G41 having detection area points G412 and connecting lines G411 based on detection information indicating the detection results detected by the event detection function 446a. That is, the image generation function 447a generates a graph in which points indicating the size of the ablation area that changes over time are plotted for each timing at which an event detected by the event detection function 446a occurs. More specifically, the image generation function 447a plots the detection area points G412 at positions corresponding to the elapsed time when an event corresponding to the progress of the expansion of the ablation area was detected and the size of the ablation area. Then, the image generation function 447a draws connecting lines G411 connecting the multiple detection area points G412.

[0081] For example, the image generation function 447 places a first detection area point G412a, which accepts an operation to display a frame when the incineration area is 20%, at a position corresponding to the timing when it is detected that the incineration area is 20% expanded. Similarly, the image generation function 447 places a second detection area point G412b, which accepts an operation to display a frame when the incineration area is 40% expanded, at a position corresponding to the timing when it is detected that the incineration area is 40% expanded. Similarly, the image generation function 447 places a third detection area point G412c, which accepts an operation to display a frame when the incineration area is 60% expanded, at a position corresponding to the timing when it is detected that the incineration area is 60% expanded. Similarly, the image generation function 447 places a fourth detection area point G412d, which accepts an operation to display a frame when the incineration area is 80% expanded, at a position corresponding to the timing when it is detected that the incineration area is 80% expanded. Similarly, the image generation function 447 places a fifth detection area point G412e, which accepts an operation to display a frame when the progress of the expansion of the incineration area is 100%, at a position corresponding to the timing when it is detected that the progress of the expansion of the incineration area is 100%.

[0082] Furthermore, the image generating function 447a generates a region image G42 corresponding to the cauterization region of the medical video. For example, the image generating function 447a generates a region image G42 having the same shape as the cauterization region of the medical video.

[0083] The display control function 448a displays on the display 42 an operation image G41 having a graph generated by the image generation function 447a and a superimposed image G4 in which an area image G42 is superimposed on the medical moving image acquired by the image acquisition function 444. When a detection area point G412 of the operation image G41 is pressed, the display control function 448a displays a frame of the medical moving image corresponding to the pressed target.

[0084] (Third embodiment) The X-ray CT apparatus 1b according to the third embodiment stores frames of events detected by the event detection function 446 from medical moving images acquired by the image acquisition function 444.

[0085] 8 is a diagram showing an example of the configuration of an X-ray CT apparatus 1b according to the third embodiment. A processing circuit 44b of a console device 40b included in the X-ray CT apparatus 1b has a storage function 449 as a characteristic function of the third embodiment.

[0086] The saving function 449 saves images for a period specified by the operation image G1. The saving function 449 is an example of a saving unit. More specifically, the saving function 449 accepts an operation to specify an event to save. For example, the saving function 449 accepts an operation to specify an event using the detection icons G12 and G224 of the operation image G1. Furthermore, when the saving function 449 accepts an operation to specify the detection icons G12 and G224, it also accepts an operation to instruct whether to save a frame. Then, when the saving function 449 accepts an operation to save a frame, it saves the frame of the event corresponding to the specified detection icons G12 and G224 in the memory 41.

[0087] The save function 449 may accept an operation to specify an event or an operation to save a frame using another user interface, not limited to the detection icons G12 and G224 of the operation image G1. For example, the save function 449 may accept an operation to specify an event using detection area lines such as the first detection area line G321a, the second detection area line G321b, the third detection area line G321c, the fourth detection area line G321d, and the fifth detection area line G32e, or may accept an operation to specify an event using the detection area point G412.

[0088] Furthermore, when accepting an operation to specify an event, the saving function 449 is not limited to accepting one event, but may accept an operation to specify multiple events. Furthermore, when saving a frame of a specified event, the saving function 449 is not limited to saving one frame, but may save multiple frames before and after the specified event that are set in advance. Furthermore, when multiple events are specified and multiple frames before and after the specified event are saved, the saving function 449 may concatenate the multiple frames to be saved in chronological order. This allows the saving function 449 to generate a video that combines frames near the multiple specified events.

[0089] As described above, the X-ray CT apparatus 1b according to the third embodiment stores the images of the event specified by the operation image G1. This allows medical personnel to view the images of the event using the stored images. Therefore, the X-ray CT apparatus 1b can reduce the effort required to search for the event included in the medical video.

[0090] (Fourth embodiment) The X-ray CT apparatus 1c according to the fourth embodiment generates treatment plan information indicating a treatment plan for a subject P in a medical video. Then, the X-ray CT apparatus 1c displays the degree of progress with respect to the plan.

[0091] 9 is a diagram showing an example of the configuration of an X-ray CT apparatus 1c according to the fourth embodiment. A processing circuit 44c of a console device 40c included in the X-ray CT apparatus 1c has, as characteristic functions in the third embodiment, a planning function 450, an event detection function 446c, an image generation function 447c, and a display control function 448c.

[0092] The planning function 450 generates treatment plan information indicating a treatment plan for a subject P in a medical video. The planning function 450 is an example of a plan generation unit. For example, in the case of a treatment in which a needle is inserted into the subject P, the treatment plan information includes information indicating the path of the needle.

[0093] The event detection function 446c detects an event included in the medical video. More specifically, the event detection function 446c detects, as an event, a difference between the treatment plan for the subject P indicated by the treatment plan information and the treatment for the subject P indicated by the medical video, based on the medical video. For example, the event detection function 446c detects, as an event, that the difference between the needle path indicated by the treatment plan information and the needle path indicated by the medical video is equal to or greater than a threshold. Then, the event detection function 446c generates detection information indicating the detected detection result.

[0094] The event detection function 446c may detect, as an event, not only a difference in path but also a difference in time. For example, the event detection function 446c may detect, as an event, that the difference between the treatment plan information and the medical video in terms of the time it takes for the needle to pass through a certain point is equal to or greater than a threshold. Furthermore, the event detection function 446c may detect, as an event, not only a difference in path and time but also a difference in other content equal to or greater than a threshold.

[0095] The image generation function 447c generates an operation image G51 and a treatment plan image G52. Fig. 10 is a diagram showing an example of a superimposed image G5. The superimposed image G5 is an image in which the operation image G51 and the treatment plan image G52 are superimposed on the medical video.

[0096] More specifically, based on the detection information generated by the event detection function 446c, the image generation function 447c generates an operation image G51 having a slider bar G511, a start icon G512, an end icon G513, a first detection icon G514a, a second detection icon G514b, a third detection icon G514c, a fourth detection icon G514d, a fifth detection icon G514e, and a difference icon G515. The first detection icon G514a, the second detection icon G514b, the third detection icon G514c, the fourth detection icon G514d, and the fifth detection icon G514e have the same functions as the detection icon G224. When the first detection icon G514a, the second detection icon G514b, the third detection icon G514c, the fourth detection icon G514d, and the fifth detection icon G514e are not distinguished from one another, they are referred to as detection icons G514. When a detection icon G514 is selected, it is highlighted, for example by changing its color, to notify the user that it has been selected. The operation image G51 shown in FIG. 10 notifies the user that an event corresponding to the fifth detection icon G514e is being displayed.

[0097] For example, the image generation function 447c places a first detection area point G412a that accepts an operation to display a frame when the needle progresses to 20% at a position corresponding to the timing when the needle progress is detected to be 20%. Similarly, the image generation function 447c places a second detection area point G412b that accepts an operation to display a frame when the needle progress is 40% at a position corresponding to the timing when the needle progress is 40%. Similarly, the image generation function 447c places a third detection area point G412c that accepts an operation to display a frame when the needle progress is 60% at a position corresponding to the timing when the needle progress is 60%. Similarly, the image generation function 447c places a fourth detection area point G412d that accepts an operation to display a frame when the needle progress is 80% at a position corresponding to the timing when the needle progress is detected to be 80%. Similarly, the image generation function 447c places a fifth detection area point G412e, which accepts an operation to display a frame when the progress of the hand is 100%, at a position corresponding to the timing when the progress of the hand is detected to be 100%.

[0098] The image generation function 447c generates a difference icon G515 that indicates the timing at which an event detected by the event detection function 446c occurred. The difference icon G515 is an icon that indicates that the difference between the needle path indicated by the treatment plan information and the needle path indicated by the medical video is equal to or greater than a threshold. For example, the image generation function 447c adds the difference icon G515 to the detection icon G514 to notify that the difference between the needle path indicated by the treatment plan information and the needle path indicated by the medical video is equal to or greater than a threshold.

[0099] The display control function 448c displays a medical moving image having a needle image G53 showing a needle inserted into the subject P, an operation image G51, and a treatment plan image G52 on the display 42. That is, the display control function 448c displays the medical moving image and the operation image G51 to which a difference icon G515 is added relative to a slider bar G511 showing the timing of the display of the medical moving image. The treatment plan image G52 is an image generated based on treatment plan information. For example, the treatment plan image G52 is an image showing the path of the needle inserted into the subject P.

[0100] As described above, the X-ray CT apparatus 1c according to the fourth embodiment detects, as an event, a difference between the treatment for the subject P and the treatment plan information generated by the planning function 450. In this case as well, the X-ray CT apparatus 1c can reduce the effort required to search for an event included in a medical video.

[0101] (Variation 1) The X-ray CT apparatus 1c of the first modification according to the fourth embodiment may superimpose an operation image G61 in which the progress of the expansion of the region is expressed by a graph on the medical video.

[0102] 11 is a diagram showing an example of a superimposed image G6. The superimposed image G6 is an image in which an operation image G61 and a region image G62 are superimposed on a medical video.

[0103] The image generation function 447c generates an operation image G61 that graphically represents the progress of the expansion of the region. In the operation image G61 shown in Fig. 11, the horizontal axis indicates the elapsed time, and the vertical axis indicates the size of the region. For example, in percutaneous radiofrequency ablation therapy, the horizontal axis of the operation image G61 indicates the elapsed time from the start of ablation, and the vertical axis indicates the size of the ablation region.

[0104] The operation image G61 also includes a connection line G611, a first detection area point G612a, a second detection area point G612b, a third detection area point G612c, a fourth detection area point G612d, a fifth detection area point G612e, and a plan line G613. When the first detection area point G612a, the second detection area point G612b, the third detection area point G612c, the fourth detection area point G612d, and the fifth detection area point G612e are not distinguished from one another, they are referred to as the detection area point G612. When a detection area point G612 is selected, it is highlighted, for example by changing its color, to indicate that it has been selected. The operation image G61 shown in FIG. 11 indicates that an event corresponding to the fifth detection area point G612e is being displayed. The detection area point G612 corresponds to the elapsed time when an event corresponding to the progress of the expansion of the ablation area was detected and the size of the ablation area. The detection area point G612 accepts an operation to display the frame when the corresponding event was detected. The connection line G611 is a line connecting the detection area points G612.

[0105] For example, the image generation function 447c places a first detection area point G612a that accepts an operation to display a frame when the progress of the incineration area is 20% at a position corresponding to the timing when it is detected that the progress of the incineration area is 20%. Similarly, the image generation function 447c places a second detection area point G612b that accepts an operation to display a frame when the progress of the incineration area is 40% at a position corresponding to the timing when it is detected that the progress of the incineration area is 40%. Similarly, the image generation function 447c places a third detection area point G612c that accepts an operation to display a frame when the progress of the incineration area is 60% at a position corresponding to the timing when it is detected that the progress of the incineration area is 60%. Similarly, the image generation function 447c places a fourth detection area point G612d that accepts an operation to display a frame when the progress of the expansion of the incineration area is 80% at a position corresponding to the timing when it is detected that the progress of the expansion of the incineration area is 80%. Similarly, the image generation function 447c places a fifth detection area point G612e that accepts an operation to display a frame when the progress of the expansion of the incineration area is 100% at a position corresponding to the timing when it is detected that the progress of the expansion of the incineration area is 100%.

[0106] The planning line G613 is a line that indicates the relationship between the elapsed time and the size of the ablation region if the procedure proceeds as planned. The planning line G613 is generated based on the treatment plan information.

[0107] The region image G62 is an image showing the ablation region, and is superimposed on the ablation region of the medical video.

[0108] The image generating function 447c generates a detection area point G612 and a connection line G611 based on the detection information, and generates a planning line G613 based on the treatment planning information, thereby generating an operation image G61.

[0109] Furthermore, the image generating function 447c generates a region image G62 corresponding to the cauterization region of the medical video. For example, the image generating function 447c generates a region image G62 having the same shape as the cauterization region of the medical video.

[0110] The display control function 448c displays on the display 42 a superimposed image G6 in which the operation image G61 and the area image G62 generated by the image generation function 447c are superimposed on the medical moving image acquired by the image acquisition function 444. Furthermore, when a detection area point G612 of the operation image G61 is pressed, the display control function 448c displays a frame of the medical moving image corresponding to the pressed target.

[0111] (Variation 2) The X-ray CT apparatus 1c may divide the treatment for the subject P into a plurality of steps and generate an operation image G71 with a display form corresponding to each of the plurality of steps.

[0112] 12 is a diagram showing an example of an operation image G71. The image generation function 447c divides the treatment for the subject P into multiple steps and generates an operation image G71 with a display format corresponding to each step. The operation image G71 has a slider bar G711, a start icon G712, and an end icon G713.

[0113] For example, there is a case where three needles are inserted into the subject P. Therefore, the image generation function 447c divides the process into three steps: a first step of inserting the first needle, a second step of inserting the second needle, and a third step of inserting the third needle. Then, the image generation function 447c generates a slider bar G711 with a display form corresponding to each step.

[0114] For example, the image generation function 447c generates the first step area G714 corresponding to the first step in the slider bar G711 in blue, the second step area G715 corresponding to the second step in yellow, and the third step area G716 corresponding to the third step in green. In this way, the image generation function 447c generates the slider bar G711 in a display form corresponding to each step. Therefore, the medical professional can easily understand which step the currently displayed frame of the medical video belongs to.

[0115] Note that the image generation function 447c may use other colors in the display form corresponding to each step, rather than being limited to blue, yellow, and green. Furthermore, the image generation function 447c may use other display forms to make the steps identifiable, rather than just changing the color in the display form corresponding to each step. For example, the image generation function 447c may change the form of the line forming the slider bar G711, such as a double line, a dashed line, or a thick line, or may change the brightness, or may add information such as letters, numbers, or symbols.

[0116] The display control function 448c displays the slider bar G711 in a display form corresponding to each of the plurality of steps.

[0117] (Variation 3) The X-ray CT apparatus 1c may generate and display a progress image G81 that indicates the progress of the treatment.

[0118] 13 is a diagram showing an example of a progress image G81. The progress image G81 has a slider bar G811, a start icon G812, an end icon G813, and a current time icon G814. The slider bar G811 is a bar that indicates the current progress of a treatment on a subject P in the medical video. The start icon G812 is an icon that indicates the start of the slider bar G811. In other words, the start icon G812 is an icon that indicates the start of the treatment. The end icon G813 is an icon that indicates the end of the slider bar G811. In other words, the end icon G813 is an icon that indicates the end of the treatment. The current time icon G814 is an icon that indicates the current progress depending on its position on the slider bar G811.

[0119] The planning function 450 generates treatment plan information indicating a treatment plan for the subject P of the medical video. Furthermore, the event detection function 446c detects the position of the tip of the needle that will be inserted into the subject P. In other words, the event detection function 446c detects the current state. Then, the event detection function 446c generates detection information indicating the detection result.

[0120] The image generation function 447c calculates the current progress level based on the entire plan indicated by the treatment plan information and the current state indicated by the detection information. Then, the image generation function 447c places a current icon G814 at a position on the slider bar G811 specified by the calculated progress level. As a result, the image generation function 447c generates a progress level image G81.

[0121] The display control function 448c displays the medical moving images acquired by the image acquisition function 444, and the operation images G51, G61 and progress image G81 generated by the image generation function 447c on the display 42. That is, the display control function 448c displays the progress image G81 indicating the progress of the treatment on the subject P in accordance with the treatment plan information generated by the planning function 450.

[0122] Furthermore, the image generating function 447c may not be able to acquire treatment plan information. That is, when the progress of the treatment is unknown, the image generating function 447c superimposes a current icon G814 on the position of the end icon G813. As a result, the image generating function 447c generates a progress image G81 indicating that the progress of the treatment is unknown.

[0123] In the above embodiment, the processing circuits 44, 44a, and 44c of the console devices 40, 40a, 40b, and 40c of the X-ray CT scanners 1, 1a, 1b, and 1c have been described as having the respective functions. However, the system control function 441, the preprocessing function 442, the reconstruction processing function 443, the image acquisition function 444, the event detection functions 446, 446a, and 446c, the image generation functions 447, 447a, and 447c, the display control functions 448, 448a, and 448c, the storage function 449, and the planning function 450 may be provided by other devices such as a personal computer, a server device, or a workstation. Furthermore, these functions may be distributed among multiple devices.

[0124] According to at least one of the embodiments described above, it is possible to reduce the effort required to search for an event included in a video.

[0125] Although several embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, and combinations of embodiments can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, as well as within the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0126] 1, 1a, 1b, 1c X-ray CT device 44, 44a, 44b, 44c processing circuit 441 System Control Functions 442 Pre-processing function 443 Reconstruction Processing Function 444 Image Acquisition Function 446, 446a, 446c Event detection functions 447, 447a, 447c Image generation function 448, 448a, 448c Display control functions 449 Save function 450 Planning Function G1, G21, G41, G51, G61, G71 operation images G11, G311, G511, G711, G811 slider bars G22, G53 needle images G31 First operation image G32 2nd operation image G12, G224, G314, G514 detection icon G12a, G224a, G314a, G514a First detection icon G12b, G224b, G314b, G514b Second detection icon G12c, G224c, G314c, G514c 3rd detection icon G12d, G224d, G314d, G514d 4th detection icon G12e, G224e, G314e, G514e 5th detection icon G321 Detection area line G321a First detection area line G321b Second detection area line G321c Third detection area line G321d 4th detection area line G321e 5th detection area line G412, G612 detection area points G412a, G612a First detection area point G412b, G612b Second detection area point G412c, G612c Third detection area point G412d, G612d 4th detection area point G412e, G612e 5th detection area point G42, G62 area images G52 Treatment Planning Image G515 Difference Icon G611 connecting wire G612 Detection Area Point G613 Planning Line G714 1st process area G715 2nd process area G716 3rd process area G81 progress image G814 Current Icon

Claims

1. an acquisition unit that acquires medical videos that are medical videos; a setting unit for setting a detection target for the medical video; a detection unit that detects an event related to the detection target included in the medical video; an image generation unit that generates an operation image in which an icon that accepts an operation to display the event detected by the detection unit is arranged on a slider bar that includes a start time point and an end time point of the change in the detection target; a display control unit that displays the medical video and the operation image on a display unit; A medical image processing device comprising:

2. the image generation unit generates a detection icon indicating a timing at which the event detected by the detection unit occurred; the display control unit displays the medical video and the operation image in which the detection icon is added to a slider bar indicating a timing of display of the medical video. The medical image processing device according to claim 1 .

3. the detection unit detects an event corresponding to a change in at least one of a position of a tip of a needle inserted into a subject in the medical video and a position of an indwelling drain or a coil; the image generation unit generates a detection icon indicating a timing at which the event detected by the detection unit occurred; the display control unit displays the medical video and the operation image. The medical image processing device according to claim 1 .

4. the detection unit detects, in the medical video, an event corresponding to the degree of expansion of a region that changes over time in at least one of the following states: percutaneous marking, abscess drainage and percutaneous transhepatic biliary / gallbladder drainage, a tumor treatment state such as percutaneous radiofrequency ablation therapy, a bone cement injection state, and a tumor change state due to an accident; the image generation unit generates the operation image indicating a shape of an area at a timing when the event detected by the detection unit occurs, for each timing when the event occurs; the display control unit displays the operation image in a superimposed manner on the time-varying area. The medical image processing device according to claim 1 .

5. the image generation unit generates a graph in which points indicating the size of the region are plotted for each timing at which the event detected by the detection unit occurs; the display control unit displays the medical video and the operation image having the graph. The medical image processing device according to claim 4 .

6. a plan generating unit that generates a treatment plan for a subject of the medical video; the detection unit detects the event indicating a difference between the plan generated by the plan generation unit and the treatment based on the medical video; the image generation unit generates a difference icon indicating a timing at which the event detected by the detection unit occurred; the display control unit displays the medical video and the operation image in which the difference icon is added to a slider bar indicating a timing during display of the medical video. The medical image processing device according to claim 1 .

7. Further, a storage unit for storing images for a period designated by the operation image is provided. The medical image processing device according to claim 1 .

8. the display control unit displays the slider bar in a display form corresponding to each of a plurality of steps. The medical image processing device according to claim 2 .

9. the display control unit displays an image indicating a progress of treatment on the subject with respect to the plan generated by the plan generating unit. The medical image processing device according to claim 6 .

10. We obtain medical videos, which are medical videos; A detection target for the medical video is set; detecting an event related to the detection target included in the medical video; generating an operation image in which an icon for accepting an operation to display the event detected by the detection unit is arranged on a slider bar including a start time point and an end time point of the change of the detection target; displaying the medical video and the operation image on a display unit; A medical image processing method comprising:

Images