Image processing device, image processing method, and program

Abstract

An image processing device (imaging console 2) comprises: an acquisition unit (control unit 21) that acquires a frame image constituting a video; an interpolation processing unit (control unit 21) that, on the basis of a plurality of frame images acquired by the acquisition unit, performs interpolation processing for outputting an interpolated frame image, which is to be inserted between an unacquired frame image to be acquired after the plurality of frame images and an immediately preceding frame image acquired immediately before the unacquired frame image, together with the immediately preceding frame image; and a first determination unit (control unit 21) that determines whether or not to perform the interpolation processing on the basis of prescribed information.

Description

Image processing device, image processing method and program

[0001] The present invention relates to an image processing device, an image processing method, and a program.

[0002] Conventionally, frame interpolation is performed in moving image capture by generating interpolated frame images between captured frame images, which directly improves the frame rate of the displayed moving image.

[0003] Patent Document 1 describes a technology in which X-rays are irradiated intermittently at predetermined exposure intervals, frame images are acquired in accordance with the exposure, interpolation frame images are generated at times when frame images are missing, and a moving image obtained by frame interpolation is displayed.

[0004] International Publication No. 2016 / 021240

[0005] In conventional frame interpolation, when an interpolated frame image between a first frame image and a second frame image is displayed, the interpolated frame image must be displayed before the second frame image, as shown in Fig. 7. Therefore, after image processing of the second frame image, the display of the moving image is delayed by at least the time T0 required for the process of generating the interpolated frame image. Furthermore, in Patent Document 1, the display of the moving image is also delayed.

[0006] An object of the present invention is to reduce the delay in displaying moving images and to prevent degradation in image quality when frame interpolation of moving images is performed.

[0007] In order to solve the above problem, the image processing device of the present invention comprises an acquisition unit that acquires frame images that constitute a moving image; an interpolation processing unit that performs interpolation processing based on the multiple frame images acquired by the acquisition unit to output an interpolated frame image that should be inserted between an unacquired frame image acquired after the multiple frame images and an immediately preceding frame image acquired immediately before the unacquired frame image, together with the immediately preceding frame image; and a first judgment unit that judges whether or not to perform the interpolation processing based on specified information.

[0008] In addition, in order to solve the above problem, the image processing device of the present invention comprises: an acquisition unit that acquires frame images that make up a moving image; an interpolation processing unit that performs interpolation processing based on the plurality of frame images acquired by the acquisition unit to output an interpolated frame image that should be inserted between an unacquired frame image acquired after the plurality of frame images and an immediately preceding frame image acquired immediately before the unacquired frame image, together with the immediately preceding frame image; and a second determination unit that determines whether or not to output the interpolated frame image based on specified information.

[0009] In addition, in order to solve the above problem, the image processing method of the present invention includes, in an image processing device, an acquisition step of acquiring frame images that constitute a moving image; an interpolation processing step of performing interpolation processing based on the plurality of frame images acquired by the acquisition step to output an interpolated frame image that should be inserted between an unacquired frame image acquired after the plurality of frame images and an immediately preceding frame image acquired immediately before the unacquired frame image, together with the immediately preceding frame image; and a first determination step of determining whether or not to perform the interpolation processing based on specified information.

[0010] In addition, in order to solve the above-mentioned problems, the image processing method of the present invention includes, in an image processing device, an acquisition step of acquiring frame images that make up a moving image; an interpolation processing step of performing interpolation processing based on the plurality of frame images acquired by the acquisition step to output an interpolated frame image that should be inserted between an unacquired frame image acquired after the plurality of frame images and an immediately preceding frame image acquired immediately before the unacquired frame image, together with the immediately preceding frame image; and a second determination step of determining whether or not to output the interpolated frame image based on predetermined information.

[0011] In addition, in order to solve the above problem, the program of the present invention causes a computer of an image processing device to function as: an acquisition unit that acquires frame images that make up a moving image; an interpolation processing unit that performs interpolation processing based on the multiple frame images acquired by the acquisition unit to output an interpolated frame image that should be inserted between an unacquired frame image acquired after the multiple frame images and an immediately preceding frame image acquired immediately before the unacquired frame image, together with the immediately preceding frame image; and a first judgment unit that judges whether or not to perform the interpolation processing based on specified information.

[0012] In addition, in order to solve the above problem, the program of the present invention causes a computer of an image processing device to function as: an acquisition unit that acquires frame images that make up a moving image; an interpolation processing unit that performs interpolation processing based on the multiple frame images acquired by the acquisition unit to output an interpolated frame image that should be inserted between an unacquired frame image acquired after the multiple frame images and an immediately preceding frame image acquired immediately before the unacquired frame image, together with the immediately preceding frame image; and a second determination unit that determines whether or not to output the interpolated frame image based on specified information.

[0013] According to the present invention, when frame interpolation of a moving image is performed, it is possible to reduce the delay in displaying the moving image and also to prevent degradation in image quality.

[0014] It is a diagram showing the overall configuration of a moving image display system in an embodiment of the present invention. It is a flowchart showing frame image output processing. It is a timing chart showing frame image output processing. It is a flowchart showing frame image output processing. It is a flowchart showing frame image output processing. It is a timing chart showing conventional frame image output processing.

[0015] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings, but the scope of the invention is not limited to the illustrated examples.

[0016] [Moving Image Display System 100] Fig. 1 shows the overall configuration of a moving image display system 100 according to this embodiment. As shown in Fig. 1, the moving image display system 100 is configured such that an imaging device 1 and an imaging console 2 (image processing device) are connected by a communication cable or the like, and the imaging console 2 and a diagnostic console 3 are connected via a communication network NT such as a LAN (Local Area Network).

[0017] [Image Capture Device 1] The image capture device 1 is an imaging unit that captures moving images of a subject exhibiting periodicity, such as changes in lung expansion and contraction due to breathing or heartbeat. Image capture refers to acquiring multiple images by repeatedly irradiating a subject with pulsed radiation, such as X-rays, at predetermined intervals (pulse irradiation) or by continuously irradiating the subject with low dose rates without interruption (continuous irradiation). In other words, image capture refers to continuous radiographic imaging of a periodic target site along a time axis. Image capture may be performed using ultrasound or magnetic fields in addition to X-rays or other radiation. A series of images obtained by image capture is called a moving image. Specifically, a moving image is a medical moving image, such as an X-ray moving image or an echo moving image. A moving image can be acquired using a semiconductor image sensor, such as a flat panel detector (FPD). Each of the multiple images constituting a moving image is called a frame image. The following embodiment will be described using pulsed radiation as an example of image capture. In the following embodiment, the subject M is described as the chest of a subject, but the subject M is not limited to this.

[0018] The radiation source 11 is disposed at a position facing the radiation detection unit 13 across the subject M, and irradiates the subject M with radiation (X-rays) under the control of the radiation irradiation control device 12. The radiation irradiation control device 12 is connected to the imaging console 2, and controls the radiation source 11 based on radiation irradiation conditions input from the imaging console 2 to perform radiation imaging. The radiation irradiation conditions include, for example, a pulse rate, a pulse width, a pulse interval, the number of imaging frames per imaging, the value of the X-ray tube current, the value of the X-ray tube voltage, and the type of additional filter. The pulse rate is the number of radiation irradiations per second and corresponds to the frame rate described below. The pulse width is the radiation irradiation time per radiation irradiation. The pulse interval is the time from the start of one radiation irradiation to the start of the next radiation irradiation and corresponds to the frame interval described below.

[0019] The radiation detection unit 13 is composed of a semiconductor image sensor such as an FPD. The FPD has, for example, a glass substrate or the like, and a plurality of detection elements (pixels) are arranged in a matrix at predetermined positions on the substrate. The detection elements detect radiation emitted from the radiation source 11 and transmitted through at least the subject M according to its intensity, and convert the detected radiation into an electrical signal and store it. Each pixel is equipped with a switching unit such as a TFT (Thin Film Transistor). FPDs include an indirect conversion type that converts X-rays into an electrical signal using a photoelectric conversion element via a scintillator, and a direct conversion type that directly converts X-rays into an electrical signal, and either type may be used. In this embodiment, the pixel values ​​(signal values) of the image data generated by the radiation detection unit 13 are density values, and the greater the amount of transmitted radiation, the higher the pixel value. The radiation detection unit 13 is disposed opposite the radiation source 11 across the subject M.

[0020] The reading control device 14 is connected to the imaging console 2. The reading control device 14 controls the switching units of each pixel of the radiation detection unit 13 based on image reading conditions input from the imaging console 2, switches the reading of electrical signals accumulated in each pixel, and acquires image data by reading the electrical signals accumulated in the radiation detection unit 13. This image data is a frame image. The reading control device 14 then assigns an identification ID and a frame number to the acquired frame image and outputs it to the imaging console 2. The image reading conditions include, for example, a frame rate, a frame interval, a pixel size, an image size (matrix size), etc. The frame rate is the number of frame images acquired per second and corresponds to the pulse rate. The frame interval is the time from the start of acquisition of one frame image to the start of acquisition of the next frame image and corresponds to the pulse interval.

[0021] The radiation irradiation control device 12 and the reading control device 14 are connected to each other and exchange synchronization signals with each other to synchronize the radiation irradiation operation and the image reading operation.

[0022] [Radiography Console 2] The radiography console 2 outputs radiation irradiation conditions and image reading conditions to the radiography device 1 and controls the radiography and radiographic image reading operations of the radiography device 1. Upon acquiring frame images from the radiography device 1, the radiography console 2 generates interpolated frame images and outputs a moving image made up of the frame images and the interpolated frame images. The radiography console 2 outputs and displays the moving image on the display unit 24, allowing the user, who is the radiographer, to check the frame images being captured as a moving image. As shown in FIG. 1 , the radiography console 2 is configured to include a control unit 21, a storage unit 22, an operation unit 23, a display unit 24, and a communication unit 25, and each unit is connected by a bus 26.

[0023] The control unit 21 is composed of a CPU (Central Processing Unit), RAM (Random Access Memory), etc. In response to operations on the operation unit 23, the CPU of the control unit 21 reads out system programs and various processing programs stored in the storage unit 22 and expands them into the RAM, and executes various processes including imaging control processing according to the expanded programs, thereby centrally controlling the operation of each unit of the imaging console 2 and the radiation irradiation and reading operations of the imaging device 1. The control unit 21 functions as an acquisition unit that acquires frame images that constitute a moving image. The control unit 21 functions as an interpolated frame image generation unit that generates, based on the multiple frame images acquired by the acquisition unit, an interpolated frame image to be inserted between an unacquired frame image acquired after the multiple frame images and an immediately preceding frame image acquired immediately before it. The control unit 21 functions as an interpolation processing unit that performs interpolation processing to output, based on the multiple frame images acquired by the acquisition unit, an interpolated frame image to be inserted between an unacquired frame image acquired after the multiple frame images and an immediately preceding frame image acquired immediately before it, together with the immediately preceding frame image. The control unit 21 functions as an output unit that outputs the previous frame image and the interpolated frame image. The control unit 21 functions as an image processing unit that performs noise reduction processing or image processing using a motion compensation filter on the moving image. The control unit 21 functions as a first determination unit that determines whether or not to perform interpolation processing based on predetermined information. The control unit 21 functions as a second determination unit that determines whether or not to output the interpolated frame image based on predetermined information.

[0024] The storage unit 22 is configured with a non-volatile semiconductor memory, a hard disk, or the like. The storage unit 22 stores various programs executed by the control unit 21, parameters required for executing processes by the programs, data such as processing results, and the like. For example, the storage unit 22 stores a program for executing an image capture control process. The various programs are stored in the form of readable program code, and the control unit 21 sequentially executes operations in accordance with the program code. Specifically, the storage unit 22 stores a frame interpolation model used in the interpolation process. The frame interpolation model is, for example, an extrapolation machine learning model. The frame interpolation model does not need to use machine learning and may be, for example, a model using optical flow. The extrapolation machine learning model is a frame interpolation model that predicts a frame image at an arbitrary later time from multiple frame images captured at an arbitrary time. For example, the machine learning model predicts a frame image at a time later than t1 from frame images captured at different times t0 and t1 (t0<t1). The storage unit 22 also stores a series of frame images (moving images) to which identification IDs and frame numbers are assigned, output from the imaging device 1. The storage unit 22 also stores imaging order information. The imaging order information is attached to the series of frame images (moving images) and stored in the storage unit 22. The imaging order information includes radiation irradiation conditions (described above), image reading conditions (described above), subject information, and examination information. The subject information includes, for example, the subject's name, height, weight, age, and sex. The examination information includes, for example, the imaging site (chest, etc.) and the diagnostic target (ventilation, pulmonary blood flow, etc.).

[0025] The operation unit 23 is configured with a keyboard having cursor keys, numeric input keys, various function keys, etc., and a pointing device such as a mouse, and outputs instruction signals input by operating the keyboard or the mouse to the control unit 21. The operation unit 23 may also be equipped with a touch panel on the display screen of the display unit 24, and in this case, outputs instruction signals input via the touch panel to the control unit 21. The radiography operator uses the operation unit 23 to input the radiography order information.

[0026] The display unit 24 is configured with a monitor such as an LCD (Liquid Crystal Display) or a CRT (Cathode Ray Tube), and displays input instructions and data from the operation unit 23 according to instructions of a display signal input from the control unit 21.

[0027] The communication unit 25 includes a LAN adapter, a modem, a TA (Terminal Adapter), etc., and controls data transmission and reception between each device connected to the communication network NT.

[0028] [Diagnostic Console 3] The diagnostic console 3 is a device that acquires moving images from the radiographic console 2 and displays them on a monitor such as an LCD or CRT.

[0029] [Frame Image Output Processing] Next, the frame image output processing in the imaging console 2 will be described with reference to Fig. 2. The frame image output processing is a process of acquiring frame images, generating interpolated frame images, and outputting a moving image. Here, the interpolation processing in the frame image output processing is assumed to generate an interpolated frame image (N+1.5th frame image) between the N+1th frame image (the immediately preceding frame image) and the unacquired N+2th frame image (unacquired frame image) from the Nth frame image and the N+1th frame image. Note that N starts from 1.

[0030] First, the control unit 21 uses the communication unit 25 to acquire the Nth frame image from the photographing device 1 (step S1; acquisition step). Specifically, the control unit 21 acquires the first frame image.

[0031] Next, the control unit 21 uses the communication unit 25 to acquire the (N+1)th frame image from the photographing device 1 (step S2; acquisition step). Specifically, the control unit 21 acquires the second frame image.

[0032] Next, the control unit 21 outputs the (N+1)th frame image (step S3). For example, the control unit 21 outputs the second frame image to the display unit 24, and causes the display unit 24 to display it.

[0033] Next, the control unit 21 generates an interpolated frame image, which is the (N+1.5)th frame image, from the Nth frame image and the (N+1)th frame image (step S4; interpolation processing step). For example, the control unit 21 generates a 2.5th interpolated frame image.

[0034] Next, the control unit 21 outputs the 2.5th interpolated frame image (step S5; output step). For example, the control unit 21 outputs the 2.5th interpolated frame image to the display unit 24 and causes the display unit 24 to display it.

[0035] Next, the control unit 21 determines whether there are any frame images that have not yet been acquired from the photographing device 1 (step S6). If there are any (step S6; YES), the control unit 21 adds 1 to N and proceeds with the frame image output process to step S1. If there are no frame images that have not yet been acquired (step S6; NO), the control unit 21 ends the frame image output process.

[0036] The flow of the frame image output process described above will be explained using the timing chart (horizontal axis: time t) showing the frame image output process shown in FIG. 3 . Note that FIG. 7 is a timing chart showing conventional frame image output processing. Time T0 is the time required for the interpolation process (step S4). Time T1 is the frame interval. Time T2 is the time required for image processing. Time T3 is the time required from the acquisition of the (N+1)th frame image to the output of the immediately following frame image. In this frame image output process, time T3 is equal to time T2. In contrast, in conventional methods, time T3 is equal to the sum of time T2 and time T0. In other words, in this frame image output process, the display delay is determined solely by the time required for image processing. Therefore, according to this frame image output process, the display delay of moving images is reduced when frame interpolation of moving images is performed.

[0037] Note that, in the above description, the N+1.5th interpolated frame image is generated from the Nth frame image and the N+1th frame image, but this is not limiting. As shown in FIG. 4 , the N+2.5th interpolated frame image may be generated between the N+2th frame image (the immediately preceding frame image) and the unacquired N+3th frame image (an unacquired frame image) from the Nth, N+1st, and N+2th frame images. First, the control unit 21 acquires the Nth frame image from the photographing device 1 using the communication unit 25 (step S11; acquisition step). Specifically, the control unit 21 acquires the first frame image. Next, the control unit 21 acquires the N+1th frame image from the photographing device 1 using the communication unit 25 (step S12; acquisition step). Specifically, the control unit 21 acquires the second frame image. Next, the control unit 21 acquires the N+2th frame image from the photographing device 1 using the communication unit 25 (step S13; acquisition step). Specifically, the control unit 21 acquires the third frame image. Next, the control unit 21 outputs the (N+2)th frame image (step S14). For example, the control unit 21 outputs the third frame image to the display unit 24 and causes it to be displayed on the display unit 24. Next, the control unit 21 generates an interpolated frame image, which is the (N+2.5)th frame image, from the Nth, (N+1)th, and (N+2)th frame images (step S15; interpolation processing step). For example, the control unit 21 generates the 3.5th interpolated frame image. Next, the control unit 21 outputs the 3.5th interpolated frame image (step S16; output step). For example, the control unit 21 outputs the 3.5th interpolated frame image to the display unit 24 and causes it to be displayed on the display unit 24. Next, the control unit 21 determines whether there are any frame images that have not yet been acquired from the photographing device 1 (step S17). If there are any (step S17; YES), the control unit 21 adds 1 to N and proceeds with the frame image output process to step S11. If there is no frame image (step S17; NO), the control unit 21 ends the frame image output process.

[0038] Furthermore, although the above-described interpolation process generates an interpolated frame image between the immediately preceding frame image at the end of a plurality of acquired frame images and the unacquired frame image acquired immediately thereafter, the present invention is not limited to this. For example, from the acquired Nth frame image and the acquired N+1th frame image, an N+2.5th interpolated frame image may be generated between the unacquired N+2th frame image (immediately preceding frame image) and the unacquired N+3th frame image (unacquired frame image), or an N+3.5th interpolated frame image may be generated between the unacquired N+3th frame image (immediately preceding frame image) and the unacquired N+4th frame image (unacquired frame image).

[0039] Furthermore, the control unit 21 may execute various types of image processing such as sharpening and / or smoothing before outputting the frame image.

[0040] 5 and 6, a frame image output process including a determination process in the radiography console 2 will be described. The determination process is a process for determining whether or not to generate or output an interpolated frame image.

[0041] 5 shows the frame image output process, which includes a process in which the control unit 21 determines whether or not to generate an interpolated frame image (step S24; first determination step). If it is determined that an interpolated frame image should be generated (step S24; YES), the control unit 21 advances the frame image output process to step S25. If it is determined that an interpolated frame image should not be generated (step S24; NO), the control unit 21 advances the frame image output process to step S27. The processing contents of the other steps are the same as the processing contents of FIG. 2.

[0042] Specifically, the control unit 21 determines whether to generate an interpolated frame image from at least one acquired frame image using a predetermined determination algorithm. That is, the control unit 21 determines whether to perform interpolation processing based on the analysis results of the frame images. For example, the determination algorithm calculates the correlation between multiple adjacent frame images and determines to generate an interpolated frame image only if the correlation is equal to or greater than a threshold. For example, the determination algorithm determines to generate an interpolated frame image only if the proportion of low-frequency components among the spatial frequency components contained in at least one frame image is less than a threshold. For example, the determination algorithm determines to generate an interpolated frame image only if the enlargement ratio of at least one frame image is less than a threshold. The enlargement ratio refers to the enlargement ratio of the display area relative to the original image, such as when enlarging and displaying a region of interest (ROI).

[0043] Furthermore, for example, the determination algorithm detects the magnitude of movement of the subject M from the optical flow of a plurality of adjacent frame images, and determines to generate an interpolated frame image only if the magnitude of the movement is less than a threshold value. This is particularly effective when the subject M is a subject that moves a lot, such as a fetus. Furthermore, for example, the determination algorithm determines to generate an interpolated frame image only if the observation magnification in the radiography console 2 is less than a threshold value. Furthermore, for example, the determination algorithm determines not to generate an interpolated frame image if the subject is a child, based on subject information input to the radiography console 2.

[0044] Specifically, the control unit 21 determines whether to generate an interpolated frame image using a predetermined determination algorithm based on information from an auxiliary imaging device, such as an optical camera, attached to the imaging console 2 and / or sensors attached to the imaging device 1. That is, the control unit 21 determines whether to perform interpolation processing based on setting information of the device for generating frame images. For example, the determination algorithm detects the movement of a subject from moving images captured by the auxiliary imaging device, and determines to generate an interpolated frame image only if the magnitude of the movement is less than a threshold. The magnitude of the movement can be calculated using a known motion detection technique such as optical flow. Furthermore, for example, the determination algorithm detects the movement of an X-ray generator or an X-ray detector from information from sensors attached to the radiation source 11 or the radiation detection unit 13 of the imaging device 1, and determines to generate an interpolated frame image only if the magnitude of the movement is less than a threshold.

[0045] 6 shows the frame image output process, which includes a process in which the control unit 21 determines whether or not to output an interpolated frame image (step S35; second determination step). If it is determined that the interpolated frame image should be output (step S35; YES), the control unit 21 advances the frame image output process to step S36. If it is determined that the interpolated frame image should not be output (step S35; NO), the control unit 21 advances the frame image output process to step S37. The processing contents of the other steps are the same as the processing contents of FIG. 2.

[0046] Specifically, the control unit 21 determines whether or not to output an interpolated frame image using a predetermined determination algorithm based on at least one acquired frame image and the generated interpolated frame image. For example, the determination algorithm calculates the degree of correlation between an interpolated frame image and its immediately preceding frame image, and determines to output the interpolated frame image only if the degree of correlation is equal to or greater than a threshold value.

[0047] Furthermore, for example, the determination algorithm may be the same as the determination algorithm used to determine whether or not to generate the interpolated frame image described above. Note that the phrase "at least one or more acquired frame images" may be read as "at least one or more frame images" or "interpolated frame images," and "generation" may be read as "output," etc.

[0048] [Others] In the above, the control unit 21 outputs the frame images or interpolated frame images as they are, but the control unit 21 may also modify the frame images or interpolated frame images using various noise reduction processes and output them. Noise reduction processes are processes using a recursive filter or persistence technology, for example. The control unit 21 may also perform a weighted average of at least two or more temporally consecutive frame images, modify the frame images or interpolated frame images, and output them. Note that the weighted average may be performed by weighting the frame images or interpolated frame images. The control unit 21 may also use a known motion compensation filter to modify the frame images or interpolated frame images and output them.

[0049] Furthermore, the control unit 21 may switch between interpolation processing and extrapolation processing at a predetermined timing. In this case, an interpolation frame interpolation model must be stored in the storage unit 22. The interpolation frame interpolation model is a frame interpolation model that predicts an interpolated image between multiple frame images captured at a given time based on the frame images. Specifically, the predetermined timing is the timing at which video capture is completed. In other words, while the imaging device 1 and the imaging console 2 are working together to capture a video, the control unit 21 generates an interpolated frame image using the extrapolation frame interpolation model, and after the video capture is completed, generates an interpolated frame image using the interpolation frame interpolation model. This reduces display delay during video capture and enables more accurate display after the video capture is completed.

[0050] [Effect 1] As described above, the image processing device (imaging console 2) comprises an acquisition unit (control unit 21) that acquires frame images that make up a moving image, an interpolated frame image generation unit (control unit 21) that generates, based on the multiple frame images acquired by the acquisition unit, an interpolated frame image to be inserted between an unacquired frame image acquired after the multiple frame images and an immediately preceding frame image acquired immediately before the unacquired frame image, and an output unit (control unit 21) that outputs the immediately preceding frame image and the interpolated frame image. This makes it possible to reduce display delays for moving images when performing frame interpolation for moving images.

[0051] The image processing method also includes an acquisition step (steps S1 and S2) in an image processing device (imaging console 2) of acquiring frame images constituting a moving image, an interpolated frame image generation step (step S4) of generating an interpolated frame image to be inserted between an unacquired frame image acquired after the plurality of frame images and an immediately preceding frame image acquired immediately before the unacquired frame image, based on the plurality of frame images acquired in the acquisition step, and an output step (step S5) of outputting the immediately preceding frame image and the interpolated frame image. This makes it possible to reduce the display delay of a moving image when performing frame interpolation of the moving image.

[0052] The program also causes the computer of the image processing device (imaging console 2) to function as an acquisition unit (control unit 21) that acquires frame images that make up a moving image, an interpolated frame image generation unit (control unit 21) that generates, based on the multiple frame images acquired by the acquisition unit, an interpolated frame image to be inserted between an unacquired frame image acquired after the multiple frame images and the immediately preceding frame image acquired immediately before the unacquired frame image, and an output unit (control unit 21) that outputs the immediately preceding frame image and the interpolated frame image. This makes it possible to reduce display delays for moving images when performing frame interpolation for moving images.

[0053] [Effect 2] As described above, the image processing device (radiography console 2) includes an acquisition unit (control unit 21) that acquires frame images that make up a moving image, an interpolation processing unit (control unit 21) that performs interpolation processing based on the multiple frame images acquired by the acquisition unit to output an interpolated frame image that should be inserted between an unacquired frame image acquired after the multiple frame images and an immediately preceding frame image acquired immediately before the unacquired frame image, together with the immediately preceding frame image, and a first determination unit (control unit 21) that determines whether or not to perform interpolation processing based on predetermined information. This reduces display delay of the moving image and prevents degradation of image quality when performing frame interpolation of the moving image.

[0054] The image processing device (imaging console 2) also includes an acquisition unit (control unit 21) that acquires frame images that make up a moving image, an interpolation processing unit (control unit 21) that performs interpolation processing based on the multiple frame images acquired by the acquisition unit to output an interpolated frame image that should be inserted between an unacquired frame image acquired after the multiple frame images and an immediately preceding frame image acquired immediately before the unacquired frame image, together with the immediately preceding frame image, and a second determination unit (control unit 21) that determines whether or not to output the interpolated frame image based on predetermined information. This makes it possible to reduce display delays for moving images and prevent degradation in image quality when performing frame interpolation for moving images.

[0055] The image processing method also includes an acquisition step (steps S21 and S22) in the image processing device (imaging console 2) of acquiring frame images that make up a moving image, an interpolation processing step (step S25) of performing interpolation processing based on the plurality of frame images acquired in the acquisition step to output an interpolated frame image that should be inserted between an unacquired frame image acquired after the plurality of frame images and an immediately preceding frame image acquired immediately before the unacquired frame image, together with the immediately preceding frame image, and a first determination step (step S24) of determining whether or not to perform interpolation processing based on predetermined information. This reduces delay in displaying the moving image and prevents degradation of image quality when performing frame interpolation of the moving image.

[0056] The image processing method also includes an acquisition step (steps S31 and S32) in the image processing device (imaging console 2) of acquiring frame images that make up a moving image, an interpolation processing step (step S34) of performing interpolation processing based on the plurality of frame images acquired in the acquisition step to output an interpolated frame image that should be inserted between an unacquired frame image acquired after the plurality of frame images and an immediately preceding frame image acquired immediately before the unacquired frame image, together with the immediately preceding frame image, and a second determination step (step S35) of determining whether or not to output the interpolated frame image based on predetermined information. This makes it possible to reduce display delay of the moving image and prevent degradation of image quality when performing frame interpolation of the moving image.

[0057] The program also causes the computer of the image processing device (imaging console 2) to function as an acquisition unit (control unit 21) that acquires frame images that make up a moving image, an interpolation processing unit (control unit 21) that performs interpolation processing based on the multiple frame images acquired by the acquisition unit to output an interpolated frame image that should be inserted between an unacquired frame image acquired after the multiple frame images and the immediately preceding frame image acquired immediately before it, together with the immediately preceding frame image, and a first determination unit (control unit 21) that determines whether or not to perform interpolation processing based on predetermined information. This makes it possible to reduce display delays for moving images and prevent degradation of image quality when performing frame interpolation for moving images.

[0058] The program also causes the computer of the image processing device (imaging console 2) to function as an acquisition unit (control unit 21) that acquires frame images that make up a moving image, an interpolation processing unit (control unit 21) that performs interpolation processing based on the multiple frame images acquired by the acquisition unit to output an interpolated frame image that should be inserted between an unacquired frame image acquired after the multiple frame images and the immediately preceding frame image acquired immediately before it, together with the immediately preceding frame image, and a second determination unit (control unit 21) that determines whether or not to output an interpolated frame image based on predetermined information. This makes it possible to reduce display delays for moving images and prevent degradation in image quality when performing frame interpolation for moving images.

[0059] The description in this embodiment is an example of a suitable moving image display system according to the present invention, and the present invention is not limited to this.

[0060] For example, in the above description, examples have been disclosed in which a hard disk or a semiconductor nonvolatile memory is used as a computer-readable medium for the program according to the present invention, but the present invention is not limited to these examples. Other computer-readable media include portable recording media such as CD-ROMs. Furthermore, carrier waves can also be used as a medium for providing the program data according to the present invention via a communication line.

[0061] In addition, the detailed configuration and detailed operation of each device constituting the moving image display system 100 can be modified as appropriate without departing from the spirit of the present invention.

[0062] The present invention can be used in an image processing device, an image processing method, and a program.

[0063] REFERENCE SIGNS LIST 100 Moving image display system 1 Imaging device 11 Radiation source 12 Radiation irradiation control device 13 Radiation detection unit 14 Reading control device 2 Imaging console 21 Control unit (acquisition unit, interpolated frame image generation unit, interpolation processing unit, output unit, image processing unit, first determination unit, second determination unit) 22 Storage unit 23 Operation unit 24 Display unit 25 Communication unit 26 Bus 3 Diagnostic console

Claims

1. An image processing device comprising: an acquisition unit that acquires frame images that constitute a moving image; an interpolation processing unit that performs interpolation processing based on the multiple frame images acquired by the acquisition unit to output an interpolated frame image that should be inserted between an unacquired frame image acquired after the multiple frame images and an immediately preceding frame image acquired immediately before the unacquired frame image, together with the immediately preceding frame image; and a first determination unit that determines whether or not to perform the interpolation processing based on specified information.

2. The image processing device according to claim 1, wherein the first determination unit determines whether or not to perform the interpolation processing based on the analysis result of the frame image.

3. The image processing device according to claim 1, wherein the first determination unit determines whether or not to perform the interpolation processing based on setting information of a device for generating the frame images.

4. An image processing device comprising: an acquisition unit that acquires frame images that constitute a moving image; an interpolation processing unit that performs interpolation processing based on the plurality of frame images acquired by the acquisition unit to output an interpolated frame image that should be inserted between an unacquired frame image acquired after the plurality of frame images and an immediately preceding frame image acquired immediately before the unacquired frame image, together with the immediately preceding frame image; and a second determination unit that determines whether or not to output the interpolated frame image based on specified information.

5. The image processing device according to claim 4, wherein the second determination section determines whether or not to output the interpolated frame image based on the interpolated frame image.

6. An image processing method in an image processing device, comprising: an acquisition step for acquiring frame images that constitute a moving image; an interpolation processing step for performing interpolation processing based on the plurality of frame images acquired by the acquisition step to output an interpolated frame image that should be inserted between an unacquired frame image acquired after the plurality of frame images and an immediately preceding frame image acquired immediately before the unacquired frame image, together with the immediately preceding frame image; and a first determination step for determining whether or not to perform the interpolation processing based on predetermined information.

7. An image processing method in an image processing device, comprising: an acquisition step for acquiring frame images that constitute a moving image; an interpolation processing step for performing interpolation processing based on the plurality of frame images acquired by the acquisition step to output an interpolated frame image that should be inserted between an unacquired frame image acquired after the plurality of frame images and an immediately preceding frame image acquired immediately before the unacquired frame image, together with the immediately preceding frame image; and a second determination step for determining whether or not to output the interpolated frame image based on predetermined information.

8. A program that causes a computer of an image processing device to function as: an acquisition unit that acquires frame images that make up a moving image; an interpolation processing unit that performs interpolation processing based on the multiple frame images acquired by the acquisition unit to output an interpolated frame image that should be inserted between an unacquired frame image acquired after the multiple frame images and the immediately preceding frame image acquired immediately before the unacquired frame image, together with the immediately preceding frame image; and a first determination unit that determines whether or not to perform the interpolation processing based on specified information.

9. A program that causes a computer of an image processing device to function as: an acquisition unit that acquires frame images that make up a moving image; an interpolation processing unit that performs interpolation processing based on the multiple frame images acquired by the acquisition unit to output an interpolated frame image that should be inserted between an unacquired frame image acquired after the multiple frame images and the immediately preceding frame image acquired immediately before the unacquired frame image, together with the immediately preceding frame image; and a second determination unit that determines whether or not to output the interpolated frame image based on specified information.

Images