Information processing apparatus, information processing method, and program

Abstract

To provide an information processing apparatus, an information processing method and a program that allow easy access to a desired image from among a series of radiation images.SOLUTION: An information processing apparatus comprises at least one processor. The processor performs as follows: acquiring a series of radiation images captured by continuous exposure to radiation; when the sounds made during a period of capturing the series of radiation images are specific sounds, generating image specific information that specifies radiation images selected, according to occurrence timing of the sounds, from among the series of radiation images; and associating the image specific information with the series of radiation images.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The disclosed technology relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] The following techniques are known as techniques related to image processing using audio. For example, Patent Document 1 describes an image processing device that includes an imaging unit that images an object to be inspected, an image processing unit that creates a video signal from an image captured by the imaging unit, a recording unit that creates and records a video file using the video signal and audio signals related to the actions and operations of an operator who operates the imaging unit and the object to be inspected during imaging, an audio analysis unit that monitors whether the audio signal strength is equal to or greater than a predetermined threshold, and a notification unit that notifies the operator that the audio signal strength is equal to or greater than the predetermined threshold.

[0003] Patent document 2 describes a method of storing in advance intravascular ultrasound video images, angiographic video images, audio data including the names of the parts of the shooting positions shown in the frames of the intravascular ultrasound video images, and anatomical data indicating the course of blood vessels and information indicating each part of the blood vessels, detecting the part that is called out from the audio data, detecting the frame of the intravascular ultrasound video image that was taken when that part was called out, and associating the detected part with the frame. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2012-217632 A [Patent Document 2] JP 2010-253017 A Summary of the Invention [Problem to be solved by the invention]

[0005] A videofluoroscopic examination of swallowing is known as one of the examinations using radiation images. A videofluoroscopic examination of swallowing is an examination to evaluate the process and state of a subject swallowing a sample. In a videofluoroscopic examination of swallowing, a video consisting of a series of radiation images taken by continuously irradiating the subject with radiation is used.

[0006] The swallowing contrast examination includes the following process. (1) Subject positioning (2) Providing samples to subjects (3) Chewing the sample (4) Start of swallowing (5) End of swallowing In a swallowing contrast examination, the main object of observation is radiation images taken during the period of interest necessary for diagnosis (e.g., the period from (4) the start of swallowing to (5) the end of swallowing). However, the series of radiation images taken in a swallowing contrast examination may also include images taken during periods other than the period of interest (e.g., the period from (1) positioning the subject to (3) chewing the sample). In this case, in order to observe images during the period of interest, it is necessary to search for images during the period of interest from the series of radiation images, which places a heavy burden on the observer.

[0007] The disclosed technology has been made in consideration of the above points, and has an object to facilitate access to a desired image from a series of radiation images. [Means for solving the problem]

[0008] The information processing device according to the disclosed technique includes at least one processor, which acquires a series of radiographic images captured by continuously irradiating radiation, and when a sound generated during the capture of the series of radiographic images is a specific sound, generates image specification information for specifying a radiographic image to be selected from the series of radiographic images according to the timing of generation of the sound, and associates the image specification information with the series of radiographic images.

[0009] The specific sound may be a speech sound including a specific word. The specific sound may be a specific body sound.

[0010] The processor may generate a plurality of pieces of image-specific information based on a plurality of sounds intermittently emitted during a period in which the series of radiation images are captured, and may associate the plurality of pieces of image-specific information with the series of radiation images.

[0011] The processor may display a time position of the radiation image identified by the image identifying information in a moving image constituted by the series of radiation images. The processor may change the image identifying information based on an operation for changing the time position of the radiation image identified by the image identifying information in the moving image constituted by the series of radiation images.

[0012] The processor may acquire a series of optical images that are taken continuously in parallel with the taking of the series of radiation images, and play back each of the radiation videos constituted by the series of radiation images and the optical videos constituted by the series of optical images so that images at the same time as each other are displayed.

[0013] The processor may extract some radiographic images from the series of radiographic images, with the radiographic image specified by the image specifying information as a start point or an end point, and generate a data file including the extracted some radiographic images. The processor may obtain related information related to the shooting content of the series of radiographic images, and generate a data file in which the related information corresponds to the some radiographic images.

[0014] The information processing method related to the disclosed technology is a method in which a series of radiological images are acquired by continuously irradiating radiation, and if a sound emitted during the capture period of the series of radiological images is a specific sound, image identification information is generated that identifies a radiological image from the series of radiological images to be selected depending on the timing of the sound generation, and a process of associating the image identification information with the series of radiological images is performed by at least one processor provided in the information processing device.

[0015] The program related to the disclosed technology is a program for acquiring a series of radiological images captured by continuously irradiating radiation, and if a sound emitted during the capture period of the series of radiological images is a specific sound, generating image identification information that identifies a radiological image to be selected from the series of radiological images according to the timing of the sound generation, and causing at least one processor provided in an information processing device to execute a process of associating the image identification information with the series of radiological images. Effect of the Invention

[0016] The disclosed technique makes it possible to easily access a desired image from a series of radiological images. [Brief description of the drawings]

[0017] [Figure 1] 1 is a diagram illustrating an example of a configuration of a radiation image capturing system according to an embodiment of the disclosed technique. [Diagram 2] 1 is a diagram illustrating an example of a configuration of a radiological image capturing device according to an embodiment of the disclosed technique. [Diagram 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of an information processing device according to an embodiment of the disclosed technique. [Figure 4] 1 is a functional block diagram illustrating an example of a functional configuration of an information processing device according to an embodiment of the disclosed technology. [Diagram 5] 11 is a diagram illustrating an example of a structure of a data file generated by an association processing unit according to an embodiment of the disclosed technique. [Figure 6] FIG. 11 is a diagram illustrating an example of a playback screen according to an embodiment of the disclosed technology. [Figure 7] 11 is a flowchart showing an example of a flow of processing performed by a CPU according to an embodiment of the disclosed technology by executing an association program. [Figure 8] FIG. 11 is a functional block diagram showing an example of a functional configuration of an information processing device according to another embodiment of the disclosed technology. [Figure 9] FIG. 13 is a diagram showing an example of a playback screen according to another embodiment of the disclosed technique. [Figure 10] FIG. 11 is a functional block diagram showing an example of a functional configuration of an information processing device according to another embodiment of the disclosed technology. [Figure 11A] 11A to 11C are diagrams illustrating an example of an image extraction process according to an embodiment of the disclosed technology. [Figure 11B] 11A to 11C are diagrams illustrating an example of an image extraction process according to an embodiment of the disclosed technology. [Figure 12] FIG. 11 is a functional block diagram showing an example of a functional configuration of an information processing device according to another embodiment of the disclosed technology. [Figure 13] 11A to 11C are diagrams illustrating an example of a matching process and an image extraction process according to an embodiment of the disclosed technique. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] Hereinafter, an example of an embodiment of the disclosed technology will be described with reference to the drawings. In each drawing, the same or equivalent components and parts are given the same reference numerals, and duplicated description will be omitted.

[0019] [First embodiment] 1 is a diagram showing an example of a configuration of a radiographic imaging system 1 according to an embodiment of the disclosed technique. In the following description, a case where the radiographic imaging system 1 is used for a swallowing radiography test will be described as an example. The radiographic imaging system 1 includes an information processing device 10, a radiographic imaging device 20, a sound collection device 30, and a voice recognition device 40.

[0020] The radiological image capturing device 20 is capable of capturing radiological images using radiation such as X-rays. It is also possible to display a series of radiological images captured by continuously irradiating radiation in a time series, in sequence, at all times, to perform video display. The capturing of a series of radiological images for video display is called fluoroscopic imaging. In a swallowing contrast examination, fluoroscopic imaging is performed to observe the process in which a subject swallows a sample. Note that "continuous irradiation of radiation" includes both a case in which radiation is continuously irradiated for a certain period of time and a case in which pulsed radiation is irradiated multiple times within a certain period of time. The radiological images captured by the radiological image capturing device 20 are immediately transmitted to the information processing device 10.

[0021] 2 is a diagram showing an example of the configuration of the radiographic image capturing device 20. The radiographic image capturing device 20 has an imaging table 21. The imaging table 21 is supported on the floor surface by a stand 22. A radiation generating unit 24 is attached to the imaging table 21 via a support 23. The radiation generating unit 24 is configured to include a radiation source 25 and a collimator 26. A radiation detector 27 is built into the imaging table 21.

[0022] The radiation source 25 has a radiation tube (not shown) and irradiates the subject P with radiation. The collimator 26 limits the irradiation field of the radiation emitted from the radiation tube. The radiation detector 27 has a plurality of pixels that generate signal charges according to the radiation that has passed through the subject P. The radiation detector 27 is called an FPD (Flat Panel Detector).

[0023] The radiation generating unit 24 can be moved back and forth together with the support 23 along the long side direction of the imaging table 21 by a moving mechanism such as a motor (not shown). The radiation detector 27 can be moved back and forth along the long side direction of the imaging table 21 in conjunction with the movement of the radiation generating unit 24. The imaging table 21 and the support 23 can be rotated between a standing state shown in FIG. 2 and a lying state (not shown) by a rotating mechanism such as a motor (not shown). In the lying state, the surface of the imaging table 21 is parallel to the floor surface, and the extension direction of the support 23 is perpendicular to the floor surface. On the other hand, in the standing state, the surface of the imaging table 21 is perpendicular to the floor surface, and the extension direction of the support 23 is parallel to the floor surface. In the standing state, it is possible to perform fluoroscopic imaging on a subject P sitting on a wheelchair 50 as shown in FIG. 2.

[0024] The sound collection device 30 is a microphone that collects surrounding sounds. The voice of a radiographer, such as a doctor or a radiologist, or the biological sound of a subject is collected by the sound collection device 30. The voice recognition device 40 recognizes the voice collected by the sound collection device 30 using a known voice recognition technology.

[0025] The voice recognition device 40 generates a trigger signal when the collected voice is a specific voice. The trigger signal is a signal indicating the start or end of a period of interest in a swallowing contrast examination. The specific voice may be a speech containing a specific word. For example, in a case where the start of the period of interest is the timing when the subject swallows a sample, the voice recognition device 40 may generate a trigger signal when the collected speech contains a word instructing the subject to swallow the sample. When instructing the subject to swallow the sample, a doctor or a radiologist will make an utterance containing a word such as "swallow it". The voice recognition device 40 may generate a trigger signal when the spoken voice contains a specific word such as "swallow". The specific voice may also be a specific biological sound. For example, the voice recognition device 40 may generate a trigger signal when the collected voice contains a swallowing sound emitted by the subject swallowing the sample.

[0026] When the recognized voice contains a specific voice, the voice recognition device 40 immediately generates a trigger signal and transmits it to the information processing device 10. That is, the trigger signal is transmitted to the information processing device 10 immediately after the specific voice is generated. When the specific voice is intermittently generated multiple times, the voice recognition device 40 sequentially generates trigger signals corresponding to each specific voice and transmits them sequentially to the information processing device 10.

[0027] 3 is a diagram showing an example of a hardware configuration of the information processing device 10. The information processing device 10 includes a CPU (Central Processing Unit) 101, a RAM (Random Access Memory) 102, a non-volatile memory 103, an input device 104 including a keyboard and a mouse, a display 105, and a communication interface 106. These pieces of hardware are connected to a bus 108.

[0028] The display 105 may be a touch panel display. The communication interface 106 is an interface for the information processing device 10 to communicate with the radiation image capturing device 20 and the voice recognition device 40. The communication method may be either wired or wireless. For the wireless communication, a method conforming to existing wireless communication standards such as Wi-Fi (registered trademark) and Bluetooth (registered trademark) can be applied.

[0029] The non-volatile memory 103 is a non-volatile storage medium such as a hard disk or a flash memory. A data processing program 110 and a playback control program 120 are stored in the non-volatile memory 103. The RAM 102 is a work memory for the CPU 101 to execute processing. The CPU 101 loads the data processing program 110 or the playback control program 120 stored in the non-volatile memory 103 into the RAM 102, and executes processing according to the data processing program 110 or the playback control program 120. The CPU 101 is an example of a "processor" in the disclosed technology.

[0030] 4 is a functional block diagram showing an example of the functional configuration of the information processing device 10. The information processing device 10 has an image acquisition unit 11, an image specification information generation unit 12, a correspondence processing unit 13, and a playback control unit 14. When the CPU 101 executes a data processing program 110, the information processing device 10 functions as the image acquisition unit 11, the image specification information generation unit 12, and the correspondence processing unit 13. When the CPU 101 executes a playback control program 120, the information processing device 10 functions as the playback control unit 14.

[0031] The image acquisition unit 11 acquires a series of radiological images captured by continuously irradiating radiation in the radiological image capturing device 20. The series of radiological images are fluoroscopic images of the process in which a subject chews and swallows a sample in a swallowing contrast examination.

[0032] The image specification information generating unit 12 generates image specification information. The image specification information is information for specifying a radiation image selected from a series of radiation images according to the occurrence timing of a specific sound generated during the imaging period of the series of radiation images. The image specification information generating unit 12 recognizes the occurrence timing of the specific sound by a trigger signal transmitted from the voice recognition device 40. The image specification information generating unit 12 selects a radiation image acquired at the time of receiving the trigger signal from a series of radiation images acquired by the image acquiring unit 11 as an image (key frame) at the start or end of the period of interest. The image specification information generating unit 12 generates image specification information for specifying the selected image (key frame). For example, the image specification information generating unit 12 may generate, as the image specification information, information (i.e., a frame number) indicating the order of the radiation image (key frame) acquired at the time of receiving the trigger signal. The image specification information generating unit 12 may also generate, as the image specification information, information indicating the elapsed time from the start of acquisition of the series of radiation images to the time of receiving the trigger signal. When the image specifying information generating section 12 receives a plurality of trigger signals intermittently during the period in which a series of radiation images are captured, the image specifying information generating section 12 generates a plurality of pieces of image specifying information based on each of the plurality of trigger signals.

[0033] The association processing unit 13 associates the series of radiographic images acquired by the image acquisition unit 11 with the image identification information generated by the image identification information generation unit 12. For example, as shown in Fig. 5, the association processing unit 13 may associate the series of radiographic images with the image identification information by generating a data file 60 including image group data 61 including the series of radiographic images and image identification information 62. When a plurality of pieces of image identification information are generated based on a plurality of sounds intermittently emitted during the capture period of the series of radiographic images, the association processing unit 13 associates the plurality of pieces of image identification information with the series of radiographic images.

[0034] The association processing unit 13 stores a data file in which a series of radiation images are associated with the image specifying information in the recording medium 70. The recording medium 70 in which the data file is stored may be the non-volatile memory 103 included in the information processing device 10, or may be a recording medium included in an external image server (not shown).

[0035] The playback control unit 14 reads out the data file stored in the recording medium 70 and performs playback control to display a series of radiographic images included in the data file as a moving image. A moving image composed of a series of radiographic images is hereinafter referred to as an examination moving image. The playback control unit 14 causes the display 105 to display a playback screen 200, as exemplified in FIG. 6, and causes an examination moving image 201 to be displayed on the playback screen 200.

[0036] On the playback screen 200, a play / pause button 202, a stop button 203, skip buttons 204A and 204B, a seek bar 205, a slider 206, a key frame mark 207, and a playback time 208 are displayed together with the inspection video 201. The play / pause button 202 is an operation input means for playing and pausing the inspection video 201. The stop button 203 is an operation input means for stopping the playback of the inspection video 201. The seek bar 205 and the slider 206 indicate the current playback position of the inspection video 201. The user can change the playback position of the inspection video 201 by sliding the slider 206 on the seek bar 205.

[0037] The key frame mark 207 indicates the time position of the radiographic image (key frame) identified by the image identification information in the inspection moving image 201. The position on the seek bar 205 indicated by the key frame mark 207 is the time position of the key frame in the inspection moving image 201. In Fig. 6, there are two radiographic images (key frames) identified by the image identification information, and two key frame marks 207 corresponding to the two key frames are displayed.

[0038] The skip buttons 204A and 204B are operation input means for moving the playback position of the inspection video 201 to the position of a radiological image (key frame) identified by the image identification information. When the skip button 204A is pressed, the playback control unit 14 moves the playback position of the inspection video 201 to the position of the next key frame mark 207. When the skip button 204B is pressed, the playback control unit 14 moves the playback position of the inspection video 201 to the position of the previous key frame mark 207. The playback control unit 14 can identify a key frame in the inspection video 201 by referring to the image identification information.

[0039] The user can change the time position of the key frame in the inspection video 201 by changing the position on the seek bar 205 indicated by the key frame mark 207. The image identification information is changed in accordance with the change in the time position of the key frame in the inspection video 201. That is, the image identification information generating unit 12 changes the image identification information based on an operation for changing the time position of the key frame identified by the image identification information in the inspection video 201. This makes it possible to correct a shift in the time position of the radiological image identified by the image identification information, for example, due to a shift in the timing of generation of a trigger signal.

[0040] 7 is a flowchart showing an example of the flow of processing performed by the CPU 101 executing the data processing program 110. In step S1, the image acquisition unit 11 acquires a series of radiographic images captured by continuously irradiating radiation in the radiographic imaging device 20. The series of radiographic images are fluoroscopic images of the process in which a subject swallows a sample in a swallowing contrast examination. The acquisition of the series of radiographic images continues until the irradiation of radiation (fluoroscopic imaging) in the radiographic imaging device 20 ends.

[0041] During the period of capturing a radiological image, if the voice collected by the sound collection device 30 contains a specific voice, the voice recognition device 40 generates a trigger signal and transmits it to the information processing device 10.

[0042] In step S2, the image identification information generating unit 12 judges whether or not a trigger signal has been received. If it is judged that a trigger signal has been received, the process proceeds to step S3, and if it is judged that a trigger signal has not been received, the process proceeds to step S4.

[0043] In step S3, the image identification information generation unit 12 selects the radiation image acquired at the time the trigger signal is received as an image (key frame) at the start or end of the period of interest, and generates image identification information that identifies the selected image (key frame).

[0044] In step S4, the CPU 101 determines whether or not the radiographic image capturing has been completed. The determination as to whether or not the radiographic image capturing has been completed can be made based on, for example, a status signal supplied from the radiographic image capturing device 20. If it is determined that the radiographic image capturing has been completed, the process proceeds to step S7, and if it is determined that the radiographic image capturing has not been completed, the process returns to step S1.

[0045] In step S5, the CPU 101 determines whether or not radiography has been completed, similarly to step S4. If it is determined that radiography has been completed, the process proceeds to step S6, and if it is determined that radiography has not been completed, the process returns to step S1.

[0046] In step S6, the association processing unit 13 associates the series of radiographic images acquired in step S1 with the image specifying information generated in step S3. The association processing unit 13 may associate the series of radiographic images with the image specifying information by generating a data file 60 including image group data 61 including the series of radiographic images and image specifying information 62, as shown in Fig. 5, for example.

[0047] In step S7, the association processing unit 13 stores in the recording medium 70 a data file in which a series of radiation images are associated with the image specifying information.

[0048] As described above, the information processing device 10 according to an embodiment of the disclosed technology acquires a series of radiological images captured by continuously irradiating radiation, and when a specific sound is generated during the capture period of the series of radiological images, generates image identification information that identifies a radiological image from the series of radiological images to be selected according to the timing of the sound generation, and associates the image identification information with the series of radiological images.

[0049] In a swallowing contrast examination, radiation images taken during a period of interest necessary for diagnosis are the main object of observation. However, a series of radiation images taken during a swallowing contrast examination may include images taken during a period other than the period of interest. In this case, it is necessary to search for images during the period of interest from the series of radiation images taken, which places a heavy burden on the observer.

[0050] According to the information processing device 10 of this embodiment, information for identifying an image (key frame) at the start or end of a period of interest among a series of radiation images can be generated as image identification information. Then, the image identification information is associated with a series of radiation images. This makes it possible to easily extract an image (key frame) identified by the image identification information in playing a video (examination video) composed of a series of radiation images. For example, by operating the skip buttons 204A and 204B (see FIG. 6), it becomes possible to move the playback position of the examination video to a key frame. This makes it unnecessary to search for an image in the period of interest among a series of radiation images, and reduces the burden on the observer. That is, according to the information processing device 10 of this embodiment, it becomes possible to easily access a desired image among a series of radiation images.

[0051] Moreover, the image specification information is generated based on a trigger signal transmitted from the voice recognition device 40. The voice recognition device 40 generates a trigger signal when the voice collected by the sound collection device 30 is a specific voice. This makes it possible to generate image specification information based on the speech of, for example, a doctor or a radiologist. In other words, since it is possible to select an image (key frame) at the start or end of a period of interest by voice, the user does not need to perform a special operation to select a key frame.

[0052] In a swallowing contrast examination, radiographic images may be taken continuously while changing the combination of the subject's posture and the type of sample (i.e., while changing the examination level). In this case, multiple examination levels are mixed in one examination video, making it difficult to extract a portion related to a desired examination level from the examination video.

[0053] According to the information processing device 10 of the present embodiment, image specification information is generated to specify each of the radiographic images acquired at the timing of transition from one examination level to the next, and the image specification information is associated with a series of radiographic images, so that even if a plurality of examination levels are mixed in one examination video, it is easy to extract the portion related to each examination level from the series of radiographic images. For example, if a doctor or radiologist utters an utterance indicating the type of examination level to be performed when transitioning from one examination level to another, the voice recognition device 40 is configured to generate a trigger signal according to a word indicating the type of examination level contained in the utterance, so that it is possible to generate image specification information to specify the radiographic image acquired at the timing of transitioning from one examination level to another.

[0054] [Second embodiment] 8 is a diagram showing an example of the configuration of a radiographic image capturing system 1A according to a second embodiment of the disclosed technique. The radiographic image capturing system 1A differs from the radiographic image capturing system 1 according to the first embodiment (see FIG. 1) in that it further includes an optical camera 80.

[0055] The optical camera 80 is a digital video camera that captures optical images. A series of optical images are captured by the optical camera 80 in parallel with the capture of a series of radiation images by the radiation image capture device 20. The optical images captured by the optical camera 80 are immediately transmitted to the information processing device 10.

[0056] The image acquiring unit 11 acquires a series of radiological images captured by continuously irradiating radiation in the radiological image capturing device 20. The series of radiological images are fluoroscopic images of the process in which the subject chews and swallows a sample in a swallowing contrast examination. The image acquiring unit 11 further acquires a series of optical images captured continuously in parallel with capturing the series of radiological images. The series of optical images are optical images of the process in which the subject chews and swallows a sample in a swallowing contrast examination.

[0057] The image identification information generating unit 12 generates first image identification information and second image identification information. The first image identification information is information for identifying a radiographic image selected from a series of radiographic images according to the timing of a specific sound generated during the imaging period of the radiographic images. The second image identification information is information for identifying an optical image selected from a series of optical images according to the timing of a specific sound generated during the imaging period of the optical images.

[0058] The image identification information generating unit 12 recognizes the timing of occurrence of a specific voice by a trigger signal transmitted from the voice recognition device 40. The image identification information generating unit 12 selects, from a series of radiation images acquired by the image acquiring unit 11, a radiation image acquired at the time of receiving the trigger signal as a radiation image (key frame) at the start or end of the period of interest. The image identification information generating unit 12 generates first image identification information for identifying the selected radiation image (key frame). Similarly, the image identification information generating unit 12 selects, from a series of optical images acquired by the image acquiring unit 11, an optical image acquired at the time of receiving the trigger signal as an optical image (key frame) at the start or end of the period of interest. The image identification information generating unit 12 generates second image identification information for identifying the selected optical image (key frame). The first image identification information and the second image identification information are generated based on a common trigger signal. That is, the radiation image identified by the first image identification information and the optical image identified by the second image identification information are images captured at the same time.

[0059] The association processing unit 13 associates the series of radiographic images acquired by the image acquiring unit 11 with the first image identification information generated by the image identification information generating unit 12. The association processing unit 13 also associates the series of optical images acquired by the image acquiring unit 11 with the second image identification information generated by the image identification information generating unit 12. When a plurality of pieces of first image identification information and a plurality of pieces of second image identification information are generated based on a plurality of sounds intermittently emitted during the capturing period of the series of radiographic images and the series of optical images, the association processing unit 13 associates the plurality of pieces of first image identification information with the series of radiographic images and associates the plurality of pieces of second image identification information with the series of optical images.

[0060] The association processing unit 13 stores a data file in which a series of radiation images are associated with the first image specifying information in the recording medium 70. The association processing unit 13 also stores a data file in which a series of optical images are associated with the second image specifying information in the recording medium 70.

[0061] The playback control unit 14 reads out a data file stored in the recording medium 70, and controls the playback of a radiation video (hereinafter referred to as a first inspection video) composed of a series of radiation images included in the data file, and an optical video (hereinafter referred to as a second inspection video) composed of a series of optical images.

[0062] 9 on the display 105, and simultaneously displays a first inspection video 201A and a second inspection video 201B on the playback screen 200. The playback control unit 14 plays back the first inspection video 201A and the second inspection video 201B so that images at the same time are displayed.

[0063] The key frame mark 207 indicates the time position in the first test video 201A and the second test video 201B of the radiological image and the optical image (key frame) respectively identified by the first image identification information and the second image identification information. The position on the seek bar 205 indicated by the key frame mark 207 is the time position in the test video of the key frame.

[0064] The skip buttons 204A and 204B are operation input means for moving the playback positions of the first inspection video 201A and the second inspection video 201B to the positions of the radiographic images (key frames) specified by the first image specifying information and the second image specifying information. When the skip button 204A is pressed, the playback control unit 14 moves the playback positions of the first inspection video 201A and the second inspection video 201B to the positions of the next key frame marks 207. When the skip button 204B is pressed, the playback control unit 14 moves the playback positions of the first inspection video 201A and the second inspection video 201B to the positions of the previous key frame marks 207. The playback control unit 14 can specify key frames in the first inspection video 201A and the second inspection video 201B by referring to the first image specifying information and the second image specifying information.

[0065] As described above, the information processing device 10 according to the second embodiment of the disclosed technology acquires a series of optical images that are continuously captured in parallel with the capture of a series of radiation images, and plays back each of the radiation video composed of the series of radiation images and the optical video composed of the series of optical images so that the images at the same time are displayed.

[0066] In a swallowing contrast examination, it may be difficult to grasp the progress of the examination and the condition of the subject from only the radiation images. By playing back the radiation video and the optical video so that the images at the same time are displayed, it becomes easier to grasp the progress of the examination and the condition of the subject.

[0067] [Third embodiment] 10 is a functional block diagram showing an example of a functional configuration of an information processing device 10A according to a third embodiment of the disclosed technology. The information processing device 10A differs from the information processing device 10 according to the first embodiment (see FIG. 4) in that the information processing device 10A further includes an image extraction unit 15.

[0068] The image extracting unit 15 extracts a portion of the series of radiation images from the radiation image sequence starting from the radiation image specified by the image specifying information, and generates a data file including the extracted portion of the radiation images.

[0069] Fig. 11A is a diagram showing an example of image extraction processing by the image extracting section 15. A series of radiation images acquired by the image acquiring section 11 constitute each frame of the examination video. Fig. 11A illustrates a case where a series of radiation images corresponding to the first frame to the nth frame of the examination video are acquired by the image acquiring section 11. The fourth frame shown by hatching in Fig. 11A is an image (key frame) identified by image identification information.

[0070] The image extraction unit 15 extracts a part of radiographic images starting from the fourth frame specified by the image specification information from a series of radiographic images corresponding to the first frame to the nth frame of the examination video. FIG. 11A illustrates an example in which radiographic images corresponding to the fourth frame to the nth frame are extracted. The image extraction unit 15 generates a data file 60A including the extracted radiographic images corresponding to the fourth frame to the nth frame. The image extraction unit 15 stores the generated data file 60A in the recording medium 70.

[0071] The recording medium 70 stores an original data file containing a series of radiation images corresponding to the first frame to the nth frame of the examination video, and a data file generated by the image extraction unit 15 containing radiation images corresponding to the fourth frame to the nth frame.

[0072] Fig. 11B is a diagram showing another example of the image extraction process by the image extractor 15. The fourth and seventh frames shown by hatching in Fig. 11B are images (key frames) identified by the image identification information.

[0073] The image extraction unit 15 extracts some radiographic images starting from the fourth and seventh frames specified by the image specification information from a series of radiographic images corresponding to the first to nth frames of the examination video. FIG. 11B illustrates an example in which radiographic images corresponding to the fourth to sixth frames and radiographic images corresponding to the seventh to nth frames are extracted. The image extraction unit 15 generates a data file 60B including the extracted radiographic images corresponding to the fourth to sixth frames and a data file 60C including the extracted radiographic images corresponding to the seventh to nth frames. The image extraction unit 15 stores the generated data files 60B and 60C in the recording medium 70.

[0074] The playback control unit 14 reads out the data files stored in the recording medium 70 and controls the playback of a moving image composed of radiation images included in the data files. The data file to be played back can be specified by the user. For example, when the data file 60C shown in FIG. 11B is specified as the data file to be played back, the examination moving image composed of the 7th frame to the nth frame is played back.

[0075] As described above, the information processing device 10A according to the third embodiment of the disclosed technology extracts some radiographic images from a series of radiographic images starting from a radiographic image specified by the image specifying information, and generates a data file including the extracted some radiographic images. According to the information processing device 10A according to this embodiment, by setting the image specifying information to specify, for example, a radiographic image at the start point of a period of interest, it is possible to generate a data file in which images in the period of interest are extracted from a series of radiographic images captured. This makes it unnecessary to search for images in the period of interest from a series of radiographic images, thereby reducing the burden on the user. In other words, according to the information processing device 10A according to this embodiment, it is possible to easily access a desired image from a series of radiographic images.

[0076] In the above explanation, an example has been given of extracting some radiological images from a series of radiological images starting from a radiological image identified by image identification information, but it is also possible to extract some radiological images from a series of radiological images starting from a radiological image identified by image identification information.

[0077] [Fourth embodiment] 12 is a functional block diagram showing an example of a functional configuration of an information processing device 10B according to a fourth embodiment of the disclosed technology. The information processing device 10B differs from the information processing device 10A according to the third embodiment (see FIG. 10) in that the information processing device 10B further includes a related information acquisition unit 16.

[0078] In this embodiment, when the captured voice contains a predetermined specific term indicating the content of the examination level in a swallowing contrast examination, the voice recognition device 40 generates identification information of the examination level indicated by the term as associated information related to the capture of the radiological image.

[0079] The specific terms indicating the contents of the examination level may include terms indicating the type of sample swallowed by the subject in the swallowing contrast examination, such as "water," "thick," "chopped," and "curd." In this case, the related information includes identification information for the type of sample. The specific terms indicating the contents of the examination level may also include terms indicating the type of posture taken by the subject in the swallowing contrast examination, such as "45°," "supine," and "prone." In this case, the related information includes identification information for the type of posture of the subject. The specific terms indicating the contents of the examination level may also include terms indicating the type of imaging direction of the radiographic image taken in the swallowing contrast examination, such as "frontal imaging" and "side imaging." In this case, the related information includes identification information for the type of imaging direction.

[0080] For example, when the voice collected by the sound collection device 30 includes the term "toromi" indicating the contents of the inspection level, the voice recognition device 40 generates identification information corresponding to "toromi" as related information. In this case, the voice recognition device 40 may generate, for example, a text describing "toromi" or a level code consisting of letters, numbers, symbols, or a combination of these corresponding to "toromi" as related information. When the recognized voice includes a specific term, the voice recognition device 40 immediately generates related information and immediately transmits it to the information processing device 10B. That is, the related information is transmitted to the information processing device 10B immediately after the generation of a voice including a specific term. When an utterance including a specific term is made intermittently over a plurality of times, related information corresponding to each utterance is generated in sequence, and these are transmitted in sequence to the information processing device 10B.

[0081] The related information acquisition unit 16 acquires related information generated by the voice recognition device 40. The related information is information related to the shooting contents of the series of radiation images acquired by the image acquisition unit 11. Specifically, identification information of the examination level generated based on the speech of a doctor or radiologist when shooting the series of radiation images is acquired as the related information. The related information is acquired immediately after the generation of a voice containing a specific term. When multiple pieces of related information are generated intermittently, these pieces of related information are acquired sequentially by the related information acquisition unit 16.

[0082] The association processing unit 13 associates the series of radiological images acquired by the image acquiring unit 11, the image identifying information generated by the image identifying information generating unit 12, and the associated information acquired by the associated information acquiring unit 16. Specifically, the association processing unit 13 associates the associated information acquired within a predetermined period before and after the reception of a trigger signal with a radiological image (key frame) identified by the image identifying information generated in response to the trigger signal.

[0083] FIG. 13 is a diagram showing an example of the association process in the association processing unit 13 and the image extraction process by the image extraction unit 15. The fourth frame and the seventh frame shown by hatching in FIG. 13 are images (key frames) specified by the image specification information, respectively. This means that a trigger signal was received at the time of acquisition of the fourth frame and the time of acquisition of the seventh frame, respectively. In the example shown in FIG. 13, related information corresponding to "thickness" is acquired within a predetermined period before and after the time of receiving the trigger signal corresponding to the fourth frame, and this related information is associated with the fourth frame. Also, related information corresponding to "cut" is acquired within a predetermined period before and after the time of receiving the trigger signal corresponding to the seventh frame, and this related information is associated with the seventh frame.

[0084] The image extraction unit 15 generates a data file 60D in which the radiation images constituting the fourth to sixth frames correspond to related information corresponding to "thickness". The image extraction unit 15 also generates a data file 60E in which the radiation images constituting the seventh to nth frames correspond to related information corresponding to "notches". The image extraction unit 15 stores the generated data files 60D and 60E in the recording medium 70.

[0085] As described above, the information processing device 10B according to the fourth embodiment of the disclosed technology extracts some radiographic images from a series of radiographic images, with a radiographic image specified by image specifying information as a start point or an end point, in the same manner as the third embodiment. In addition, the information processing device 10B obtains related information related to the shooting contents of the series of radiographic images, and generates a data file in which the related information is associated with the some radiographic images extracted from the series of radiographic images.

[0086] In a swallowing contrast examination, radiographic images may be taken continuously while changing the combination of the subject's posture and the type of sample (i.e., while changing the examination level), and multiple examination levels may be mixed in one examination video. In this case, it is necessary to accurately match the contents of the examination level to the frames related to that examination level so that it is possible to know which part of a series of radiographic images corresponds to which examination level.

[0087] According to the information processing device 10B of this embodiment, by using image identification information to identify a radiographic image at the time of transition of the inspection level, it is possible to generate a plurality of data files corresponding to each of the plurality of inspection levels. Also, it is possible to include related information indicating the contents of the corresponding inspection level in each of the plurality of data files. Also, based on the recognized voice, a series of radiographic images are divided for each inspection level, and the contents of the inspection level are associated with each divided image, so that the burden on the user can be reduced.

[0088] In the present embodiment, the case where the related information is generated by voice recognition is illustrated, but the disclosed technology is not limited to this. For example, the related information can be generated by operating a function button or a keyboard.

[0089] In the above first to fourth embodiments, the disclosed technology is applied to a radiographic image acquired in a videofluoroscopic examination, but the disclosed technology is not limited to this embodiment. The disclosed technology can be applied to any radiographic image acquired in an examination or diagnosis other than a videofluoroscopic examination.

[0090] In addition, in each of the above embodiments, the radiographic imaging system 1, 1A is illustrated as having a configuration including the voice recognition device 40, but the information processing device 10, 10A, 10B may have at least a part of the functions of the voice recognition device 40. For example, the voice recognition device 40 may transmit a voice recognition result to the information processing device 10, 10A, 10B, and the information processing device 10, 10A, 10B may generate image specification information and related information based on the recognized voice. Also, the information processing device 10, 10A, 10B may recognize voice and generate image specification information and related information based on the recognized voice.

[0091] The hardware for executing the processes in each functional unit of the information processing devices 10, 10A, and 10B may be various processors as shown below. The processor may be a CPU that executes software (programs) and functions as various processing units. The processor may also be a programmable logic device (PLD) that can change the circuit configuration, such as an FPGA. The processor may also have a circuit configuration designed specifically for executing specific processes, such as an application specific integrated circuit (ASIC).

[0092] Each of the functional units of the information processing devices 10, 10A, and 10B may be configured with one of the various processors described above, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs or a combination of a CPU and an FPGA). Also, multiple functional units may be configured with one processor.

[0093] In the above embodiment, the data processing program 110 and the playback control program 120 are stored (installed) in advance in the non-volatile memory 103, but the present invention is not limited to this. The data processing program 110 and the playback control program 120 may be provided in a form recorded on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), or a USB (Universal Serial Bus) memory. The data processing program 110 and the playback control program 120 may be downloaded from an external device via a network.

[0094] The following supplementary notes are further disclosed regarding the above first to fourth embodiments. (Appendix 1) An information processing device having at least one processor, The processor, A series of radiographic images are obtained by successively irradiating the radiation; generating image identification information for identifying a radiographic image to be selected from the series of radiographic images in accordance with a timing of generation of the sound when the sound generated during the period of capturing the series of radiographic images is a specific sound; Corresponding the image identification information to the series of radiation images Information processing device.

[0095] (Appendix 2) The specific voice is a speech containing a specific word. 2. An information processing device according to claim 1.

[0096] (Appendix 3) The specific sound is a specific body sound. 3. An information processing device according to claim 1 or 2.

[0097] (Appendix 4) The processor, generating a plurality of pieces of image-specific information based on a plurality of sounds intermittently generated during the capturing period of the series of radiation images; Corresponding the plurality of pieces of image-identifying information to the series of radiation images. 4. An information processing device according to claim 1.

[0098] (Appendix 5) The processor displays a time position of the radiation image identified by the image identification information within a moving image constituted by the series of radiation images. 5. An information processing device according to any one of claims 1 to 4.

[0099] (Appendix 6) The processor changes the image specifying information based on an operation of changing a time position of the radiation image specified by the image specifying information in the moving image constituted by the series of radiation images. 6. An information processing device according to any one of claims 1 to 5.

[0100] (Appendix 7) The processor, acquiring a series of optical images that are continuously captured in parallel with the capture of the series of radiological images; The radiation moving image constituted by the series of radiation images and the optical moving image constituted by the series of optical images are each reproduced so that images at the same time are displayed. 7. An information processing device according to any one of claims 1 to 6.

[0101] (Appendix 8) The processor extracts a portion of the series of radiation images from the series of radiation images, using the radiation image specified by the image specifying information as a start point or an end point, and generates a data file including the extracted portion of the radiation images. 8. An information processing device according to any one of claims 1 to 7.

[0102] (Appendix 9) The processor, Acquire relevant information related to the imaging content of the series of radiation images; A data file is generated in which the related information and the part of the radiation image are associated with each other. 9. The information processing device according to claim 8.

[0103] (Appendix 10) A series of radiographic images are obtained by successively irradiating the radiation; generating image identification information for identifying a radiographic image to be selected from the series of radiographic images in accordance with a timing of generation of the sound when the sound generated during the period of capturing the series of radiographic images is a specific sound; Corresponding the image identification information to the series of radiation images An information processing method in which processing is executed by at least one processor provided in an information processing device.

[0104] (Appendix 11) A series of radiographic images are obtained by successively irradiating the radiation; generating image identification information for identifying a radiographic image to be selected from the series of radiographic images in accordance with a timing of generation of the sound when the sound generated during the period of capturing the series of radiographic images is a specific sound; Corresponding the image identification information to the series of radiation images A program for causing at least one processor of an information processing device to execute a process. [Explanation of symbols]

[0105] 1. 1A Radiography System 10, 10A, 10B Information processing device 11 Image acquisition section 12 Image specific information generation unit 13 Correspondence Processing Unit 14 Playback control section 15 Image Extraction Section 16 Related Information Acquisition Department 20 Radiation imaging device 21 Photo stand 22 Stand 23 Pillar 24 Radiation Generation Unit 25 Radiation source 26 Collimator 27 Radiation Detector 30 Sound recording device 40 Voice recognition device 50 Wheelchair 60, 60A, 60B, 60C, 60D, 60E Data Files 61 Image Group Data 62 Related Information 70 Recording media 101 CPU 102 RAM 103 Non-volatile memory 104 Input Devices 105 Display 106 Communication Interface 108 Bus 110 Data Processing Program 120 Playback Control Program 200 playback screen 201, 201A, 201B inspection video 202 Play / Pause button 203 Stop button 204A, 204B Skip button 205 Seek Bar 206 Slider 207 Keyframe Mark 208 Playing Time

Claims

1. An information processing device including at least one processor, The processor, A series of radiographic images are obtained by successively irradiating the radiation; generating image identification information for identifying a radiographic image to be selected from the series of radiographic images in accordance with a timing of generation of the sound when the sound generated during the capturing period of the series of radiographic images is a specific sound; Corresponding the image identification information to the series of radiation images Information processing device.

2. The specific voice is a speech containing a specific word. The information processing device according to claim 1 .

3. The specific sound is a specific body sound. The information processing device according to claim 1 .

4. The processor, generating a plurality of pieces of image-specific information based on a plurality of sounds intermittently generated during the capturing period of the series of radiation images; Corresponding the plurality of pieces of image-identifying information to the series of radiation images. The information processing device according to claim 1 .

5. The processor displays a time position of the radiation image identified by the image identification information within a moving image constituted by the series of radiation images. The information processing device according to claim 1 .

6. The processor changes the image specifying information based on an operation of changing a time position of the radiation image specified by the image specifying information in the moving image constituted by the series of radiation images. The information processing device according to claim 1 .

7. The processor, acquiring a series of optical images that are continuously captured in parallel with the capture of the series of radiological images; The radiation moving image constituted by the series of radiation images and the optical moving image constituted by the series of optical images are each reproduced so that images at the same time are displayed. The information processing device according to claim 1 .

8. The processor extracts a portion of the series of radiation images from the series of radiation images, using the radiation image specified by the image specifying information as a start point or an end point, and generates a data file including the extracted portion of the radiation images. The information processing device according to claim 1 .

9. The processor, Acquire relevant information related to the imaging content of the series of radiation images; A data file is generated in which the related information and the part of the radiation image are associated with each other. The information processing device according to claim 8.

10. A series of radiographic images are obtained by successively irradiating the radiation; generating image identification information for identifying a radiographic image to be selected from the series of radiographic images in accordance with a timing of generation of the sound when the sound generated during the period of capturing the series of radiographic images is a specific sound; Corresponding the image identification information to the series of radiation images An information processing method in which processing is executed by at least one processor included in an information processing device.

11. A series of radiographic images are obtained by successively irradiating the radiation; generating image identification information for identifying a radiographic image to be selected from the series of radiographic images in accordance with a timing of generation of the sound when the sound generated during the period of capturing the series of radiographic images is a specific sound; Corresponding the image identification information to the series of radiation images A program for causing at least one processor included in an information processing device to execute a process.

Images