Information processing device, medical image acquisition device, information processing method, and information processing program

Abstract

The present invention provides an information processing device, a medical imaging device, an information processing method, and an information processing program that can provide instructions and guidance at appropriate intervals, even when imaging multiple body parts in a single continuous scan. [Solution] The console (information processing device) 4 includes a recognition unit 403A that recognizes the shooting period in which parts of the subject associated with predetermined presentation conditions for presenting instructions and guidance are photographed from the captured images obtained in chronological order by photographing the subject, and a presentation unit 403B that presents instructions and guidance according to the recognized shooting period.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, a medical imaging apparatus, an information processing method, and an information processing program.

Background Art

[0002] In recent years, with the progress of medical devices such as CT (Computed Tomography) devices and MRI (Magnetic Resonance Imaging) devices, higher-quality and higher-resolution three-dimensional images have come to be used for medical diagnosis.

[0003] Conventionally, as a technique that can be applied to suppress a decrease in the quality of a captured image during a capture period of a part such as an organ targeted for capture when continuously capturing a subject by a capture device in a CT device, an MRI device, or the like, there has been the following technique.

[0004] Patent Document 1 discloses an X-ray CT device aimed at enabling main imaging to be performed at an appropriate timing in imaging of a tomographic image using a contrast agent.

[0005] In this X-ray CT device, a monitoring region of a subject for performing monitoring imaging, an auto voice start threshold value, and an imaging start threshold value are set. After starting the monitoring imaging, a monitoring CT value (concentration value of the contrast agent in the tomographic image) is acquired. When the monitoring CT value reaches the auto voice start threshold value, the auto voice is started. When the monitoring CT value reaches the imaging start threshold value, the main imaging is started. <00​​​​​This X-ray CT computed tomography system is an X-ray computed tomography system that determines the timing of the start of the main scan by monitoring the concentration of contrast agent administered to the subject by prep scan, and comprises a speaker that outputs guidance to the subject, and a real prep control unit that supplies an audio signal to the speaker to output audio guidance when the CT value or contrast agent concentration of the tomographic image data obtained by prep scan reaches or exceeds a guidance threshold, and starts the execution or preparation for the execution of the main scan when the CT value or contrast agent concentration reaches or exceeds a threshold for the main scan.

[0008] Patent Document 3 discloses an X-ray CT apparatus aimed at enabling safe operation without increasing the burden on the user.

[0009] This X-ray CT scanner includes a motion detection unit that detects whether or not there is a moving object in the examination room where the stand is located, a first sound output unit that outputs a first sound, and a second sound output unit that outputs a second sound. It performs monitoring imaging on a subject who has been administered a contrast agent based on first irradiation conditions, and determines the time-changing CT value of the region of interest in the image data generated by the imaging. If the CT value of the region of interest is the first CT value and there is a moving object in the examination room, it outputs a first sound. If the CT value of the region of interest is the first CT value and there is no moving object in the examination room, it avoids outputting sound.

[0010] Patent Document 4 discloses an X-ray CT scanner that aims to reduce the burden on the subject during examination using an X-ray CT scanner, eliminate the complexity of the examination by omitting breathing instructions from the technician, and prevent the deterioration of X-ray CT image quality due to failure to hold one's breath.

[0011] This X-ray CT scanner sets the output position of the pre-sound in the scanning range setting screen to a position after the position at the start of scanning, and sets the output position of the post-sound between the position at the end of scanning and the pre-sound output position. It also executes a breath-hold command when the pre-sound output position is detected, and executes a breath-hold release command when the post-sound output position is detected. [Prior art documents] [Patent Documents]

[0012] [Patent Document 1] Japanese Patent Publication No. 2007-111255 [Patent Document 2] Japanese Patent Publication No. 2003-245275 [Patent Document 3] Japanese Patent Publication No. 2012-070890 [Patent Document 4] Japanese Patent Publication No. 2009-189635 [Overview of the project] [Problems that the invention aims to solve]

[0013] Incidentally, when conventionally imaging multiple body parts such as the lungs and lumbar spine in a single continuous imaging motion, an imaging sequence is set for each body part to be imaged, and voice guidance is associated with that imaging sequence. Therefore, if voice guidance such as "Hold your breath" or "Relax" is to be given for each body part being imaged during imaging, the voice guidance associated with the imaging sequence set for the corresponding body part should be played sequentially.

[0014] In contrast, when multiple body parts are to be photographed consecutively in a single shooting operation, there is a demand for a system that allows each body part to be photographed using a single shooting sequence.

[0015] However, in this case, while voice guidance can be played at the start and end of the shooting sequence, there was a problem in that it was difficult to play voice guidance for the next body part to be photographed at the appropriate time during the shooting sequence. This is because there is no trigger to play the corresponding voice guidance during the shooting sequence.

[0016] In contrast, the technologies disclosed in the aforementioned patent documents determine the duration of voice guidance playback based on factors such as the contrast agent concentration and the position of the examination bed where the patient lies, and therefore cannot be applied to technologies that play voice guidance according to the imaging sequence. This problem is not limited to the playback of voice guidance, but can also occur when various instructions and guidance are presented to the patient through displays on a display unit or printing by an image forming apparatus. Furthermore, this problem is not limited to the use of imaging sequences for imaging, but can also occur when determining the timing of imaging using other pre-set imaging information.

[0017] This disclosure is made in view of the above points, and aims to provide an information processing device, a medical image acquisition device, an information processing method, and an information processing program that can display instructions and guidance at appropriate intervals even when imaging multiple body parts in a single continuous imaging sequence. [Means for solving the problem]

[0018] An information processing device in a first embodiment of the technology of this disclosure includes a processor, which recognizes from captured images obtained in a time series by photographing a subject a period during which a part of the subject associated with a predetermined presentation condition for presenting instructions is photographed, and presents instructions according to the recognized period of photography.

[0019] The information processing apparatus according to the second aspect of the technology of the present disclosure is the information processing apparatus according to the first aspect, wherein the shooting period includes at least one of any time points within a period after the start of a shooting sequence indicating the shooting procedure and before the end of the shooting sequence, and after the start and before the end.

[0020] The information processing apparatus according to the third aspect of the technology of the present disclosure is the information processing apparatus according to the first aspect or the second aspect, wherein the processor determines that the shooting period may arrive from the captured image, and presents an instruction guidance according to the determined shooting period.

[0021] The information processing apparatus according to the fourth aspect of the technology of the present disclosure is the information processing apparatus according to the third aspect, wherein the processor determines that the shooting period may arrive by using shooting conditions preset corresponding to the shooting of the subject.

[0022] The information processing apparatus according to the fifth aspect of the technology of the present disclosure is the information processing apparatus according to the third aspect, wherein the processor determines that the shooting period may arrive by determining that other parts included in the captured image can be captured from the parts recognized by image recognition of the captured image.

[0023] The information processing apparatus according to the sixth aspect of the technology of the present disclosure is the information processing apparatus according to the fifth aspect, wherein the processor further presents a cross-sectional image corresponding to the captured image in which the shooting period is recognized, with the part recognized by image recognition in a state different from other parts.

[0024] The information processing apparatus according to the seventh aspect of the technology of the present disclosure is the information processing apparatus according to the first aspect or the second aspect, wherein the instruction guidance is an audio guidance by voice, and the processor reproduces the audio guidance according to the recognized shooting period.

[0025] The information processing apparatus according to the eighth aspect of the technology of the present disclosure is the information processing apparatus according to the first aspect or the second aspect, wherein the instruction guidance is display guidance by display, and the processor displays the display guidance according to the recognized shooting period.

[0026] The medical image capturing apparatus according to the ninth aspect of the technology of the present disclosure includes the information processing apparatus of the present disclosure and an image capturing apparatus that performs actual shooting of medical images while instruction guidance is presented by the information processing apparatus. <00001,00><00001,01><00001,02>The information processing method according to the tenth aspect of the technology of the present disclosure is such that the processor recognizes, from the captured images obtained in time series by capturing a subject, the shooting period during which a part associated with a presentation condition for presenting a predetermined instruction guidance to the subject is captured, and presents the instruction guidance according to the recognized shooting period. <00001,03><00001,04><00001,05>The information processing program according to the eleventh aspect of the technology of the present disclosure causes a computer to execute a process of recognizing, from the captured images obtained in time series by capturing a subject, the shooting period during which a part associated with a presentation condition for presenting a predetermined instruction guidance to the subject is captured, and presenting the instruction guidance according to the recognized shooting period. <00001,06>

Advantages of the Invention

Brief Description of the Drawings

[0031] Hereinafter, an example of an embodiment of the technology of this disclosure will be described with reference to the drawings. In this example, the case in which audio guidance is used as the presentation of instructions and guidance for the technology of this disclosure will be described. In each drawing, the same or equivalent components and parts are given the same reference numerals. Also, the dimensional ratios in the drawings are exaggerated for illustrative purposes and may differ from the actual ratios.

[0032] Figure 1 is a diagram showing a schematic configuration of a medical diagnostic device including an information processing device and a medical image acquisition device according to an embodiment of the technology of this disclosure. In this embodiment, the configuration of one embodiment of an X-ray CT (Computed Tomography) device is shown as the medical diagnostic device. However, the medical diagnostic device of this disclosure is not limited to an X-ray CT device and can be applied to other medical diagnostic devices such as MRI (Magnetic Resonance Imaging) devices.

[0033] The medical diagnostic apparatus according to this embodiment comprises a scanner 1, a patient table 3, and a console 4. The console 4 corresponds to the information processing device of this disclosure, the scanner 1 corresponds to the image acquisition device of this disclosure, and the combination of the scanner 1, patient table 3, and console 4 corresponds to the medical image acquisition device of this disclosure.

[0034] Scanner 1 is the part that performs the CT scan. Scanner 1 comprises a gantry 11, a rotating plate 12 having an opening in its central part and rotatably supported by the gantry 11, an X-ray tube device 13 fixed to the rotating plate 12, a collimator 14 provided at the X-ray emission port of the X-ray tube device 13, an X-ray detector 15 positioned opposite the X-ray tube device 13 with the opening of the rotating plate 12 in between, and a rotating plate drive device 17 provided on the gantry 11.

[0035] Furthermore, the rotating plate 12 of the scanner 1 includes a collimator control device 18 that controls the collimator 14 to change the X-ray irradiation field, a rotating plate drive control device 19 that controls the drive of the rotating plate drive device 17, an X-ray high voltage generator 20 that supplies power for X-ray generation to the X-ray tube device 13 and controls the X-ray generation conditions, a data acquisition device 16 that collects the output of the X-ray detector 15, and a data transmission device 21 that transmits the data collected by the data acquisition device 16. Power and control signals are supplied to each unit on the rotating plate 12, and data is extracted from each unit on the rotating plate 12 via a slip ring (not shown) provided between the frame 11 and the rotating plate 12.

[0036] The examination bed 3 moves the subject between the preparation position for imaging and the imaging position. The subject is placed on the top plate 31. The top plate 31 has vertical movement mechanisms and horizontal movement mechanisms, which are not shown in the diagram. The examination bed 3 is also equipped with an examination bed control device 32, a top plate vertical movement control device 33, and a top plate horizontal movement control device 34 to control the operation of the vertical movement mechanism and horizontal movement mechanism of the top plate 31.

[0037] Console 4 controls a medical diagnostic device, which is an X-ray CT scanner. Console 4 is an example of the computer of this disclosure. Console 4 comprises a CPU (Central Processing Unit) 41, ROM (Read Only Memory) 42, RAM (Random Access Memory) 43, and storage 44. Console 4 may also further comprise an input unit 45 and a display unit 46.

[0038] A CPU 41, which is an example of a processor, is a central processing unit that executes various programs and controls various parts. Specifically, the CPU 41 reads a program from the ROM 42 or storage 44 and executes the program using the RAM 43 as a working area. The CPU 41 controls each of the above components and performs various calculations according to the program recorded in the ROM 42 or storage 44. In this embodiment, the ROM 42 or storage 44 stores a control program for a medical diagnostic device, which includes information processing such as determining the imaging range in the actual imaging by the X-ray CT device and playing back voice guidance. The program related to said information processing corresponds to the information processing program of this disclosure, and the processing method by said information processing corresponds to the information processing method of this disclosure.

[0039] ROM 42 stores various programs and data. RAM 43 temporarily stores programs or data as a working area. Storage 44 consists of a storage device such as an HDD (Hard Disk Drive), SSD (Solid State Drive), or flash memory, and stores various programs including the operating system, and various data.

[0040] The input unit 45 includes a pointing device such as a mouse and a keyboard, and is used for various types of input. The input unit 45 also includes a bed control unit for adjusting the height of the bed 3.

[0041] The display unit 46 is, for example, a liquid crystal display and displays various information. The display unit 46 may also function as an input unit 45 by employing a touch panel system.

[0042] In this embodiment, console 4 is connected to the hospital information system 5 of the hospital where the X-ray CT scanner is installed. The hospital information system 5 includes a patient information management system 51 and an examination reservation system 52.

[0043] The patient information management system 51 is a database containing personal information, medical data, test image data, test data, and medication data of patients who have received medical treatment at the hospital in the past. Patient personal information includes personally identifiable information such as name, ID (Identification), date of birth, age, and gender, as well as physical information such as height and weight, and past consultation dates. This personal information is entered into the system when a patient visits the hospital and receives medical treatment. The patient's height and weight are collected through self-reporting on a medical questionnaire or through actual measurement and entered into the patient information management system 51. Furthermore, medical data, test image data, test data, and medication data are entered into the patient information management system 51 each time a patient receives treatment, creating an in-hospital patient database.

[0044] On the other hand, the above-mentioned examination data includes information about the examination of the patient, such as the non-organ areas to be examined, the organs to be examined, and the scan protocol applied during the examination. Here, the non-organ areas to be examined refer to information indicating body parts such as the head, chest, abdomen, or thoracoabdomen, while the organs to be examined refer to information indicating the organs themselves, such as the lungs or stomach. The scan protocol refers to information indicating the settings applied during the actual imaging, such as the imaging mode to be applied during the examination, the mAs value to be set in the X-ray tube device 13, and the initial settings for the imaging range.

[0045] The examination reservation system 52 creates a daily examination schedule based on information stored or written to the patient information management system 51 for each medical diagnostic device system installed in the hospital, and distributes the created examination schedule as data to each system. The examination schedule includes the order in which patients will receive examinations on that day using the medical diagnostic device, as well as each patient's personal identification information and physical information. The contents of the examination reservation system 52 are updated sequentially in accordance with the progress of medical treatment on that day, and the updated data is transmitted to each system each time it is updated.

[0046] A camera 7 is mounted on the ceiling of the imaging room equipped with a medical diagnostic device, in a position that allows it to photograph an area within the movable range of the examination table 3. The camera 7 in this embodiment is capable of obtaining an optical image (hereinafter referred to as "camera image") within the field of view by taking a photograph. In this embodiment, a camera 7 that captures color still images is used, but the embodiment is not limited to this configuration. For example, a camera 7 that captures monochrome still images may be used, or a camera 7 that captures color or monochrome moving images may be used.

[0047] When executing the control program for the medical diagnostic device described above, console 4 uses the hardware resources described above to implement various functions. The functional configuration implemented by console 4 will be described below.

[0048] Figure 2 is a block diagram showing an example of the functional configuration of Console 4.

[0049] As shown in Figure 2, the console 4 has a functional configuration consisting of a scanogram image acquisition unit 401, a shooting range determination unit 402, an examination control unit 403, an irradiation control unit 404, a noise reduction unit 405, and a patient bed control unit 406. Each functional configuration is realized by the CPU 41 reading and executing the control program of the medical diagnostic device stored in the ROM 42 or storage 44.

[0050] The scanogram image acquisition unit 401 performs the process of acquiring a scanogram image of the subject based on the irradiation of X-rays to the subject controlled by the irradiation control unit 404, which will be described later. The scanogram image can be obtained by detecting the X-rays that have passed through the subject with the X-ray detector 15. The scanogram image acquisition unit 401 acquires a scanogram image that includes at least the most protruding region of the subject's abdomen (in this embodiment, the central part of the abdomen). Note that the scanogram image is also called a scout image or topogram, but will be referred to as a "scanogram image" below.

[0051] The shooting range determination unit 402 determines the shooting range for the actual shooting using the scanogram image.

[0052] In this embodiment, first, feature points in the contours of organs, bones, and other body parts to be examined are recognized from the scanogram image, and for each same body part, the region surrounding each feature point is identified as a candidate for the imaging range. Then, the bounding rectangle of the identified candidate imaging range, or a region wider by a predetermined margin than the bounding rectangle, is determined as the final imaging range. Thus, in this embodiment, the imaging range is determined according to the bounding rectangle containing the body part to be examined. Therefore, if there are multiple body parts to be examined, the final imaging range determined is a rectangle that encompasses all of the multiple candidate imaging ranges corresponding to those multiple body parts.

[0053] As described above, this embodiment explains how to determine the shooting range using a scanogram image, but it is not limited to this form. For example, the shooting range may be determined using a camera image obtained by shooting with camera 7. In this case, for example, characteristic points of parts of the subject to be examined, such as both eyes, nose, both shoulders, both hands, both hips, both knees, etc., are recognized from the camera image, and the range connecting the characteristic points that encompass the parts to be examined is determined as the final shooting range for the actual shooting. Alternatively, a scanogram image or camera image may be displayed, and the photographer may be asked to specify the shooting range for the actual shooting based on the displayed image.

[0054] The examination control unit 403 controls the examination sequence of the subject by the medical diagnostic device. As shown in Figure 2, the examination control unit 403 according to this embodiment includes a recognition unit 403A and a presentation unit 403B.

[0055] The recognition unit 403A recognizes the imaging period in which a part of the subject associated with a predetermined presentation condition for presenting instructions is captured, from the captured images corresponding to the medical images of this disclosure, which are obtained in chronological order by scanning the subject with the scanner 1. The presentation unit 403B then presents the instructions according to the imaging period recognized by the recognition unit 403A. The instructions represent information that helps improve the quality of the captured images, such as "Hold your breath" or "Relax" when scanning is being performed with the scanner 1.

[0056] In this embodiment, the "presentation condition" is the timing for presenting the corresponding instruction (hereinafter referred to as the "presentation timing"), and the "shooting period" is the timing for shooting the part associated with the presentation timing (hereinafter referred to as the "shooting timing").

[0057] Specifically, the recognition unit 403A in this embodiment recognizes, from the captured images obtained in chronological order by photographing the subject, the timing at which a part of the subject associated with a predetermined presentation timing for presenting instructions is photographed. Then, the presentation unit 403B in this embodiment presents instructions according to the recognized shooting timing.

[0058] As a result, for example, if the presentation timing is set to include a first timing for starting imaging of the area associated with the presentation timing and a second timing for ending the imaging, instructions and guidance will be presented at both the first and second timings.

[0059] Thus, in this embodiment, the "presentation timing" is applied as the "presentation condition" and the "shooting period" is applied as the "shooting period," but this is not the only way. For example, the "presentation condition" could be the condition that the corresponding instruction guidance is presented and the subject's body movement is still, and the "shooting period" could be the period during which the subject's body movement is still. Here, "the subject's body movement is still" means not only that the subject's body movement has completely stopped, but also a state of stillness in which some degree of subject movement is permitted so as not to hinder the interpretation of the resulting image. Similarly, "the period during which the subject's body movement is still" means not only the period during which the subject's body movement has completely stopped, but also a period during which some degree of subject movement is permitted so as not to hinder the interpretation of the resulting image.

[0060] In other words, in this configuration, the recognition unit 403A recognizes from the captured images obtained in chronological order by photographing the subject that a part of the subject is photographed that is associated with the condition that the subject's body movement is still, and that a predetermined instruction guidance is presented. The presentation unit 403B in this embodiment then presents an instruction guidance according to the recognized period of still body movement of the subject.

[0061] In this embodiment, the above-mentioned shooting period, i.e., the above-mentioned shooting timing, is defined as a timing that includes the start of the shooting sequence indicating the shooting procedure, the end of the shooting sequence, and at least one of the points in time after the start and before the end (in this embodiment, all timings).

[0062] Furthermore, the recognition unit 403A in this embodiment determines from the captured image whether the capture period, i.e., the capture timing, may occur, and the presentation unit 403B presents instructions and guidance according to the capture period determined by the recognition unit 403A. In this embodiment, the determination of whether the capture timing may occur is made by predicting the arrival of the capture timing.

[0063] Furthermore, in this embodiment, the determination of whether the above-mentioned shooting period may occur, that is, the prediction of the timing of the above-mentioned shooting, is performed by predicting that other parts of the image included in the captured image will be photographed after the parts recognized by image recognition of the captured image.

[0064] Furthermore, the display unit 403B according to this embodiment further displays a cross-sectional image corresponding to the captured image for which the above-mentioned shooting period, i.e., the above-mentioned shooting timing, has been recognized, with the portion recognized by the image recognition in a state different from other portions.

[0065] In this embodiment, voice guidance is used as the above-mentioned instruction guidance, and the presentation unit 403B in this embodiment presents the voice guidance by playing the voice guidance according to the shooting period (shooting timing) recognized by the recognition unit 403A. For this reason, the shooting room in this embodiment is provided with a speaker 8 (see also Figure 1) for playing the voice guidance.

[0066] Thus, in this embodiment, we have described a case in which voice guidance is applied as the instruction guidance and said voice guidance is played, but this is not the only form. For example, a display guidance may be applied as the instruction guidance, and the display unit 403B may display the display guidance according to the recognized shooting period (shooting timing) to present the display guidance. In this case, the content of the instruction guidance can be understood by the display.

[0067] Meanwhile, the irradiation control unit 404 controls the amount of X-rays irradiated to the patient from the X-ray tube device 13. For example, the shoulder requires a higher dose, the lungs require a lower dose because they are filled with air and therefore do not attenuate the radiation much, while the liver requires a higher dose because it experiences greater attenuation. The irradiation control unit 404 controls the amount of X-rays irradiated to the patient according to the area of ​​the patient. The required image quality level differs between the scanogram image and the image obtained from the examination (actual image), and the actual image is required to have higher image quality than the scanogram image. Therefore, the irradiation control unit 404 may determine the amount of X-rays irradiated to the patient by multiplying the dose data from the scanogram image by a coefficient or by converting it to a table. By using the X-ray dose data from when the scanogram image was generated, the irradiation control unit 404 can control the amount of X-rays irradiated to the patient, thereby obtaining an examination image of the patient with the noise level desired by the operator.

[0068] The noise reduction unit 405 performs noise reduction (denoising) on ​​the examination image if the amount of noise in the examination image obtained by irradiating the subject with X-rays exceeds the permissible amount for the desired amount of noise. For example, if the dose modulation based on the subject's dose data linked to past scanogram images does not result in the desired image quality indicator (e.g., image noise) due to an increase in the subject's weight, and the image noise increases, the noise reduction unit 405 increases the intensity level of the denoising process to suppress the image noise and automatically reconstructs the image to achieve the same level of desired image quality indicator as in past examinations.

[0069] The bed control unit 406 controls the height of the bed 3. The bed control unit 406 may control the height of the bed 3 based on operations performed by the technician, or it may control the height of the bed 3 based on data from the patient's most recent examination.

[0070] On the other hand, in the medical diagnostic device according to this embodiment, in order to enable the control of the examination sequence by the examination control unit 403, a voice information database containing data indicating voice guidance (hereinafter referred to as "voice data") is registered in the hospital information system 5.

[0071] Next, the voice information database according to this embodiment will be described with reference to Figure 3. Figure 3 is a schematic diagram showing an example of the configuration of the voice information database 53 according to this embodiment.

[0072] The voice information database 53 according to this embodiment stores voice data indicating the voice guidance described above. As shown in Figure 3, the voice information database 53 according to this embodiment stores information such as scan protocol, shooting sequence, body part, presentation timing, and voice data in association with each other.

[0073] The above scan protocol is information indicating the scan protocol itself, and the above imaging sequence is information indicating the imaging sequence applied in the corresponding scan protocol. Furthermore, the above body part is information indicating the body part targeted by the corresponding scan protocol and imaging sequence, and the above presentation timing is information indicating the timing at which the corresponding audio data is played when the corresponding body part is imaged. And the above audio data is information indicating the audio data itself that is played at the corresponding presentation timing.

[0074] In the example shown in Figure 3, for instance, the imaging sequence SQ01 in scan protocol SP01 is registered to include "lung field" and "lumbar spine" as the areas to be examined. In this example, when imaging is performed, information is registered to play the voice message "Inhale and hold your breath" when imaging of the lung field begins, and the voice message "Relax" when imaging of the lung field is completed.

[0075] In this embodiment, the scan protocol, imaging sequence, body part, presentation timing, and audio data are described as being combined into a single database, but this is not the only configuration. For example, the scan protocol and imaging sequence may be configured in a different database from the body part, presentation timing, and audio data.

[0076] Next, with reference to Figures 4 to 7, the process for playing back the voice guidance according to this embodiment will be described in detail. Figure 4 is a diagram used to explain the problems of the conventional technology and shows an example of the voice guidance playback state when multiple body parts are photographed using multiple shooting sequences in a single continuous shooting operation. Figure 5 is a diagram used to explain the problems of the conventional technology and shows an example of the voice guidance playback state when multiple body parts are photographed using one shooting sequence in a single continuous shooting operation. Figure 6 is a diagram used to explain the technology of this disclosure and shows an example of the voice guidance playback state when multiple body parts are photographed using one shooting sequence in a single continuous shooting operation according to the disclosed technology. Furthermore, Figure 7 is a diagram used to explain the technology of this disclosure and shows an example of a method for playing back voice guidance when multiple body parts are photographed using one shooting sequence in a single continuous shooting operation according to the disclosed technology.

[0077] As an example, as shown in Figure 4, in conventional voice guidance playback processes, when multiple body parts such as the lungs and lumbar spine are imaged in a single continuous imaging operation, multiple imaging sequences (in the example shown in Figure 4, "First Imaging Sequence" and "Second Imaging Sequence") are set for each body part to be imaged, indicating the procedure for that imaging. Then, in conventional voice guidance playback processes, voice guidance is associated with each imaging sequence. Therefore, if voice guidance such as "Please inhale and hold your breath" or "Please relax" is to be given for each body part being imaged during imaging, the voice guidance associated with the imaging sequence set for the corresponding body part should be played sequentially.

[0078] In response to this, as shown in Figure 5 as an example, when multiple body parts are to be photographed consecutively in a single shooting operation, there is a demand for a system that allows each body part to be photographed in a single shooting sequence.

[0079] However, in this case, while voice guidance can be played at the start and end of the shooting sequence, it is difficult to play voice guidance for the next body part to be photographed at the appropriate time during the shooting sequence. This is because there is no trigger to play the corresponding voice guidance during the shooting sequence.

[0080] Therefore, in the recognition unit 403A according to this embodiment, as shown in Figures 6 and 7 as an example, during scanning with a single shooting sequence corresponding to the continuous shooting of multiple body parts, the recognition unit recognizes the shooting timing of the multiple body parts by image recognition of the captured image (axial image in this embodiment) obtained by the scanning. Then, the presentation unit 403B according to this embodiment plays the corresponding voice guidance at the recognized shooting timing.

[0081] In this embodiment, image recognition of the multiple body parts is performed using a pre-trained model that takes the captured image as input information and information indicating the body parts captured by the image as output information.

[0082] In this embodiment, a Convolutional Neural Network (CNN) model is used as the learning model, but it is not limited to this. For example, other models such as Recurrent Neural Network (RNN) models or Artificial Intelligence (AI) models may be used as the learning model.

[0083] Furthermore, the image recognition method for the multiple parts described above is not limited to the method using the learning model described above. For example, a method using conventionally known pattern matching techniques may also be applied as the image recognition method for the multiple parts described above.

[0084] Next, we will explain the operation of console 4 with reference to Figure 8.

[0085] Figure 8 is a flowchart showing the control flow of the medical diagnostic device by the console 4. The CPU 41 reads the control program for the medical diagnostic device from the ROM 42 or storage 44, loads it into the RAM 43, and executes it, thereby performing the control processing of the medical diagnostic device. The flowchart shown in Figure 8 is executed in response to instructions input by the radiographer (hereinafter referred to as "user") via the input unit 45 when a patient undergoes an examination with the medical diagnostic device.

[0086] In step S100, the CPU 41 receives input from the user specifying the scan protocol and imaging sequence.

[0087] Following step S100, in step S102, the CPU 41 reads information from the voice information database 53 regarding the body part, presentation timing, and voice data corresponding to the scan protocol and imaging sequence received from the user. The body part read here will be referred to as the "specified body part" below.

[0088] Following step S102, in step S104, the CPU 41 moves the bed 3 into the frame 11.

[0089] Following step S104, in step S106, the CPU 41 irradiates the subject with X-rays to acquire a scanogram image.

[0090] Following step S106, in step S108, the CPU 41 uses the acquired scanogram image to determine the shooting range for the actual shooting, as described above.

[0091] Following step S108, in step S110, the CPU 41 moves (returns) the bed 3 to its initial position.

[0092] Following step S110, in step S112, the CPU 41 starts moving the bed 3 into the frame 11, thereby initiating imaging (main imaging) with the scanner 1 over the determined imaging range, and thus commencing the main examination on the subject.

[0093] Following step S112, in step S114, the CPU 41 starts displaying the cross-sectional image (in this embodiment, an axial image, hereinafter simply referred to as "cross-sectional image") corresponding to the captured image obtained by the capture using the display unit 46.

[0094] Following step S114, in step S116, the CPU 41 starts recognizing the designated area to be photographed (inspected) by image recognition of the captured image (axial image in this embodiment).

[0095] Following step S116, in step S118, the CPU 41 determines whether the designated part has been recognized. If the determination is negative, the system proceeds to step S124; if the determination is positive, the system proceeds to step S120.

[0096] In step S120, the CPU 41 updates the cross-sectional image so that the designated area recognized by image recognition is in a different state from the other areas.

[0097] Figure 9 shows an example of the display state of the cross-sectional image updated by the processing in step S120. As shown in Figure 9, in the cross-sectional image according to this embodiment, the recognized designated area (the lung field in the example shown in Figure 9) is updated to a state different from other areas (a filled-in state in the example shown in Figure 9). Therefore, by referring to this cross-sectional image, the user can determine whether or not there is an error in the recognition result by image recognition, thereby preventing errors in the timing of voice guidance playback.

[0098] Following step S120, in step S122, the CPU 41 controls the speaker 8 to play the guidance voice indicated by the audio data associated with the recognized designated part at the corresponding presentation timing.

[0099] Following step S122, in step S124, the CPU 41 determines whether all designated parts have been recognized. If the determination is negative, the system returns to step S118; if the determination is positive, the system proceeds to step S126.

[0100] Through the repeated processing of steps S118 to S124 described above, the display state of the cross-sectional image is updated, and the corresponding audio guidance is played at the presentation timing for all the specified parts that have been read. In addition, during the repeated processing described above, the system may predict the capture of specified parts that will be included in the subsequent captured image based on the recognized specified parts, and use the prediction result to pre-determine the next audio guidance to be played.

[0101] In step S126, the CPU 41 stops recognizing the designated area to be photographed, which was initiated by the processing in step S116.

[0102] Following step S126, in step S128, the CPU 41 stops displaying the cross-sectional image that was started by the processing in step S114.

[0103] Following step S128, in step S130, the CPU 41 stops the inspection that was started by the processing in step S112, and then terminates the control process.

[0104] As described above, according to the embodiment of this disclosure, the imaging period during which parts of the subject associated with predetermined presentation conditions for presenting instructions are captured is recognized from the images obtained in chronological order by imaging the subject, and instructions are presented according to the recognized imaging period. Therefore, even when multiple body parts are imaged in a single continuous imaging, instructions can be presented at appropriate intervals.

[0105] Furthermore, according to embodiments of this disclosure, the shooting period is defined as a period that includes the start of the shooting sequence indicating the shooting procedure, the end of the shooting sequence, and at least one of the points in time after the start and before the end. Therefore, the instructions can be played back using the shooting sequence.

[0106] Furthermore, according to the embodiments of this disclosure, it is determined from the captured image whether a shooting period may be coming, and instructions are presented according to the determined shooting period. Therefore, compared to the case where it is not determined whether a shooting period may be coming, instructions can be presented using a more appropriate shooting period.

[0107] Furthermore, according to the embodiments of this disclosure, the determination of when the shooting period may occur is made by determining from the part recognized by image recognition of the captured image whether other parts included in the captured image can be photographed afterward. Therefore, the shooting period can be determined with higher accuracy compared to when the determination of when the shooting period may occur is made using shooting conditions.

[0108] Furthermore, according to the embodiments of this disclosure, the cross-sectional image corresponding to the captured image for which the shooting period is recognized is further presented with the recognized portion in a state different from other portions. As a result, the results of image recognition can be grasped, and malfunctions due to misrecognition can be prevented.

[0109] Furthermore, according to the embodiments of this disclosure, voice guidance is applied as instruction and guidance, and the voice guidance is played back according to the recognized shooting period. Therefore, the content of the guidance can be understood by voice.

[0110] While embodiments of the present disclosure have been described in detail above with reference to the attached drawings, the technical scope of the present disclosure is not limited to these examples. It is clear that a person with ordinary skill in the art of the present disclosure may conceive of various modifications or alterations within the scope of the technical idea set forth in the claims, and these modifications or alterations are also understood to fall within the technical scope of the present disclosure.

[0111] Furthermore, the effects described in the above embodiments are descriptive or illustrative, and are not limited to those described in the above embodiments. In other words, the technology relating to this disclosure may produce other effects that would be obvious to a person of ordinary skill in the art of this disclosure from the descriptions in the above embodiments, in addition to or in lieu of the effects described in the above embodiments.

[0112] For example, in the above embodiment, the information processing device according to this disclosure is applied to an X-ray CT scanner, but the invention is not limited thereto. The information processing device according to this disclosure may be applied to any imaging device that presents instructions and guidance, such as voice guidance, to the subject, such as an MRI scanner.

[0113] Furthermore, while the above embodiment describes a case in which the determination of whether the shooting period (or shooting timing in the above embodiment) may occur is performed by image recognition of the captured image, the invention is not limited to this. For example, the determination of whether the shooting period may occur may be performed using shooting conditions that are set in advance in response to the shooting of the subject.

[0114] In this case, an example of the above shooting conditions is to apply at least one of the following: the scanning speed by scanner 1, the movement speed of bed 3, and the waiting time if there is a waiting time between the shooting of multiple body parts that are the target of shooting in one shooting sequence. In this case, an example of the method is to recognize the shooting period for which the voice guidance will be played by estimating the shooting period of the body part to be targeted for voice guidance playback according to the elapsed time from the start of shooting for the shooting range using the applied shooting conditions. In this method, it is possible to determine whether the shooting period may arrive more easily than when it is determined by image recognition.

[0115] Furthermore, in the above embodiment, we have described a case in which a cross-sectional image, as shown in Figure 9, is applied as an image to allow the user to understand the error in the recognition result of the part to be photographed, but the invention is not limited to this. For example, as shown in Figure 10, the captured image itself may be applied as an image to allow the user to understand the error in the recognition result of the part to be photographed. Figure 10 is a diagram showing an example of the display state of a captured image according to an embodiment of the technology of this disclosure.

[0116] Furthermore, while the above embodiment describes a case where the shooting period is recognized using captured images, it is not limited to this. For example, the shooting period may be recognized using a scanogram image. An example of this form is one in which the area to be inspected is identified from the scanogram image, and instructions and guidance are presented for the identified area. Moreover, the control flow shown in the flowchart of Figure 8, which is illustrated in the above embodiment, is just one example, and for example, the processing of steps S114 and S116 may be swapped, or the processing of steps S126 and S128 may be swapped.

[0117] In this embodiment, each process is executed on any computer. Furthermore, any computer may execute these processes using a processor as hardware, a program as software, or a combination thereof. In that case, the processor is configured to work in cooperation with the program to execute the various processes in this embodiment, and can function as a unit or means in this embodiment. Also, the execution order of the processes by the processor is not limited to the order described and may be changed as appropriate. Any computer may be a general-purpose computer, a computer designed for a specific purpose, a workstation, or any other system capable of executing each process.

[0118] A processor may consist of one or more hardware components, and the type of hardware is not limited. For example, a processor may consist of a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a programmable logic device such as an FPGA (Field Programmable Gate Array), a dedicated circuit for executing a specific process such as an ASIC (Application Specific Integrated Circuit), a GPU (Graphic Processing Unit), or an NPU (Neural Processing Unit). Furthermore, the type of hardware may be a combination of different types of hardware. When multiple hardware components are configured to execute one or more processes of a given processor, these components may reside in physically separate devices or in the same device. Also, in any embodiment, the order of each process performed by the processor is not limited to the order described above and may be changed as appropriate. Hardware is composed of electrical circuits (circuitry) that combine circuit elements such as semiconductor elements.

[0119] Furthermore, the program may be firmware or software such as microcode. Alternatively, the program may be, for example, a set of program modules, each function of which may be implemented by a processor configured to perform its respective function. The program may be program code or multiple code segments stored on one or more non-temporary computer-readable media (e.g., storage media or other storage). The program may be divided and stored on multiple non-temporary computer-readable media located on physically separate devices. Program code or code segments may represent any combination of procedures, functions, subprograms, routines, subroutines, modules, software packages, classes, or instructions, data structures, or program statements. Program code or code segments may be connected to other code segments or hardware circuits by sending and receiving information, data, arguments, parameters, or memory contents.

[0120] Furthermore, although the above embodiment describes an embodiment in which the information processing program is pre-stored (installed) in the ROM 42 or storage 44 of the console 4, the invention is not limited to this. The information processing program may be provided in the form of a recording medium such as a CD-ROM (Compact Disc Read Only Memory), DVD-ROM (Digital Versatile Disc Read Only Memory), or USB (Universal Serial Bus) memory. Alternatively, the information processing program may be provided in the form of a download from an external device via a network.

[0121] The technology disclosed herein extends not only to information processing programs but also to computer-readable storage media (such as CD-ROMs, DVD-ROMs, and USB memory sticks) that store information processing programs non-temporarily.

[0122] Furthermore, the present invention can also be applied to programs and program products.

[0123] The following additional information is disclosed regarding the above-described embodiments.

[0124] [Note 1] Equipped with a processor, The aforementioned processor, From the images obtained chronologically through imaging of the subject, the imaging period in which the body part associated with the presentation conditions for presenting predetermined instructions and guidance is captured is recognized. The instructions and guidance are presented according to the recognized shooting period. Information processing device. [Note 2] The aforementioned shooting period is a period that includes the start of the shooting sequence indicating the shooting procedure, the end of the shooting sequence, and at least one of the points in time after the start and before the end. The information processing device described in Appendix 1. [Note 3] The aforementioned processor, From the aforementioned captured images, it is determined that the aforementioned shooting period may have arrived. The instructions and guidance will be presented according to the determined shooting period. The information processing device described in Appendix 1 or Appendix 2. [Note 4] The aforementioned processor, The determination of whether the aforementioned imaging period may occur is made using imaging conditions that have been set in advance in accordance with the imaging of the subject. The information processing device described in Appendix 3. [Note 5] The aforementioned processor, The determination of whether the aforementioned shooting period may occur is made by determining from the part recognized by image recognition of the captured image that other parts included in the captured image can be photographed thereafter. The information processing device described in Appendix 3. [Note 6] The aforementioned processor, The cross-sectional image corresponding to the captured image, in which the aforementioned shooting period has been recognized, is further presented with the part recognized by the image recognition in a state different from other parts. The information processing device described in Appendix 5. [Note 7] The aforementioned instructions and guidance are provided via voice guidance. The processor plays the voice guidance according to the recognized shooting period. An information processing device as described in any one of the appendices 1 through 6. [Note 8] The aforementioned instructions and guidance are provided by signs, The processor displays the display guide according to the recognized shooting period. An information processing device as described in any one of the appendices 1 through 7. [Note 9] An information processing device described in any one of the appendices 1 to 8, An image acquisition device in which medical images are actually taken while instructions and guidance are presented by the aforementioned information processing device, Medical imaging equipment including... [Note 10] The processor, From the images obtained chronologically through imaging of the subject, the imaging period in which the body part associated with the presentation conditions for presenting predetermined instructions and guidance is captured is recognized. The instructions and guidance are presented according to the recognized shooting period. Information processing methods. [Note 11] From the images obtained chronologically through imaging of the subject, the imaging period in which the body part associated with the presentation conditions for presenting predetermined instructions and guidance is captured is recognized. The instructions and guidance are presented according to the recognized shooting period. An information processing program that instructs a computer to perform a task. [Explanation of Symbols]

[0125] 1 Scanner 11. Stand 12 Rotating Plates 13 X-ray tube equipment 14 Collimator 15 X-ray detector 16 Data Acquisition Device 17 Rotary plate drive device 18 Collimator control device 19 Rotary plate drive control device 20 X-ray high-voltage generator 21 Data transmission device 3 berths 31 Top plate 32 Bed control device 33. Tabletop vertical movement control device 34 Top plate forward / backward movement control device 4 Console 41 CPU 42 ROM 43 RAM 44 Storage 45 Input section 46 Display section 401 Scanogram Image Acquisition Unit 402 Shooting range determination unit 403 Inspection Control Unit 403A recognition section 403B Presentation section 404 Irradiation Control Unit 405 Noise Reduction Section 406 Bed Control Unit 5. Hospital Information System 51. Patient Information Management System 52. Examination Reservation System 53 Voice Information Database 7 Cameras 8 speakers

Claims

1. Equipped with a processor, The aforementioned processor, From the images obtained chronologically through imaging of the subject, the imaging period in which the body part associated with the presentation conditions for presenting predetermined instructions and guidance is captured is recognized. The instructions and guidance are presented according to the recognized shooting period. Information processing device.

2. The aforementioned shooting period is a period that includes the start of the shooting sequence indicating the shooting procedure, the end of the shooting sequence, and at least one of the points in time after the start and before the end. The information processing apparatus according to claim 1.

3. The aforementioned processor, From the aforementioned captured images, it is determined that the aforementioned shooting period may have arrived. The instructions and guidance will be presented according to the determined shooting period. The information processing apparatus according to claim 1 or claim 2.

4. The aforementioned processor, The determination of whether the aforementioned imaging period may occur is made using imaging conditions that have been set in advance in accordance with the imaging of the subject. The information processing apparatus according to claim 3.

5. The aforementioned processor, The determination of whether the aforementioned shooting period may occur is made by determining from the part recognized by image recognition of the captured image that other parts included in the captured image can be photographed thereafter. The information processing apparatus according to claim 3.

6. The aforementioned processor, The cross-sectional image corresponding to the captured image, in which the aforementioned shooting period has been recognized, is further presented with the part recognized by the image recognition in a state different from other parts. The information processing apparatus according to claim 5.

7. The aforementioned instructions and guidance are provided via voice guidance. The processor plays the voice guidance according to the recognized shooting period. The information processing apparatus according to claim 1 or claim 2.

8. The aforementioned instructions and guidance are provided by signs, The processor displays the display guide according to the recognized shooting period. The information processing apparatus according to claim 1 or claim 2.

9. The information processing apparatus according to claim 1, An image acquisition device in which medical images are actually taken while instructions and guidance are presented by the aforementioned information processing device, Medical imaging equipment including...

10. The processor, From the images obtained chronologically through imaging of the subject, the imaging period in which the body part associated with the presentation conditions for presenting predetermined instructions and guidance is captured is recognized. The instructions and guidance are presented according to the recognized shooting period. Information processing methods.

11. From the images obtained chronologically through imaging of the subject, the imaging period in which the body part associated with the presentation conditions for presenting predetermined instructions and guidance is captured is recognized. The instructions and guidance are presented according to the recognized shooting period. An information processing program that instructs a computer to perform a task.

Images