Information processing device, medical image capturing device, information processing method, and information processing program

Abstract

To provide an information processing device, a medical image capturing device, an information processing method, and an information processing program capable of suppressing generation of a missing part in an axial image obtained by main imaging.SOLUTION: A console (information processing device) 4 includes: a scanogram image acquisition part 401 and a camera image acquisition part 402 for acquiring a scanogram image obtained by imaging a subject and a camera image obtained by imaging the subject by an optical camera or a depth camera; and an imaging range determination part 403 for determining an imaging range in the main imaging using body thickness information indicating the body thickness of the subject obtained from the camera image and the scanogram image.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, a medical imaging device, an information processing method, and an information processing program. [Background technology]

[0002] Patent Document 1 discloses an automatic scout image scanning and positioning device that includes a receiving means for receiving a scout image of a subject obtained through a scout scan, an inspection and determination means for automatically examining at least one position in the scout image according to a plurality of pieces of information contained in the scout image and automatically determining a scan range based on the at least one position, and an execution means for executing an axial scan of the subject based on the determined scan range. Note that the scout image referred to here is also called a scanogram image, a topogram, etc., but will be referred to as a "scanogram image" below.

[0003] This technology can reduce the time and effort required when an operator manually sets the imaging range (scan range) and improve the inaccuracy of setting the imaging range. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-128656 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the technology disclosed in Patent Document 1, the imaging range for the actual imaging is automatically set based on the characteristics of the scanogram image used for positioning. However, in the case of a subject with a relatively thick body, if only a scanogram image from the front (AP (Anterior-Posterior View) direction) is taken, the imaging range may be insufficient, and the axial image obtained by the actual imaging may lack parts of the body with a thicker body thickness.

[0006] The present disclosure has been made in consideration of the above points, and aims to provide an information processing device, a medical image capturing device, an information processing method, and an information processing program that can suppress the occurrence of chipping in the axial image obtained by the actual capturing. [Means for solving the problem]

[0007] An information processing device according to a first aspect of the present disclosure includes at least one processor, which acquires a scanogram image obtained by photographing a subject and a camera image obtained by photographing the subject using an optical camera or a depth camera, and determines the photographing range for the actual photographing using body thickness information indicating the body thickness of the subject obtained from the camera image and the scanogram image.

[0008] An information processing device according to a second aspect of the present disclosure is the information processing device according to the first aspect, wherein the camera image is a depth camera image obtained by photographing with the depth camera, and the body thickness information is information estimated using the depth camera image.

[0009] An information processing device according to a third aspect of the present disclosure is the information processing device according to the first aspect, wherein the camera image is an optical camera image obtained by photographing with the optical camera, and the body thickness information is information estimated by analyzing an image of the subject included in the optical camera image.

[0010] An information processing device according to a fourth aspect of the present disclosure is an information processing device according to any one of the first to third aspects, wherein the processor determines the imaging range by including a predetermined margin in the body thickness information.

[0011] An information processing device according to a fifth aspect of the present disclosure is an information processing device according to the first or second aspect, wherein the processor notifies that the shooting range has been determined using the body thickness information.

[0012] An information processing device according to a sixth aspect of the present disclosure is the information processing device according to the first or second aspect, wherein the processor reflects body movement of the subject in the imaging range.

[0013] An information processing device according to a seventh aspect of the present disclosure is an information processing device according to the first or second aspect, in which the processor adjusts the determined shooting range using an axial image of the subject and reconstructs the axial image in the main shooting.

[0014] A medical imaging device according to an eighth aspect of the present disclosure includes an information processing device of the present disclosure and a radiation imaging device controlled by the information processing device.

[0015] In an information processing method according to a ninth aspect of the present disclosure, a processor acquires a scanogram image obtained by photographing a subject and a camera image obtained by photographing the subject using an optical camera or a depth camera, and determines the photographing range for the actual photographing using body thickness information indicating the body thickness of the subject obtained from the camera image and the scanogram image.

[0016] An information processing program according to a tenth aspect of the present disclosure causes a computer to execute a process of acquiring a scanogram image obtained by photographing a subject and a camera image obtained by photographing the subject using an optical camera or a depth camera, and determining the photographing range for the actual photographing using body thickness information indicating the body thickness of the subject obtained from the camera image and the scanogram image. [Effects of the Invention]

[0017] According to the present disclosure, it is possible to provide an information processing device, a medical image capturing device, an information processing method, and an information processing program that can suppress the occurrence of chipping in an axial image obtained by main imaging. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a diagram illustrating a schematic configuration of a medical diagnostic apparatus according to an embodiment of the disclosed technique. [Figure 2] FIG. 2 is a block diagram illustrating an example of a functional configuration of a console according to an embodiment of the disclosed technology. [Figure 3] FIG. 10 is a diagram illustrating the problems of the conventional technology, showing an example of the imaging range and axial image of the main imaging obtained by the conventional technology. [Figure 4] 1A and 1B are diagrams for explaining problems with the prior art, showing a side view of an example of a medical imaging device and a graph showing an example of the relationship between the position on the tabletop of a bed and the body thickness. [Figure 5] 10A and 10B are diagrams for explaining the disclosed technology, showing an example of the imaging range of the main imaging and an axial image obtained by the disclosed technology. [Figure 6] FIG. 1 is a diagram for explaining a first embodiment of the disclosed technology, in which the upper diagram shows an example of the shooting range and axial image of the main photography obtained using the disclosed technology in the same manner as with conventional technology, and the lower diagram shows an example of the shooting range and axial image of the main photography obtained using the disclosed technology. [Figure 7] 10 is a flowchart showing a flow of control of a medical diagnostic device by a console according to the first embodiment of the disclosed technology. [Figure 8] 10A and 10B are diagrams for explaining a second embodiment of the disclosed technology, in which the upper diagram shows an example of the imaging range and axial image of the main imaging obtained using the disclosed technology, and the lower diagram shows an example of the imaging range and axial image of the main imaging obtained using the disclosed technology with a margin added. [Figure 9] FIG. 10 is a diagram for explaining the problems of the disclosed technology, showing an example of a defect in an axial image caused by narrowing the imaging range due to a misunderstanding by a user. [Figure 10] FIG. 13 is a diagram showing an example of a notification state on a GUI (Graphical User Interface) screen displayed when planning main imaging according to the third embodiment of the disclosed technique. [Figure 11] FIG. 10 is a block diagram illustrating an example of a functional configuration of a console according to a third embodiment of the disclosed technology. [Figure 12] 10 is a flowchart showing a flow of control of a medical diagnostic device by a console according to a third embodiment of the disclosed technology. [Figure 13] 13 is a graph showing an example of time-series changes in respiratory information and body thickness according to the fourth embodiment of the disclosed technology. [Figure 14] 13 is a map showing an example of the relationship between breathing timing and the rate of change in body thickness according to the fourth embodiment of the disclosed technology. [Figure 15] This figure is used to explain the fifth embodiment of the disclosed technology, where the left figure shows an example of a defect in an axial image obtained by the disclosed technology, and the right figure shows an example of an axial image in which the defect has been eliminated by reconstruction using the disclosed technology. DETAILED DESCRIPTION OF THE INVENTION

[0019] Hereinafter, examples of embodiments of the present disclosure will be described with reference to the drawings. Note that the same reference numerals are used to designate the same or equivalent components and parts in each drawing. Furthermore, the dimensional proportions of the drawings are exaggerated for the sake of explanation and may differ from the actual proportions.

[0020] [First embodiment] 1 is a diagram showing a schematic configuration of a medical diagnostic apparatus including an information processing apparatus and a medical imaging apparatus according to this embodiment. In this embodiment, the configuration of one embodiment of an X-ray CT (Computed Tomography) apparatus is shown as the medical diagnostic apparatus. Note that the medical diagnostic apparatus of the present disclosure is not limited to an X-ray CT apparatus, and can also be applied to other medical diagnostic apparatuses such as an MRI (Magnetic Resonance Imaging) apparatus.

[0021] The medical diagnostic device according to this embodiment includes a scanner 1, a bed 3, and a console 4. The console 4 corresponds to the information processing device of the present disclosure, the scanner 1 corresponds to the radiographic image capturing device of the present disclosure, and the combination of the scanner 1, the bed 3, and the console 4 corresponds to the medical image capturing device of the present disclosure.

[0022] Scanner 1 is a part that performs CT scans. Scanner 1 includes a gantry 11, a rotating plate 12 that has an opening in its center and is rotatably supported by gantry 11, an X-ray tube assembly 13 fixed to rotating plate 12, a collimator 14 provided at an X-ray emission port of X-ray tube assembly 13, an X-ray detector 15 disposed opposite X-ray tube assembly 13 across the opening of rotating plate 12, and a rotating plate drive unit 17 provided on gantry 11. Rotating plate 12 of scanner 1 also includes a collimator control unit 18 that controls collimator 14 to change the X-ray irradiation field, a rotating plate drive control unit 19 that controls the drive of rotating plate drive unit 17, an X-ray high-voltage generator 20 that supplies power to X-ray tube assembly 13 for generating X-rays and controls the X-ray generation conditions, a data acquisition unit 16 that acquires the output of X-ray detector 15, and a data transmission unit 21 that transmits data acquired by data acquisition unit 16. The supply of power and control signals to each unit on the rotating plate 12, and the extraction of data from each unit on the rotating plate 12, are carried out via a slip ring (not shown) installed between the base 11 and the rotating plate 12.

[0023] The bed 3 moves the subject between an imaging preparation position and an imaging position. The subject is placed on a top board 31. The top board 31 has a vertical movement mechanism and a forward / backward movement mechanism (not shown). The bed 3 is provided with a bed controller 32, a top board vertical movement controller 33, and a top board forward / backward movement controller 34 to control the operation of the vertical movement mechanism and the forward / backward movement mechanism of the top board 31.

[0024] The console 4 controls a medical diagnostic device, which is an X-ray CT device. The console 4 is an example of a computer of the present disclosure. The console 4 includes a CPU (Central Processing Unit) 41, a ROM (Read Only Memory) 42, a RAM (Random Access Memory) 43, and a storage 44. The console 4 may further include an input unit 45 and a display unit 46.

[0025] The CPU 41, which is an example of a processor, is a central processing unit that executes various programs and controls each component. That is, the CPU 41 reads a program from the ROM 42 or storage 44 and executes the program using the RAM 43 as a work area. The CPU 41 controls the above-mentioned components and performs various arithmetic processing in accordance with the program recorded in the ROM 42 or storage 44. In this embodiment, the ROM 42 or storage 44 stores a control program for the medical diagnostic apparatus, including information processing for determining the imaging range for actual imaging by the X-ray CT apparatus. The program related to this information processing corresponds to the information processing program of the present disclosure, and the processing method by this information processing corresponds to the information processing method of the present disclosure.

[0026] The ROM 42 stores various programs and various data. The RAM 43 temporarily stores programs or data as a working area. The storage 44 is configured with a storage device such as an HDD (Hard Disk Drive), SSD (Solid State Drive), or flash memory, and stores various programs including the operating system and various data.

[0027] The input unit 45 includes a pointing device such as a mouse and a keyboard, and is used to perform various inputs. The input unit 45 includes a bed operating unit for operating the height of the bed 3.

[0028] The display unit 46 is, for example, a liquid crystal display, and displays various information. The display unit 46 may function as the input unit 45 by adopting a touch panel system.

[0029] In this embodiment, the console 4 is connected to a hospital information system 5 of a hospital where an X-ray CT apparatus is installed. The hospital information system 5 includes a patient information management system 51 and an examination reservation system 52.

[0030] The patient information management system 51 is a database of personal information, medical data, examination image data, test data, medication data, etc. of patients who have received medical treatment at the hospital in the past. The patient's personal information includes personal identification information such as name, ID (Identification), date of birth, age, and gender, as well as physical information such as height and weight, and the dates of past examinations. This personal information is entered into the system when the subject visits the hospital as a patient and receives medical treatment. The patient's height and weight are collected by the patient's self-reporting in a medical questionnaire or by actual measurement, and then entered into the patient information management system 51. The medical data, examination image data, test data, and medication data are entered into the patient information management system 51 each time a patient is treated, and an in-hospital patient database is created.

[0031] The examination reservation system 52 creates an examination schedule for each day for each system of medical diagnostic equipment installed in the hospital based on the information stored or written in the patient information management system 51, and distributes the created examination schedule as data to each system. The examination schedule includes the order in which patients will be examined that day by the medical diagnostic equipment, as well as the personal identification information and physical information of each patient. The contents of the examination reservation system 52 are updated sequentially according to the progress of medical treatment that day, and the updated data is sent to each system each time an update is made.

[0032] A camera 7 is mounted on the ceiling of the imaging room in which the medical diagnostic device is installed, so as to be able to capture an image of an area within the movable range of the bed 3. The camera 7 according to this embodiment is a depth camera that can obtain depth information indicating the depth of each pixel within the imaging angle of view by imaging. Note that the camera 7 according to this embodiment uses a ToF (Time of Flight) sensor as the sensor for obtaining the depth information, but is not limited to this. For example, a stereo camera system may be used to obtain the depth information.

[0033] The camera 7 is used to detect the body thickness (hereinafter simply referred to as "body thickness") of a subject lying supine on the top plate 31 of the bed 3. In this embodiment, the camera 7 acquires depth information (hereinafter referred to as "initial depth information") of the upper surface of the top plate 31 of the bed 3 when the subject is not present and when the top plate 31 of the bed 3 is positioned in the vertical direction relative to the subject during actual imaging. Then, in this embodiment, when the subject is lying supine on the top plate 31 of the bed 3 to actually perform actual imaging, the camera 7 acquires depth information of the upper surface of the top plate 31 (hereinafter referred to as "depth information at the time of imaging"). The initial depth information is subtracted from the acquired depth information at the time of imaging for each corresponding pixel to acquire information indicating the body thickness for each pixel (hereinafter referred to as "body thickness information").

[0034] As described above, in the medical diagnostic device according to this embodiment, a depth camera is used to acquire body thickness information, and the body thickness information is estimated using the depth camera image captured by the depth camera. However, this is not limited to this. For example, an optical camera may be used as the camera 7, and the body thickness information may be estimated by analyzing the subject's image contained in the optical camera image captured by the optical camera. In this case, the camera 7 may be installed diagonally above or to the side of the bed 3, and the body thickness information of the subject may be acquired from the optical camera image captured by the camera 7. In this configuration, if the camera 7 is installed diagonally above the bed 3, the body thickness indicated by the optical camera image captured by the camera 7 changes depending on the imaging angle of the camera 7 relative to the subject. Therefore, it is preferable to install the camera 7 to the side of the bed 3.

[0035] When executing the control program for the medical diagnostic apparatus, the console 4 uses the hardware resources described above to realize various functions. The functional configuration realized by the console 4 will be described below.

[0036] FIG. 2 is a block diagram showing an example of the functional configuration of the console 4.

[0037] 2, the console 4 has, as its functional components, a scanogram image acquisition unit 401, a camera image acquisition unit 402, an imaging range determination unit 403, an examination control unit 404, an irradiation control unit 405, a noise removal unit 406, and a bed control unit 407. Each functional component is realized by the CPU 41 reading and executing a control program for the medical diagnostic apparatus stored in the ROM 42 or the storage 44.

[0038] The scanogram image acquisition unit 401 executes processing to acquire a scanogram image of the subject based on the irradiation of X-rays onto the subject controlled by an irradiation control unit 405, which will be described later. The scanogram image can be obtained by detecting X-rays that have passed through the subject with the X-ray detector 15. The scanogram image acquisition unit 401 acquires a scanogram image that includes at least the most protruding region of the subject's abdomen (in this embodiment, the central part of the abdomen).

[0039] The camera image acquisition unit 402 acquires a camera image (in this embodiment, a depth camera image) obtained by photographing the subject with the camera 7.

[0040] However, if a subject is slightly obese and their abdomen protrudes relatively far from the front of their body, the subject's anterior-posterior width is often greater than their lateral width. In this case, with conventional technology that determines the imaging range (hereinafter also referred to as FOV (Field Of View)) during actual imaging based only on the scanogram image obtained by imaging from the AP direction, there are cases where part of the subject's abdomen is cut off (missing) in the axial image obtained by actual imaging.

[0041] 3 is a diagram for explaining the problems of the conventional technology, and shows an example of an FOV 61 and an axial image of the main imaging obtained by the conventional technology. As shown in FIG. 3, in this case, part of the abdomen of the subject is cut off in the axial image.

[0042] That is, as an example, as shown in Figure 4, the body thickness of a slightly obese subject in a supine position differs greatly in the position of the abdomen compared to a subject with a normal build. Figure 4 is a diagram for explaining the problems of the conventional technology, and is a side view showing an example of a medical imaging device and a graph showing an example of the relationship between the position on the top board 31 of the bed 3 and the body thickness.

[0043] Therefore, the imaging range determination unit 403 according to this embodiment determines the FOV 61 for the actual imaging using body thickness information indicating the body thickness of the subject obtained from the camera image and a scanogram image, as shown in Fig. 5 as an example. This makes it possible to avoid cutting off the abdomen of the subject in the axial image. Fig. 5 is a diagram for explaining the disclosed technology, and shows an example of the FOV 61 and axial image for the actual imaging obtained by the disclosed technology.

[0044] The examination control unit 404 controls the examination sequence of the subject by the medical diagnostic device.

[0045] The irradiation control unit 405 controls the dose of X-rays irradiated onto the subject from the X-ray tube assembly 13. For example, the shoulders require a higher dose, while the lungs, which are filled with air and therefore have less attenuation, require a lower dose. The liver, which has more attenuation, requires a higher dose. The irradiation control unit 405 controls the dose of X-rays irradiated onto the subject depending on the part of the subject. The required image quality level differs between a scanogram image and an image obtained during an examination (an actual image), and the actual image is required to have higher image quality than a scanogram image. Therefore, the irradiation control unit 405 may calculate the dose of X-rays irradiated onto the subject by multiplying the dose data for the scanogram image by a coefficient or by converting it using a table. The irradiation control unit 405 controls the dose of X-rays irradiated onto the subject using the X-ray dose data used to generate the scanogram image, thereby enabling the operator to obtain an examination image of the subject with the desired amount of noise.

[0046] If the amount of noise in an examination image obtained by irradiating a subject with X-rays exceeds the allowable amount for the desired amount of noise, the noise removal unit 406 performs noise removal (denoising) processing on the examination image. For example, if the dose modulation based on the subject's dose data linked to past scanogram images does not result in the desired image quality index (e.g., image noise) due to an increase in the subject's weight and the image noise increases, the noise removal unit 406 increases the intensity level of the denoising processing to suppress the image noise and performs automatic reconstruction so as to achieve the desired image quality index at the same level as in the past examination.

[0047] The bed control unit 407 controls the height of the bed 3. The bed control unit 407 may control the height of the bed 3 based on an operation by a technician, or may control the height of the bed 3 based on data from the most recent examination of the subject.

[0048] Next, the process of determining the FOV during actual imaging, which is executed in the console 4 according to this embodiment, will be described in more detail with reference to Fig. 6. Fig. 6 is a diagram used to explain the first embodiment of the disclosed technology, with the upper diagram showing an example of an FOV 61A and axial image during actual imaging obtained using the disclosed technology in the same manner as with conventional technology, and the lower diagram showing an example of an FOV 61B and axial image during actual imaging obtained using the disclosed technology.

[0049] First, the console 4 estimates an FOV (hereinafter referred to as "first FOV") 61A in the same manner as in the conventional technology, using a scanogram image, as shown in the upper diagram of Fig. 6 as an example. In this case, the estimation of the first FOV 61A may be performed, for example, by recognizing feature points of an organ from the scanogram image and setting an ROI (Region of Interest) surrounding the feature points as the first FOV 61A, or by using a model for organ recognition or ROI setting using machine learning.

[0050] On the other hand, as shown in the lower diagram of Fig. 6 as an example, the console 4 estimates the body thickness of the subject as described above based on the depth information indicated by the depth camera image acquired from the camera 7. In this case, initial depth information may be registered in advance for each height of the top surface of the table 31 of the bed 3 that can be used in the medical diagnostic device, and the initial depth information corresponding to the height of the top surface of the table 31 during actual imaging may be selectively applied.

[0051] Next, the console 4 uses the estimated body thickness to estimate an FOV (hereinafter referred to as the "second FOV") 61B such that the maximum value of the body thickness is the horizontal size. At this time, the console 4 applies the same size as the first FOV 61A as the vertical size of the second FOV 61B. However, this is not limited to this, and the vertical sizes of the first FOV 61A and the second FOV 61B may be different.

[0052] Then, the console 4 compares the first FOV 61A and the second FOV 61B, and determines the FOV with the larger horizontal size as the final FOV.

[0053] In this manner, in this embodiment, both the first FOV 61A and the second FOV 61B are estimated, and the FOV with the larger horizontal size is applied, for the following reason.

[0054] That is, since the axial image is used for diagnosing the subject, it is desirable to have as high a resolution as possible, but to avoid a situation in which the subject's abdomen is cut off. Therefore, in the console 4 according to this embodiment, the first FOV 61A is used for subjects with a normal build to obtain a higher resolution axial image, while the second FOV 61B is used for subjects who are slightly obese to obtain an axial image in which the abdomen is not cut off.

[0055] Therefore, if it is known in advance whether the subject is slightly obese or not, only the second FOV 61B may be estimated without estimating the first FOV 61A, and the second FOV 61B may be determined as the final FOV.

[0056] Next, the operation of the console 4 will be described.

[0057] Fig. 7 is a flowchart showing the flow of control of the medical diagnostic apparatus by the console 4. The CPU 41 reads out a control program for the medical diagnostic apparatus from the ROM 42 or storage 44, loads it into the RAM 43, and executes it, thereby performing control processing for the medical diagnostic apparatus. The flowchart shown in Fig. 7 is executed when a subject undergoes an examination with the medical diagnostic apparatus.

[0058] In step S100, the CPU 41 moves the bed 3 into the gantry 11.

[0059] Following step S100, in step S102, the CPU 41 irradiates the subject with X-rays and obtains a scanogram image of the subject.

[0060] Following step S102, in step S104, the CPU 41 acquires a depth camera image from the camera 7 as described above.

[0061] Following step S104, in step S106, the CPU 41 determines the FOV as described above using the acquired scanogram image and depth camera image.

[0062] Following step S106, in step S108, the CPU 41 applies the determined FOV and performs the main examination on the subject.

[0063] As described above, according to an embodiment of the present disclosure, a scanogram image obtained by photographing a subject and a camera image obtained by photographing the subject with an optical camera or a depth camera are acquired, and the photographing range for the actual photographing is determined using body thickness information indicating the body thickness of the subject obtained from the camera image and the scanogram image. Therefore, it is possible to prevent the occurrence of missing parts in the axial image obtained by the actual photographing.

[0064] [Second embodiment] Figure 8 is a diagram used to explain the second embodiment of the disclosed technology, where the upper diagram shows an example of the second FOV61B and axial image of the actual imaging obtained using the disclosed technology, and the lower diagram shows an example of the third FOV61C and axial image of the actual imaging obtained using the disclosed technology with a margin added.

[0065] As an example, as shown in the upper diagram of Figure 8, if the size of the body thickness is applied directly to the FOV when estimating the FOV based on the body thickness as in the first embodiment, the image of the subject may be adjacent to the edge of the axial image on the captured axial image, which may make the image difficult to diagnose.

[0066] Therefore, the imaging range determination unit 403 of the console 4 according to the second embodiment determines the FOV (the third FOV 61C in the example shown in FIG. 8) by including a predetermined margin in body thickness information indicating the body thickness, as shown in the lower diagram of FIG. 8 as an example. This allows the subject's body to be accommodated in the FOV with ample room, making it possible to make the captured axial image an image that is easy to diagnose.

[0067] The margin in this case may be, for example, set by the user at an arbitrary fixed value, calculated by multiplying the estimated body thickness by a certain percentage, or calculated using a model using machine learning. Furthermore, the margin may be varied for each unit of clinically desired use, such as subject information (gender, height, weight, etc.), examination or diagnostic target, etc. For example, if an examination is easier to diagnose with a wider ROI, a relatively large margin may be used.

[0068] The operation of the console 4 according to this embodiment is the same as that of the first embodiment except that the above-mentioned margin is taken into account when determining the FOV in step S106, and therefore a description thereof will be omitted here.

[0069] [Third embodiment] When planning imaging using a medical diagnostic apparatus, the final FOV is generally determined by manipulating a scan planning line that indicates the FOV on the captured scanogram image.

[0070] In this case, if the FOV is determined in accordance with the body thickness as in the above-described embodiments, the width of the FOV 61 of the scan planning line appears to not match the width of the subject image displayed on the scanogram image, so the user may end up narrowing the FOV 61, as shown in Fig. 9 as an example. Fig. 9 is a diagram for explaining the problems of the disclosed technology, and shows an example of a defect in the axial image caused by the user misunderstanding and narrowing the FOV 61.

[0071] Therefore, in the console 4 according to the third embodiment, when the FOV estimated based on the body thickness is set as the FOV 61, as shown in Fig. 10 as an example, information indicating this is displayed on the GUI to notify the user. This allows the user to know whether the FOV has been set based on the body thickness, thereby preventing human error. Fig. 10 is a diagram showing an example of a notification state on the GUI screen displayed when planning the actual radiography according to the third embodiment of the disclosed technology.

[0072] As shown in Fig. 10, the display on the GUI screen in this embodiment may be, for example, such that an icon 62 is displayed on the scanogram image, or such that an icon 63 is displayed in the portion where the FOV or the like is set numerically, or such that the color, line width, or line type of lines 64A and 64B may be changed. Note that the example shown in Fig. 10 illustrates a case where icons representing cameras are used as the icons 62 and 63.

[0073] Fig. 11 is a block diagram showing an example of the functional configuration of the console 4 according to this embodiment. As shown in Fig. 11, the console 4 according to this embodiment differs from the console 4 according to the above embodiments in that a notification unit 408 is added. The notification unit 408 according to this embodiment notifies that the FOV has been determined using body thickness information.

[0074] FIG. 12 is a flowchart showing the flow of control of the medical diagnostic device by the console 4 according to this embodiment, and steps that perform the same processing as those shown in FIG. 7 are assigned the same step numbers as in FIG. 7, and their explanations will be omitted.

[0075] In step S107, the CPU 41 performs control to notify the user that the FOV determined by the processing in step S106 has been determined using body thickness information. As a result of this control, on the screen subsequently displayed on the display unit 46, etc., icons 62, 63, etc. are displayed, and the color, line width, line type, etc. of lines 64A, 64B are changed, as shown in Fig. 10 as an example.

[0076] [Fourth embodiment] In each of the above embodiments, the subject's body thickness is estimated using depth information obtained by camera 7, and the FOV is estimated based on that body thickness. However, if the subject's body thickness is not constant due to breathing, etc., the FOV may be insufficient depending on the timing of obtaining the depth information, etc.

[0077] Therefore, the imaging range determination unit 403 of the console 4 according to the fourth embodiment acquires respiration information indicating the breathing cycle of the subject in addition to depth information, and dynamically adjusts the FOV using the respiration information to set an FOV that follows the body movement of the subject due to breathing. That is, the imaging range determination unit 403 according to the present embodiment reflects the body movement of the subject in the FOV.

[0078] 13, breathing information is acquired before acquiring depth information from camera 7, and breathing information is also acquired at the same time as acquiring depth information from camera 7. The timing of the subject's breathing at the timing when the depth information from camera 7 is acquired is estimated, and the body thickness is estimated by combining the change in body thickness according to the breathing cycle, the depth information from camera 7 to the surface of the subject, and the depth information from camera 7 to the surface of the top board 31 of the bed 3. Fig. 13 is a graph showing an example of time-series changes in breathing information and body thickness according to the fourth embodiment of the disclosed technology.

[0079] For example, as shown in Fig. 14, the rate of change in body thickness of a typical subject is mapped for each respiratory cycle, and based on the mapping, the maximum value of the subject's body thickness is estimated using the rate at the time of acquiring depth information from camera 7, and the FOV is set according to the maximum value. Fig. 14 is a map showing an example of the relationship between the timing of breathing and the rate of change in body thickness according to the fourth embodiment of the disclosed technology, and in the example shown in Fig. 14, the rate at the center timing in the respiratory cycle is set to 1.0.

[0080] The operation of the console 4 according to this embodiment differs from that of the first embodiment only in the operation of the imaging range determination unit 403, and the other operations are the same as those of the first embodiment, so a description thereof will be omitted here.

[0081] [Fifth embodiment] In each of the above embodiments, the FOV determined by estimating the subject's body thickness using the depth information obtained by camera 7 may be wider than the ideal FOV due to factors such as the accuracy of obtaining the depth information from camera 7, as shown in the left diagram of Figure 15 as an example.

[0082] Therefore, the imaging range determination unit 403 of the console 4 according to the fifth embodiment detects an area in which the subject appears in the reconstructed axial image and optimizes the FOV according to that area, as shown in the right diagram of FIG. 15 as an example. The examination control unit 404 according to this embodiment then automatically reconstructs the axial image using the optimized FOV. This makes it possible to obtain an axial image with an optimal FOV without increasing the user's effort. FIG. 15 is a diagram used to explain the fifth embodiment of the disclosed technology. The left diagram shows an example of a defect in an axial image obtained by the disclosed technology, and the right diagram shows an example of an axial image in which the defect has been eliminated by reconstruction using the disclosed technology.

[0083] The process of detecting the area in the axial image where the subject is shown is, for example, to create an axial image in real time during imaging, and then detect the area in which the subject is shown in real time immediately after creation. Then, when imaging is completed, the optimal FOV is determined based on the detection results for all the created axial images, and the axial image is reconstructed using the determined FOV.

[0084] Here, the optimal FOV can be determined, for example, by determining the area that encompasses the largest area among the detection results for all axial images as the FOV, by multiplying the average value of the detection results for all axial images by a constant value, or by using a machine-learned model that outputs the optimal FOV for the subject on the axial images.

[0085] The operation of the console 4 in this embodiment differs from that in the first embodiment only in the operations of the imaging range determination unit 403 and the examination control unit 404, and the other operations are the same as in the first embodiment, so the explanation here will be omitted.

[0086] Furthermore, as examples of models using machine learning in some of the above embodiments, in addition to models using AI (Artificial Intelligence) using CNN (Convolutional Neural Network), other machine learning models such as AI other than CNN, such as RNN (Recurrent Neural Network), can also be applied.

[0087] Although the embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person skilled in the art of the present disclosure can conceive of various modifications or alterations within the scope of the technical idea described in the claims, and it is understood that these modifications or alterations also naturally fall within the technical scope of the present disclosure.

[0088] Furthermore, the effects described in the above embodiments are explanatory or exemplary and are not limited to those described in the above embodiments. In other words, the technology according to the present disclosure may achieve other effects that are obvious to a person skilled in the art of the present disclosure from the description in the above embodiments, in addition to or instead of the effects described in the above embodiments.

[0089] For example, in each of the above embodiments, the information processing device according to the present disclosure is applied to an X-ray CT scanner, but the present disclosure is not limited to this. The information processing device according to the present disclosure may be applied to an MRI scanner or the like, as long as the scanner is an imaging device that sets an imaging range using a scanogram image.

[0090] In each of the above embodiments, the following various processors may be used as the hardware structure of processing units that perform various processes, such as the scanogram image acquisition unit 401, the camera image acquisition unit 402, the imaging range determination unit 403, the examination control unit 404, the irradiation control unit 405, the noise removal unit 406, the bed control unit 407, and the notification unit 408. As described above, the various processors include a CPU, which is a general-purpose processor that executes software (programs) and functions as various processing units, as well as dedicated electrical circuits that are processors having a circuit configuration specifically designed to perform specific processes, such as a programmable logic device (PLD), a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field Programmable Gate Array), and an ASIC (Application Specific Integrated Circuit).

[0091] A single processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple processing units may be configured with a single processor.

[0092] Examples of configuring multiple processing units with a single processor include, first, a form in which one processor is configured with a combination of one or more CPUs and software, and this processor functions as multiple processing units, as typified by computers such as client and server. Second, a form in which a processor is used to realize the functions of the entire system including multiple processing units with a single IC (Integrated Circuit) chip, as typified by systems on chips (SoCs). In this way, various processing units are configured using one or more of the above-mentioned various processors as a hardware structure.

[0093] Furthermore, more specifically, the hardware structure of these various processors can be an electric circuit that combines circuit elements such as semiconductor elements.

[0094] In addition, in each of the above embodiments, the information processing program is pre-stored (installed) in the ROM 42 or storage 44 of the console 4, but this is not limiting. The information processing program may be provided in a form recorded on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), or a USB (Universal Serial Bus) memory. The information processing program may also be downloaded from an external device via a network.

[0095] From the above description, the invention described in the following appendix can be understood.

[0096] [Appendix 1] at least one processor; The processor: Obtaining a scanogram image obtained by photographing a subject and a camera image obtained by photographing the subject with an optical camera or a depth camera; determining an imaging range for the main imaging using body thickness information indicating a body thickness of the subject obtained from the camera image and the scanogram image; Information processing device. [Appendix 2] the camera image is a depth camera image captured by the depth camera, The body thickness information is information estimated using the depth camera image. 10. The information processing device according to claim 1. [Appendix 3] the camera image is an optical camera image obtained by photographing with the optical camera, The body thickness information is information estimated by analyzing an image of the subject included in the optical camera image. 10. The information processing device according to claim 1. [Appendix 4] The processor: determining the imaging range by including a predetermined margin in the body thickness information; 4. An information processing device according to any one of claims 1 to 3. [Appendix 5] The processor: notifying that the imaging range has been determined using the body thickness information; 5. An information processing device according to any one of claims 1 to 4. [Appendix 6] The processor: reflecting the subject's body movement in the imaging range; 6. An information processing device according to any one of claims 1 to 5. [Appendix 7] The processor: adjusting the determined imaging range using an axial image of the subject, and reconstructing the axial image in the main imaging; 7. An information processing device according to any one of claims 1 to 6. [Appendix 8] An information processing device according to any one of Supplementary Note 1 to Supplementary Note 7; a radiographic imaging device controlled by the information processing device; 1. A medical imaging device comprising: [Appendix 9] The processor: Obtaining a scanogram image obtained by photographing a subject and a camera image obtained by photographing the subject with an optical camera or a depth camera; determining an imaging range for the main imaging using body thickness information indicating a body thickness of the subject obtained from the camera image and the scanogram image; Information processing methods. [Appendix 9] Obtaining a scanogram image obtained by photographing a subject and a camera image obtained by photographing the subject with an optical camera or a depth camera; determining an imaging range for the main imaging using body thickness information indicating a body thickness of the subject obtained from the camera image and the scanogram image; An information processing program that causes a computer to execute a process. [Explanation of symbols]

[0097] 1. Scanner 11 Mounting stand 12 Rotating Plate 13 X-ray tube equipment 14 Collimator 15 X-ray detector 16 Data Collection Equipment 17 Rotating plate drive unit 18 Collimator control device 19 Rotating plate drive control device 20 X-ray high voltage generator 21 Data transmission equipment 3 berths 31 Top plate 32 Bed control device 33 Top plate up / down movement control device 34 Top plate forward / backward movement control device 4 Console 41 CPU 42 ROM 43 RAM 44 Storage 45 Input section 46 Display section 401 Scanogram image acquisition unit 402 Camera image acquisition unit 403 Shooting range determination unit 404 Inspection Control Unit 405 Irradiation control unit 406 Noise removal section 407 Bed Control Unit 408 Information Department 5. Hospital Information System 51 Patient Information Management System 52 Examination reservation system 6. Subjects 61 FOV 61A 1st FOV 61B 2nd FOV 61C 3rd FOV 62 icons 63 Icons 64A, 64B lines 7. Camera

Claims

1. at least one processor; The processor: Acquire a scanogram image obtained by photographing a subject and a camera image obtained by photographing the subject with an optical camera or a depth camera; determining an imaging range for the main imaging using body thickness information indicating a body thickness of the subject obtained from the camera image and the scanogram image; Information processing device.

2. the camera image is a depth camera image captured by the depth camera, The body thickness information is information estimated using the depth camera image. The information processing device according to claim 1 .

3. the camera image is an optical camera image obtained by capturing an image with the optical camera, The body thickness information is information estimated by analyzing an image of the subject included in the optical camera image. The information processing device according to claim 1 .

4. The processor: determining the imaging range by including a predetermined margin in the body thickness information; The information processing device according to any one of claims 1 to 3.

5. The processor: notifying that the imaging range has been determined using the body thickness information; 3. The information processing device according to claim 1.

6. The processor: reflecting the subject's body movement in the imaging range; 3. The information processing device according to claim 1.

7. The processor: adjusting the determined imaging range using an axial image of the subject, and reconstructing the axial image in the main imaging; 3. The information processing device according to claim 1.

8. The information processing device according to claim 1 or 2; a radiographic imaging device controlled by the information processing device; 1. A medical imaging device comprising:

9. The processor: Acquire a scanogram image obtained by photographing a subject and a camera image obtained by photographing the subject with an optical camera or a depth camera; determining an imaging range for the main imaging using body thickness information indicating a body thickness of the subject obtained from the camera image and the scanogram image; Information processing methods.

10. Acquire a scanogram image obtained by photographing a subject and a camera image obtained by photographing the subject with an optical camera or a depth camera; determining an imaging range for the main imaging using body thickness information indicating a body thickness of the subject obtained from the camera image and the scanogram image; An information processing program that causes a computer to execute a process.

Images