Information processing apparatus, medical image capturing apparatus, information processing method, and program

Abstract

To provide an information processing apparatus, a medical image capturing apparatus, an information processing method, and a program capable of suppressing display shake caused by display of a line indicating a capturing range of scanogram capturing, as compared with a technology of the related art.SOLUTION: An information processing apparatus 10 includes a display controller 24 that continuously acquires image information obtained by optically capturing a subject in a decubitus state on a bed while performing control to display a first line in a case where a difference between a position of the first line corresponding to a position of a predetermined part of the subject in an image indicated by the image information at a current point in time and a position of a second line corresponding to a position of the above-described predetermined part of the subject in an image indicated by the image information in a most recent past exceeds a predetermined threshold value.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, a medical imaging device, an information processing method, and a program. [Background technology]

[0002] In recent years, advances in medical equipment such as CT (Computed Tomography) and MRI (Magnetic Resonance Imaging) devices have led to the use of higher quality, higher resolution three-dimensional images for diagnostic imaging.

[0003] When imaging a subject using an imaging device such as a CT device or an MRI device, a scanogram (hereinafter referred to as "scanogram imaging") is taken prior to the actual imaging to obtain a three-dimensional image in order to determine the imaging range, and a two-dimensional positioning image (scanogram) is obtained. The operator of the imaging device (technologist, etc.) sets the imaging range for the actual imaging while looking at the scanogram. Note that a scanogram is also called a scout image, topogram, etc., but hereinafter referred to as a "scanogram."

[0004] Prior to scanogram imaging, the operator sets the imaging range for the scanogram imaging of the subject on the bed. For example, a cross-shaped laser is irradiated onto the subject, the scanogram start position for the scanogram imaging is set, and the scanogram end position for the scanogram imaging is set so that the imaging range corresponds to the imaging area. During scanogram imaging, the scanogram imaging begins when the bed is moved from its initial position to the scanogram start position, and ends when the bed is moved to the scanogram end position. The operator sets the imaging range for the actual imaging using the scanogram acquired by scanogram imaging, and then performs the actual imaging to obtain a 3D image.

[0005] Here, when setting the imaging range for scanogram imaging, the subject is imaged using a camera installed above the bed, feature points on the subject, such as both ankles, both hips, both elbows, and both shoulders, are detected, and the imaging range is specified based on the detected feature points. In this case, a trained detection model constructed by machine learning a neural network is used to detect the feature points.

[0006] As a technique relating to imaging using such a medical imaging device, Patent Document 1 discloses a medical image diagnostic device that aims to make the setting of the imaging cross-section position and imaging range more efficient than before.

[0007] This medical image diagnostic device includes a gantry device having an imaging system that uses radiation or magnetism to image a subject, and an image generation unit that generates a second image by combining a first image obtained by imaging the subject using an optical imaging device different from the imaging system and a plane related to the imaging position in imaging using the imaging system. [Prior art documents] [Patent documents]

[0008] [Patent Document 1] Patent Publication No. 2021-062126 Summary of the Invention [Problem to be solved by the invention]

[0009] Incidentally, there has been a conventional technique for performing scanogram imaging, in which an imaging range for scanogram imaging is specified based on the position of an image of a subject obtained by optically imaging the subject in a supine position on a bed, and a line indicating the imaging range is displayed in real time by being superimposed on the image of the subject, a schema, etc. By referring to this display, an operator can confirm the imaging range for scanogram imaging in a state where it follows the movement of the subject, prior to scanogram imaging.

[0010] However, this technology has a problem in that the lines indicating the shooting range are displayed superimposed on other images in real time, which makes the displayed image prone to blurring (hereinafter referred to as "display blurring"). Note that the technology disclosed in Patent Document 1 does not take this display blurring into consideration and is unable to solve this problem.

[0011] The present disclosure has been made in consideration of the above circumstances, and aims to provide an information processing device, a medical image capturing device, an information processing method, and a program that can suppress display blurring caused by the display of lines indicating the capturing range of scanogram imaging compared to conventional technologies. [Means for solving the problem]

[0012] In order to achieve the above object, an information processing device of a first aspect of the present disclosure includes at least one processor, which continuously acquires image information obtained by optically photographing a subject lying on a bed, and controls the display of the first line when the difference between the position of a first line corresponding to the position of a predetermined part of the subject in the image represented by the current image information and the position of a second line corresponding to the position of the predetermined part of the subject in the image represented by the most recent past image information exceeds a predetermined threshold.

[0013] An information processing device according to a second aspect of the present disclosure is the information processing device according to the first aspect, wherein the processor performs control to display the second line when the difference is equal to or smaller than a threshold value.

[0014] An information processing device of a third aspect of the present disclosure is an information processing device of the first or second aspect, in which the position of the second line is a position obtained by a moving average using images represented by multiple image information from the most recent past.

[0015] An information processing device of a fourth aspect of the present disclosure is an information processing device of the first or second aspect, in which the position of the second line is a position obtained by an image indicated by the most recent single image information from the past.

[0016] An information processing device of a fifth aspect of the present disclosure is an information processing device of the first aspect, in which a processor performs control using a difference when a bed is movable in the vertical direction and an imaging device that performs optical imaging is fixed above the bed, and when the distance between the bed and the imaging device changes beyond a predetermined distance as the bed moves.

[0017] An information processing device according to a sixth aspect of the present disclosure is the information processing device according to the fifth aspect, wherein the processor changes the threshold value according to the distance.

[0018] On the other hand, in order to achieve the above object, a medical imaging device according to a seventh aspect of the present disclosure includes an information processing device of the present disclosure and a radiation imaging device controlled by the information processing device.

[0019] In addition, in order to achieve the above-mentioned object, an information processing method of an eighth aspect of the present disclosure includes a computer continuously acquiring image information obtained by optically photographing a subject lying on a bed, and controlling the display of the first line when the difference between the position of a first line corresponding to the position of a predetermined part of the subject in the image represented by the current image information and the position of a second line corresponding to the position of the above-mentioned predetermined part of the subject in the image represented by the most recent past image information exceeds a predetermined threshold.

[0020] Furthermore, in order to achieve the above object, the program of the ninth aspect of the present disclosure causes a computer to execute a process of continuously acquiring image information obtained by optically photographing a subject lying on a bed, and controlling the display of the first line when the difference between the position of a first line corresponding to the position of a predetermined part of the subject in the image represented by the current image information and the position of a second line corresponding to the position of the predetermined part of the subject in the image represented by the most recent past image information exceeds a predetermined threshold. [Effects of the Invention]

[0021] According to the present disclosure, compared to conventional techniques, it is possible to suppress display blurring caused by displaying lines indicating the imaging range of scanogram imaging. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is a perspective view showing an overview of a CT device to which an information processing device according to an embodiment is applied. [Figure 2] 1 is a diagram showing a CT apparatus to which an information processing apparatus according to an embodiment is applied, as viewed from the side; [Figure 3] 1 is a block diagram showing a schematic configuration of an information processing apparatus according to an embodiment; [Figure 4] FIG. 1 is a block diagram showing a functional configuration of an information processing apparatus according to an embodiment. [Figure 5] FIG. 10 is a diagram for explaining feature points according to the embodiment. [Figure 6] FIG. 10 is a diagram illustrating an example of a line display screen according to the embodiment. [Figure 7] 4 is a flowchart showing an example of the flow of information processing according to the first embodiment. [Figure 8] FIG. 10 is a diagram for explaining the processing according to the second embodiment, and is a side view showing an example of a state in which the bed moves up and down. [Figure 9] FIG. 10 is a diagram for explaining the processing according to the second embodiment, showing an example of the state of the line display screen when the bed moves up and down. [Figure 10] 10 is a flowchart showing an example of the flow of information processing according to the second embodiment. [Figure 11] 10 is a flowchart showing an example of the flow of second information processing according to the second embodiment. [Figure 12] 10 is a flowchart showing an example of the flow of third information processing according to the second embodiment. [Figure 13] FIG. 10 is a diagram illustrating an example of a line display screen according to another embodiment. [Figure 14] FIG. 10 is a diagram illustrating an example of a line display screen according to another embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0023] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0024] [First embodiment] FIG. 1 is a perspective view showing an overview of a CT device to which an information processing device according to an embodiment of the present disclosure is applied, and FIG. 2 is a side view of the CT device to which an information processing device according to an embodiment of the present disclosure is applied.

[0025] 1 and 2, a CT device 1 according to this embodiment includes a gantry 2, a bed 3, and a console 4. The combination of the gantry 2 and the bed 3 corresponds to the radiographic imaging device of the present disclosure, and the combination of the gantry 2, the bed 3, and the console 4 corresponds to the medical imaging device of the present disclosure.

[0026] The gantry 2 has a tunnel-like structure with an opening 5 in its center. Inside the gantry 2, there are provided a radiation source unit that emits X-rays and a detection unit that detects the X-rays and generates a radiographic image (neither is shown). The radiation source unit and the detection unit can rotate along the annular shape of the gantry 2 while maintaining a mutually opposing positional relationship. Also provided inside the gantry 2 is a control unit that controls the operation of the CT device 1.

[0027] The gantry 2 is provided with a display device 2A at the center of the top on the front side (the side where the bed 3 is placed), and an operation button 2B is provided on the left side of the front side as viewed from the front. The display device 2A according to this embodiment can display various information including a line display screen, the details of which will be described later, under the control of the console 4. The operation button 2B according to this embodiment is a button that is pressed by the operator when performing scanogram imaging to obtain a two-dimensional image or main imaging to obtain a three-dimensional image after positioning of the subject on the bed 3 is completed.

[0028] Meanwhile, the bed 3 has a bed section 3A on which the subject lies, a base section 3B that supports the bed section 3A, and a drive section 3C that moves the bed section 3A back and forth in the direction of arrow A. The bed section 3A can be slid relative to the base section 3B in the direction of arrow A by the drive section 3C. When taking a CT image, the bed section 3A slides, and the subject H lying on the bed section 3A is transported into the opening 5 of the gantry 2.

[0029] A camera 7 is installed above the bed 3. The camera 7 is capable of capturing R (red), G (green), and B (blue) color images by detecting reflected light from the subject H. The camera 7 has a lens and an imaging element such as a CCD (Charge Coupled Device), and captures the subject H on the bed 3 at a predetermined frame rate to obtain a moving image, which is then output to the console 4. The camera 7 may be a camera combining an RGB camera and an NIR (Near Infrared) camera. In this case, the NIR camera is a stereo camera, and depth information of the subject H can be obtained by parallax. By configuring the NIR camera of the camera 7 as a stereo camera, depth information of the subject H on the bed 3 can be obtained. The NIR camera can capture images even when there is insufficient light. Therefore, if the brightness of the examination room is insufficient for RGB camera capture, the subject H may be captured by the NIR camera.

[0030] Driving of the gantry 2, driving of the bed 3, and imaging of the subject by the camera 7 are performed by input from an operator via the console 4. The console 4 includes an information processing device according to this embodiment.

[0031] Next, a description will be given of the information processing device according to this embodiment included in the console 4. First, the hardware configuration of the information processing device according to this embodiment will be described with reference to FIG.

[0032] As shown in Fig. 3, the information processing device 10 is a computer such as a workstation, a server computer, or a personal computer, and includes a CPU (Central Processing Unit) 11, non-volatile storage 13, and memory 16 as a temporary storage area. The information processing device 10 also includes a display 14 such as a liquid crystal display, an input device 15 such as a keyboard and a mouse, and a network I / F (Interface) 17 connected to the CT device 1. The CPU 11, storage 13, display 14, input device 15, memory 16, and network I / F 17 are connected to a bus 18. The CPU 11 is an example of a processor in the present disclosure. The display 14 and input device 15 are also illustrated in Figs. 1 and 2.

[0033] The storage 13 is realized by a hard disk drive (HDD), a solid state drive (SSD), a flash memory, etc. The storage 13 as a storage medium stores an information processing program 12 installed in the information processing device 10. The CPU 11 reads the information processing program 12 from the storage 13, expands it in the memory 16, and executes the expanded information processing program 12. The processing method executed by the information processing program 12 corresponds to the information processing method of the present disclosure.

[0034] The information processing program 12 is stored in a state accessible from the outside in a storage device of a server computer connected to a network or in a network storage, and is downloaded and installed in a computer constituting the information processing device 10 in response to a request. Alternatively, the information processing program 12 is recorded on a recording medium such as a DVD (Digital Versatile Disc) or a CD-ROM (Compact Disc Read Only Memory) and distributed, and is installed from the recording medium into a computer constituting the information processing device 10.

[0035] Next, the functional configuration of the information processing device according to this embodiment will be described with reference to Fig. 4, which is a diagram showing the functional configuration of the information processing device according to this embodiment.

[0036] 4, the information processing device 10 includes an imaging control unit 20, a camera control unit 21, a feature point detection unit 22, a shooting area identification unit 23, and a display control unit 24. When the CPU 11 executes the information processing program 12, the CPU 11 functions as the imaging control unit 20, the camera control unit 21, the feature point detection unit 22, the shooting area identification unit 23, and the display control unit 24.

[0037] The imaging control unit 20 controls the imaging unit, detection unit, and control unit provided in the gantry 2 in response to instructions from the input device 15 so as to perform imaging of the subject H. Note that, in CT imaging, scanogram imaging is performed prior to the actual imaging to obtain a three-dimensional CT image in order to determine the imaging range. The scanogram imaging is performed by imaging the subject H with the imaging unit and detection unit fixed.

[0038] When performing scanogram imaging, the imaging range of subject H is set, and then the bed 3 is moved to the opening 5 of the gantry 2 so that the set imaging range is imaged, and scanogram imaging is performed. The scanogram obtained by scanogram imaging is a two-dimensional image that includes the imaging range set for subject H. The scanogram is displayed on the display 14. The operator looks at the scanogram displayed on the display 14 and sets the imaging range for the actual imaging. After setting the imaging range, the operator issues an instruction for the actual imaging by pressing the operation button 2B, and the actual imaging is performed, and a three-dimensional CT image of subject H is acquired. The acquired scanogram and CT image are saved in the storage 13.

[0039] The camera control unit 21 controls the camera 7 to capture the subject H on the bed 3. The camera 7 captures the subject H in order to set the capture range for scanogram capture. The camera 7 captures the subject H from the preparation stage before capture. That is, the camera control unit 21 starts capturing the subject H with the camera 7 before the subject H lies on the bed 3, and causes the camera 7 to acquire camera images. Then, when an instruction to start scanogram capture is given by the operator, the camera control unit 21 stops the camera 7 from capturing the image. The acquired camera images are stored in the memory 16 to specify the capture range, which will be described later.

[0040] The feature point detection unit 22 uses a pre-constructed detection model 22A to detect a plurality of feature points on the subject H included in the camera image. FIG. 5 is a diagram for explaining feature points according to this embodiment. As shown in FIG. 5, in this embodiment, the detection model 22A is constructed so as to detect 17 feature points on the subject H included in the camera image. The 17 feature points are both eyes, nose, both ears, both shoulders, both elbows, both hands, both hips, both knees, and both feet. Note that a point in the middle of the collarbone may be added to these 17 feature points, making a total of 18 feature points to be used.

[0041] The detection model 22A according to this embodiment is constructed by machine learning a neural network. This neural network uses a training image, which includes the entire human body and has 17 known feature points, acquired by photographing the human body with the camera 7. The training image is acquired by photographing, for example, a person wearing an examination gown with the camera 7, just as in an actual examination.

[0042] The detection model 22A according to this embodiment derives a probability representing the possibility of each of 17 feature points for each pixel of the camera image. Then, the feature point detection unit 22 detects the pixel with the highest derived probability for each of the 17 feature points as the feature point. For example, when detecting the right eye as a feature point, the feature point detection unit 22 compares the probability that all pixels of the camera image derived by the detection model 22A are the right eye, and detects the pixel with the highest probability as the feature point for the right eye.

[0043] The imaging range specifying unit 23 specifies the imaging range of the subject H when performing scanogram imaging based on the 17 feature points detected by the feature point detection unit 22. To this end, the imaging range specifying unit 23 first determines the detection accuracy of the feature points detected by the feature point detection unit 22. As described above, the feature point detection unit 22 detects the pixel from which the highest probability is derived as a feature point for each of the 17 feature points. The higher the probability output by the detection model 22A for the detected feature point, the better the detection accuracy. For this reason, the imaging range specifying unit 23 compares a representative value of the probabilities derived by the detection model 22A for the 17 feature points with a predetermined threshold, and determines that the detection accuracy is good if the representative value is equal to or greater than the threshold, and that the detection accuracy is poor if the representative value is less than the threshold. The representative value may be, but is not limited to, an average value, a median value, a weighted average value according to the imaging region, or the like.

[0044] If the imaging range specifying unit 23 determines that the detection accuracy is good, it performs a process of specifying the imaging range. On the other hand, if the detection accuracy is determined to be poor, the imaging range specifying unit 23 displays a warning on the display 14. Here, if the subject H is moving too much, if the subject H is covered with a thick blanket, or if the entire body of the subject H is not included in the imaging range of the camera 7, feature points cannot be detected with high accuracy even using the detection model 22A, and the detection accuracy deteriorates. In such cases, the imaging range specifying unit 23 determines that the detection accuracy is poor.

[0045] When the warning display is displayed, the operator manually sets the imaging range for scanogram imaging. That is, the operator measures the distance from the initial position of the bed to a scanogram start line (described later), and further measures the distance between the scanogram start line and a scanogram end line (described later), and inputs the measured distances via the input device 15. Based on the input distances, the movement of the bed 3 during scanogram imaging is controlled.

[0046] The imaging region of the subject H is included in the examination order provided by the doctor at the time of imaging, and the operator refers to the examination order and sets the imaging region using the input device 15. The imaging regions of the subject H include the head, chest, abdomen, lower limbs, and whole body.

[0047] The process of specifying the imaging range by imaging range specifying unit 23 will be described below. For example, if the imaging part is the chest, the imaging range of the scanogram is from the tip of the chin to the middle of the abdomen. For this reason, imaging range specifying unit 23 sets the line connecting both shoulders, among the feature points detected by feature point detection unit 22, as the scanogram start line, and sets the center line between the line connecting both elbows and the line connecting both hands as the scanogram end line. Then, imaging range specifying unit 23 derives the distance D1 between the scanogram start line and the scanogram end line. The range of distance D1 between the scanogram start line and the scanogram end line becomes the imaging range.

[0048] Here, before scanogram imaging, the bed 3 is in its initial position and the subject H is lying on the bed 3, so the distance from the end of the bed 3 to the scanogram start line can be determined from the camera image. Therefore, the imaging range specifying unit 23 calculates the distance D2 from the end of the bed 3 to the scanogram start line as the amount of movement of the bed 3 from the initial position to the scanogram start line, i.e., the amount of movement of the bed 3 until the scanogram start line reaches the scanogram start position in the CT device 1.

[0049] When the imaging range for scanogram imaging is specified by imaging range specification unit 23, display control unit 24 controls the display of an image in real time on display device 2A in which the scanogram start line, scanogram end line, and a median line connecting the midpoints of the scanogram start line and scanogram end line are superimposed on the camera image. Hereinafter, the screen displayed on display device 2A at this time will be referred to as the "line display screen."

[0050] Fig. 6 is a diagram showing an example of a line display screen according to this embodiment. As shown in Fig. 6, the line display screen according to this embodiment displays an image 30 of subject H (hereinafter referred to as "subject image"), as well as a scanogram start line 31, a scanogram end line 32, and a median line 33. The operator checks the scanogram start line 31, the scanogram end line 32, and the median line 33 displayed on the display device 2A. After checking, if there are no problems, the operator presses the operation button 2B to issue an instruction to start scanogram imaging.

[0051] In response to an instruction to start scanogram imaging, information on distances D1 and D2 is output to the CT device 1. The imaging control unit 20 controls the CT device 1 so that scanogram imaging starts after the driving unit 3C moves the bed 3 by a distance D2, and ends the scanogram imaging when the driving unit 3C moves the bed 3 by a distance D1.

[0052] The scanogram acquired by scanogram imaging is displayed on display 14. The operator checks the scanogram displayed on display 14 and sets the imaging range for the actual imaging for the scanogram. Thereafter, the actual imaging is performed by issuing an imaging instruction for the actual imaging by pressing operation button 2B, and a 3D CT image of the imaging region of subject H is acquired within the set imaging range for the actual imaging.

[0053] In this way, in the scanogram imaging according to this embodiment, the line display screen is displayed in real time prior to the imaging, and in this case, each line indicating the imaging range is displayed superimposed on the camera image in real time for each imaging frame, which has led to the problem that the line display screen displayed on the display device 2A is prone to display blur.

[0054] Therefore, the display control unit 24 according to the present embodiment controls to display the first line when a difference D between the position of a first line corresponding to the position of a predetermined part of the subject H in the camera image represented by current image information among image information representing the camera image acquired by the camera 7, and the position of a second line corresponding to the position of the predetermined part of the subject H in the image represented by the most recent image information (in the present embodiment, one frame before the present time) exceeds a predetermined threshold. In contrast, the display control unit 24 according to the present embodiment controls to display the second line when the difference D is equal to or less than the threshold.

[0055] In this embodiment, the above-mentioned scanogram start line 31, scanogram end line 32, and median line 33 (hereinafter simply referred to as "lines") are used as the first and second lines. Here, the difference between the first and second lines is that the first line represents the current line, and the second line represents the most recent past line.

[0056] That is, the display control unit 24 according to this embodiment derives the amount of deviation between the position of the line indicating the imaging range of the current scanogram imaging and the position of the line indicating the imaging range of the most recent scanogram imaging as a difference D. Then, if the derived difference D is equal to or greater than the threshold value, the display control unit 24 performs control to display the current line, in other words, the latest line, on the line display screen instead of the previous line.

[0057] On the other hand, if the derived difference D is less than the threshold, the display control unit 24 controls to display the most recent line, in other words, the line that was displayed up to that point, on the line display screen. Therefore, according to the display control unit 24 of this embodiment, if the difference D, i.e., the amount of deviation of the scanogram imaging range from the most recent past, is small, the line displayed on the line display screen is not changed. This makes it possible to suppress the occurrence of the display blur on the line display screen described above. Note that the display of the most recent line performed here does not necessarily require that the line be displayed again. If the display state of the line that was displayed up to that point is maintained so as to be visible on the line display screen, it is not necessarily required to control to display the line again.

[0058] In this embodiment, the difference D is determined by the largest distance between the scanogram start lines 31, the distance between the scanogram end lines 32, and the distance between the median lines 33 of the first and second lines, but this is not limiting. For example, the difference D may be determined by the smallest or intermediate distance between the scanogram start lines 31, the distance between the scanogram end lines 32, and the distance between the median lines 33 of the first and second lines. In this embodiment, the distance between the midpoints of the corresponding lines is determined by the distance between the corresponding lines, but this is not limiting. For example, the largest distance between the corresponding lines may be determined by the distance between the corresponding lines.

[0059] Furthermore, in this embodiment, the threshold value is a fixed value that, if the difference D exceeds that value, the display of the imaging range of the scanogram imaging on the line display screen must be updated, or problems will occur. However, the present invention is not limited to this. For example, the threshold value may be set by the operator as appropriate depending on the accuracy required for the scanogram imaging, the behavior of the subject H, etc.

[0060] Furthermore, in this embodiment, the position of the second line is determined based on the image represented by a single piece of image information from the most recent past. This reduces the processing time and the storage capacity required to store image information compared to when the position of the second line is determined based on a moving average of images represented by multiple pieces of image information from the most recent past.

[0061] Next, a description will be given of information processing performed in the first embodiment. Fig. 7 is a flowchart showing the flow of information processing performed in the first embodiment. Information processing starts when an instruction to start shooting is given from the input device 15.

[0062] In step 100, the CPU 11 controls the camera 7 to start taking pictures, in step 102 the CPU 11 acquires one frame of camera image, and in step 104 the CPU 11 detects feature points from the camera image using the detection model 22A.

[0063] In step 106, the CPU 11 determines whether the feature point detection accuracy is good or not, and if the determination is negative, the process proceeds to step 108, where the CPU 11 displays a warning, and then the process proceeds to step 122. When the warning is displayed, the operator manually sets the imaging range for scanogram imaging, as described above.

[0064] On the other hand, if the judgment in step 106 is positive, the process proceeds to step 110, where the CPU 11 identifies the shooting range for scanogram shooting and stores it in memory 16. In step 112, the CPU 11 determines whether the storage is the second or subsequent storage. If the judgment is negative, the process proceeds to step 118, whereas if the judgment is positive, the process proceeds to step 114.

[0065] In step 114, the CPU 11 derives the above-mentioned difference D, and in step 116, the CPU 11 determines whether the difference D exceeds the threshold value TH. If the determination is negative, the CPU 11 proceeds to step 120, whereas if the determination is positive, the CPU 11 proceeds to step 118.

[0066] In step 118, the CPU 11 controls the display device 2A to display a line display screen showing the shooting range identified by the processing of the most recent step 110.

[0067] In step 120, the CPU 11 determines whether the operation button 2B has been pressed, thereby determining whether the operator has instructed to perform scanogram imaging.If the determination is negative, the process returns to step 102, while if the determination is positive, the process proceeds to step 122.

[0068] In step 122, the CPU 11 stops the image capture by the camera 7, and then ends this information processing.

[0069] In this way, in the information processing according to this embodiment, the line display screen is not updated when the difference D is equal to or less than the threshold value TH, but this is not limiting. As described above, when the difference D is equal to or less than the threshold value TH, the line display screen may be updated using the shooting range stored immediately before the most recent processing of step 110.

[0070] Thereafter, scanogram imaging is performed by the imaging control unit 20, and a scanogram is acquired and displayed on the display 14. After checking the scanogram, the operator sets the imaging range for the actual imaging. Then, the operator issues an instruction for the actual imaging by pressing the operation button 2B, and the actual imaging is performed, and a three-dimensional CT image of the subject H is acquired.

[0071] As described above, the information processing device 10 according to this embodiment continuously acquires image information obtained by optically capturing an image of a subject lying on a bed, and controls the display of the first line when the difference between the position of a first line corresponding to the position of a predetermined part of the subject in the image represented by the current image information and the position of a second line corresponding to the position of the predetermined part of the subject in the image represented by the most recent image information exceeds a predetermined threshold. This reduces the frequency of updating the line, thereby making it possible to suppress display blurring caused by the display of the line indicating the imaging range of scanogram imaging compared to conventional techniques.

[0072] [Second embodiment] In this second embodiment, the position of the second line is determined by a moving average using images represented by multiple image information from the most recent past, and an example of a configuration is described in which the bed section 3A of the bed 3 is configured to be movable in the vertical direction while also responding to unexpected movements of the subject H.

[0073] That is, in the bed 3 according to this embodiment, the bed section 3A is movable in the vertical direction under the control of the information processing device 10. However, this is not limiting, and the bed section 3A may be movable in the vertical direction by manual operation by an operator.

[0074] The configuration of the information processing device 10 according to this embodiment is substantially the same as that according to the first embodiment, except for a part of the processing performed by the display control unit 24.

[0075] The display control unit 24 according to this embodiment applies, as the position of the second line, a position obtained by a moving average using images represented by a plurality of image information from the most recent past. While any number can be applied as the number of targets for the moving average, in this embodiment, a number equivalent to 10 frames of camera images is applied. Thus, in this embodiment, a fixed number is applied as the number of targets for the moving average, but this is not limiting. For example, the number of targets for the moving average may be appropriately set by having the operator input a value according to the circumstances of scanogram imaging, the operator's own preferences, etc.

[0076] In addition, in order to respond to unexpected movements of the subject H, the display control unit 24 of this embodiment is configured to perform a process (hereinafter referred to as ``second information processing'') that executes control using the difference D when the subject H moves more than a predetermined amount of movement.

[0077] On the other hand, in this embodiment, since the bed section 3A of the bed 3 is movable in the vertical direction, the distance d between the camera 7 and the bed section 3A of the bed 3 may change, as shown in FIG. 8 as an example. In this case, the subject image 30 included in the camera image captured by the camera 7 becomes larger as the height of the bed section 3A of the bed 3 increases, as shown in FIG. 9 as an example. In the example shown in FIG. 9, the left diagram is an example of a camera image when the height of the bed section 3A in FIG. 8 is height H1, and the right diagram is an example of a camera image when the height of the bed section 3A in FIG. 8 is height H2. Therefore, the distance per pixel in the camera image also changes, and the higher the height of the bed section 3A, the more likely the difference D is to exceed the threshold value TH.

[0078] Therefore, the display control unit 24 according to this embodiment performs a process (hereinafter referred to as "third information processing") to execute control using the difference D when the distance between the bed 3A and the camera 7 changes beyond a predetermined distance as the bed 3A of the bed 3 moves. Furthermore, when this third information processing is performed, the difference D is likely to exceed the threshold value TH as described above, so the threshold value TH is changed according to the distance d.

[0079] Next, the operation of the information processing device 10 according to this embodiment when information processing is executed will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the flow of information processing performed in this embodiment, and steps that perform the same processing as the information processing shown in Fig. 7 are assigned the same step numbers as in Fig. 7, and their description will be omitted.

[0080] In step 112B of FIG. 10, the CPU 11 determines whether the storage of the shooting range by the processing of step 110 is the (N+1)th or later storage, and if the determination is negative, the process proceeds to step 118, whereas if the determination is positive, the process proceeds to step 114B.

[0081] In step 114B, the CPU 11 derives, as the difference D, the difference between the position of the second line obtained by the above-described moving average and the position of the first line.

[0082] In step 119, the CPU 11 applies the position of the second line derived in conjunction with the derivation of the difference D in the processing of the previous step 114B as the position of each line indicating the shooting range, and controls the display device 2A to display a line display screen.

[0083] Next, the operation of the information processing device 10 according to this embodiment when the second information processing is executed will be described with reference to Fig. 11. Fig. 11 is a flowchart showing the flow of the second information processing performed in this embodiment, and steps that perform the same processing as the information processing shown in Fig. 10 are assigned the same step numbers as in Fig. 10, and their description will be omitted. The second information processing according to this embodiment is executed every predetermined time (0.1 seconds in this embodiment).

[0084] As shown in FIG. 11, the second information processing according to this embodiment is different from the information processing according to this embodiment in that the processing of steps 102 to 119 is the same as that of step 100A.

[0085] 11, the CPU 11 determines whether or not it has been detected that the subject H has moved by more than a predetermined movement threshold, and if the determination is negative, the second information processing is terminated, whereas if the determination is positive, the process proceeds to step 102. Note that in this embodiment, the determination of whether or not the subject H has moved by more than a predetermined movement threshold is made by determining whether or not the amount of two-dimensional movement of the feature points detected by the feature point detection unit 22 between temporally adjacent frames in the camera images is greater than or equal to a predetermined amount, but it goes without saying that the present invention is not limited to this.

[0086] This second information processing makes it possible to deal with unexpected movements of the subject H.

[0087] Next, the operation of the information processing device 10 according to this embodiment when the third information processing is executed will be described with reference to Fig. 12. Fig. 12 is a flowchart showing the flow of the third information processing performed in this embodiment, and steps that perform the same processing as the information processing shown in Fig. 10 are assigned the same step numbers as in Fig. 10, and their description will be omitted. The third information processing according to this embodiment is also executed every predetermined time (0.1 seconds in this embodiment).

[0088] As shown in FIG. 12, the third information processing according to this embodiment is the same as the information processing according to this embodiment in the processes of steps 102 to 119 except for step 116, but differs only in that step 116 is changed to step 116B and the process of step 100B has been added.

[0089] That is, in step 100B of FIG. 12, the CPU 11 determines whether the height of the bed portion 3A of the bed 3 has moved beyond a predetermined distance, and if the determination is negative, the third information processing is terminated, whereas if the determination is positive, the CPU 11 proceeds to step 102.

[0090] Then, in step 116B, the CPU 11 applies a predetermined threshold value according to the height of the bed portion 3A of the bed 3 as the threshold value TH, and determines whether the difference D exceeds the threshold value TH. If the determination is negative, the CPU 11 proceeds to step 119, whereas if the determination is positive, the CPU 11 proceeds to step 118.

[0091] By this third information processing, even if the height of the bed section 3A of the bed 3 changes, it is possible to deal with the situation appropriately.

[0092] As described above, according to the information processing device 10 of this embodiment, the position of the second line is determined by a moving average of images represented by a plurality of pieces of image information from the most recent past. This makes it possible to deal with variations in the camera image between frames, thereby more effectively suppressing blurring caused by the display of the line indicating the imaging range of scanogram imaging.

[0093] Furthermore, according to the information processing device 10 of this embodiment, when the bed section 3A of the bed 3 is movable in the vertical direction and the camera 7 is fixed above the bed 3, if the distance between the bed section 3A and the camera 7 changes beyond a predetermined distance as the bed section 3A moves, control is performed using the difference D. Therefore, even if the bed section 3A moves in the vertical direction, the display blur can be more accurately suppressed.

[0094] Furthermore, according to the information processing device 10 of this embodiment, the threshold value TH is changed according to the distance d. Therefore, even if the bed 3A moves in the vertical direction, the display blur can be more accurately suppressed.

[0095] The line display screen applied in each of the above embodiments is an example and is not limited to the one shown in the drawings. For example, as shown in Fig. 13, lines 34A and 34B indicating the left and right ranges in the imaging range of scanogram imaging may also be displayed on the line display screen.

[0096] Furthermore, in each of the above embodiments, the imaging range of the scanogram imaging is the imaging range when the subject H is viewed from above, but this is not limited to this. For example, the imaging range of the scanogram imaging may be the imaging range when the subject H is viewed from the side. In this embodiment, the camera 7 is also provided on the side of the subject H, or the camera 7 includes the NIR camera described above.

[0097] An example of a line display screen in this form is shown in Figure 14. In Figure 14, the scanogram start line is line 35, the scanogram end line is line 36, and the median line is line 37.

[0098] Furthermore, the types of lines shown in the above examples are not limited to the solid lines and dashed lines shown in the figures, and other types such as dashed lines and dotted lines may be applied. Furthermore, from the standpoint of ease of visibility, the color and thickness of the lines, and the display state such as blinking display or reverse display may be changed depending on the purpose of each line.

[0099] Furthermore, in each of the above embodiments, the information processing device according to the present disclosure is applied to a CT device, but this is not limited thereto. The information processing device according to the present disclosure may also be applied to an MRI device or the like, as long as the imaging device acquires a scanogram for setting the imaging range before the actual imaging.

[0100] In addition, in each of the above embodiments, the information processing device includes the photographing control unit 20, but this is not limitative. The photographing control unit 20 may be provided separately from the information processing device.

[0101] In the above embodiment, the following various processors can be used as the hardware structure of processing units that perform various processes, such as the photography control unit 20, the camera control unit 21, the feature point detection unit 22, the photography range identification unit 23, and the display control unit 24. As described above, the various processors include a CPU, which is a general-purpose processor that executes software (programs) and functions as various processing units, as well as dedicated electrical circuits that are processors having a circuit configuration specifically designed to perform specific processes, such as a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field Programmable Gate Array), and an ASIC (Application Specific Integrated Circuit).

[0102] A single processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs or a combination of a CPU and an FPGA). Also, multiple processing units may be configured with a single processor.

[0103] Examples of configuring multiple processing units with a single processor include, first, a form in which one processor is configured with a combination of one or more CPUs and software, and this processor functions as multiple processing units, as typified by computers such as client and server. Second, a form in which a processor is used to realize the functions of an entire system including multiple processing units with a single IC (Integrated Circuit) chip, as typified by systems on chips (SoCs). In this way, various processing units are configured using one or more of the above-mentioned various processors as a hardware structure.

[0104] Furthermore, more specifically, the hardware structure of these various processors can be an electric circuit that combines circuit elements such as semiconductor elements.

[0105] From the above description, the invention described in the following appendix can be understood.

[0106] [Appendix 1] at least one processor; The processor: The subject is placed in a supine position on a bed, and image information obtained by optically photographing the subject is continuously acquired. When a difference between a position of a first line corresponding to a position of a predetermined part of the subject in an image represented by the current image information and a position of a second line corresponding to the position of the predetermined part of the subject in an image represented by the most recent image information exceeds a predetermined threshold, control is performed to display the first line. Information processing device. [Appendix 2] The processor: When the difference is equal to or smaller than the threshold value, control is performed to display the second line. 2. The information processing device according to claim 1. [Appendix 3] The position of the second line is a position obtained by a moving average using images indicated by a plurality of pieces of image information in the most recent past. 10. The information processing device according to claim 1 or 2. [Appendix 4] the position of the second line is a position obtained by an image indicated by the most recent past single image information; 10. The information processing device according to claim 1 or 2. [Appendix 5] The processor: When the bed is movable in the vertical direction and an imaging device that performs the optical imaging is fixed above the bed, control is performed using the difference when the distance between the bed and the imaging device changes beyond a predetermined distance as the bed moves. 5. An information processing device according to any one of claims 1 to 4. [Appendix 6] The processor: The threshold value is changed according to the distance. 6. The information processing device according to claim 5. [Appendix 7] An information processing device according to any one of Supplementary Note 1 to Supplementary Note 6; a radiographic imaging device controlled by the information processing device; 1. A medical imaging device comprising: [Appendix 8] The computer The subject is placed in a supine position on a bed, and image information obtained by optically photographing the subject is continuously acquired. When a difference between a position of a first line corresponding to a position of a predetermined part of the subject in an image represented by the current image information and a position of a second line corresponding to the position of the predetermined part of the subject in an image represented by the most recent image information exceeds a predetermined threshold, control is performed to display the first line. Information processing methods. [Appendix 9] The subject is placed in a supine position on a bed, and image information obtained by optically photographing the subject is continuously acquired. When a difference between a position of a first line corresponding to a position of a predetermined part of the subject in an image represented by the current image information and a position of a second line corresponding to the position of the predetermined part of the subject in an image represented by the most recent image information exceeds a predetermined threshold, control is performed to display the first line. A program that causes a computer to perform a process. [Explanation of symbols]

[0107] 1 CT device 2 Gantry 2A display device 2B Operation Button 3 berths 3A Sleeper Section 3B base 3C Drive Unit 4 Console 5 Opening 7. Camera 10. Information processing equipment 11 CPU 12 Information Processing Program 13. Storage 14 Display 15 Input Devices 16 memory 17 Network I / F 18 Bus 20. Imaging control unit 21 Camera control unit 22 Feature point detection unit 22A detection model 23 Shooting range identification unit 24 Display control unit 31 Scanogram start line 32 Scanogram End Line 33 Midline 34A, 34B lines 35 lines 36 lines 37 Line H. Subject

Claims

1. at least one processor; The processor: The subject is placed in a supine position on a bed, and image information obtained by optically photographing the subject is continuously acquired. When a difference between a position of a first line corresponding to a position of a predetermined part of the subject in an image represented by the current image information and a position of a second line corresponding to the position of the predetermined part of the subject in an image represented by the most recent image information exceeds a predetermined threshold, control is performed to display the first line. Information processing device.

2. The processor: When the difference is equal to or smaller than the threshold value, control is performed to display the second line. The information processing device according to claim 1 .

3. the position of the second line is a position obtained by a moving average using images indicated by a plurality of pieces of image information from the most recent past; 3. The information processing device according to claim 1.

4. the position of the second line is a position obtained by an image indicated by the most recent past single image information; 3. The information processing device according to claim 1.

5. The processor: When the bed is movable in the vertical direction and an imaging device that performs the optical imaging is fixed above the bed, control is performed using the difference when the distance between the bed and the imaging device changes beyond a predetermined distance as the bed moves. The information processing device according to claim 1 .

6. The processor: The threshold value is changed according to the distance. The information processing device according to claim 5 .

7. The information processing device according to claim 1 ; a radiographic imaging device controlled by the information processing device; 1. A medical imaging device comprising:

8. The computer The subject is placed in a supine position on a bed, and image information obtained by optically photographing the subject is continuously acquired. When a difference between a position of a first line corresponding to a position of a predetermined part of the subject in an image represented by the current image information and a position of a second line corresponding to the position of the predetermined part of the subject in an image represented by the most recent image information exceeds a predetermined threshold, control is performed to display the first line. Information processing methods.

9. The subject is placed in a supine position on a bed, and image information obtained by optically photographing the subject is continuously acquired. When a difference between a position of a first line corresponding to a position of a predetermined part of the subject in an image represented by the current image information and a position of a second line corresponding to the position of the predetermined part of the subject in an image represented by the most recent image information exceeds a predetermined threshold, control is performed to display the first line. A program that causes a computer to perform a process.

Images