Information processing device, medical image capturing device, information processing method, and computer program product

Abstract

The invention provides an information processing device, a medical imaging device, an information processing method, and a computer program product which can suppress display shake caused by display of a line representing an imaging range of positioning scanning imaging, compared with the prior art. An information processing device (10) is provided with: a display control unit (24) that continuously acquires image information obtained by optical imaging of a subject in a lying position on a bed body; when the difference between the position of a first line corresponding to the position of a preset part of the subject in the image displayed by the current image information and the position of a second line corresponding to the position of the preset part of the subject in the image displayed by the latest past image information exceeds a preset threshold value, the control is performed to display the first line.

Description

Technical Field

[0001] The present invention relates to an information processing device, a medical image capturing device, an information processing method, and a program. Background Art

[0002] In recent years, due to the development of medical devices such as CT (Computed Tomography) devices and MRI (Magnetic Resonance Imaging) devices, higher-quality high-resolution three-dimensional images have been used in image diagnosis.

[0003] When a subject is photographed using a photographing device such as a CT device or an MRI device, in order to determine the photographing range, a scout image is photographed (hereinafter referred to as "scout image photographing") before the official photographing for obtaining a three-dimensional image, and a two-dimensional positioning image (scout image) is obtained. While observing the scout image, an operator (technician, etc.) of the photographing device sets the photographing range at the time of official photographing. In addition, the scout image is also referred to as a scout image, a topogram, etc., but hereinafter it is referred to as a "scout image".

[0004] Before performing scout image photographing, the operator sets the photographing range of the scout image photographing of the subject on the bed. For example, a cross-shaped laser is irradiated on the subject, the scout image start position of the scout image photographing is set, and the scout image end position of the scout image photographing is set so as to be a photographing range corresponding to the photographing part. When performing scout image photographing, scout image photographing starts when the bed moves from the bed initial position to the scout image start position, and scout image photographing ends when the bed moves to the scout image end position. After the operator sets the photographing range of the official photographing using the scout image obtained by scout image photographing, the official photographing is performed to obtain a three-dimensional image.

[0005] Here, when setting the photographing range at the time of scout image photographing, the subject is photographed by a camera provided above the bed, feature points such as both ankles, both waists, both elbows, and both shoulders of the subject are detected, and the photographing range is determined based on the detected feature points. At this time, in the detection of the feature points, a learned detection model constructed by machine learning of a neural network is used.

[0006] As a technique related to photographing using the medical photographing device as described above, a medical image diagnosis device aimed at making the setting of the imaging cross-section position and the imaging range more efficient than in the past is disclosed in Patent Document 1.

[0007] The medical image diagnosis apparatus includes: a gantry apparatus having an imaging system that images a subject using radiation or magnetism; and an image generation unit that generates a second image obtained by synthesizing a first image captured of the subject by an optical imaging device different from the imaging system and a plane related to the imaging position in the imaging using the imaging system.

[0008] Patent Document 1: Japanese Unexamined Patent Application Publication No. 2021-062126

[0009] Conventionally, there has been the following technique: When performing positioning scan image photography, the photography range of the positioning scan image photography is determined based on the position of the subject image obtained by optically photographing a subject in a lying position on a bed, and a line representing the photography range is superimposed on the subject image, a schema, etc. and displayed in real time. By referring to this display, an operator can confirm the photography range of the positioning scan image photography in a state of following the movement of the subject before performing the positioning scan image photography.

[0010] However, in this technique, since the line representing the photography range is superimposed and displayed on other images in real time, there is a problem that jitter (hereinafter referred to as "display jitter") is likely to occur in the displayed image. In addition, the display jitter is not considered in the technique disclosed in Patent Document 1, and this problem cannot be solved. Summary of the Invention

[0011] The present invention has been made in view of the above circumstances, and an object thereof is to provide an information processing apparatus, a medical image photography apparatus, an information processing method, and a program that can suppress display jitter caused by the display of a line representing the photography range of positioning scan image photography more than conventional techniques.

[0012] To achieve the above object, the information processing apparatus according to the first aspect of the present invention includes at least one processor, and the processor performs the following processing: continuously acquiring image information obtained by optically photographing a subject in a lying position on a bed; and controlling the display of the first line when a difference between the position of a first line corresponding to the position of a preset part of the subject in the image displayed by the image information at the current time point and the position of a second line corresponding to the position of the preset part of the subject in the image displayed by the nearest past image information exceeds a preset threshold.

[0013] In the information processing apparatus according to the second aspect of the present invention, in the information processing apparatus according to the first aspect, the processor controls the display of the second line when the difference is equal to or less than the threshold.

[0014] In the information processing apparatus according to the third aspect of the present invention, in the information processing apparatus according to the first aspect or the second aspect, the position of the second line is a position obtained by using a moving average of images displayed by a plurality of pieces of image information of the most recent past.

[0015] In the information processing apparatus according to the fourth aspect of the present invention, in the information processing apparatus according to the first aspect or the second aspect, the position of the second line is a position obtained from the image displayed by a single piece of image information of the most recent past.

[0016] In the information processing apparatus according to the fifth aspect of the present invention, in the information processing apparatus according to the first aspect, the processor performs the following processing: when the bed body is movable in the vertical direction and a photographic apparatus for optical photography is fixed above the bed body, control using a difference value is performed when the distance between the bed body and the photographic apparatus changes and exceeds a preset distance as the bed body moves.

[0017] In the information processing apparatus according to the sixth aspect of the present invention, in the information processing apparatus according to the fifth aspect, the processor is based on a distance change threshold.

[0018] On the other hand, in order to achieve the above object, the medical image photographing apparatus according to the seventh aspect of the present invention includes the information processing apparatus of the present invention and a radiation image photographing apparatus controlled by the information processing apparatus.

[0019] Moreover, in order to achieve the above object, in the information processing method according to the eighth aspect of the present invention, a computer performs the following processing: continuously acquiring image information obtained by optically photographing a subject lying on a bed; and controlling to display the first line when a difference between a position of a first line corresponding to a position of a preset part of the subject in the image displayed by the image information at the current time point and a position of a second line corresponding to the position of the preset part of the subject in the image displayed by the most recent past image information exceeds a preset threshold.

[0020] Furthermore, in order to achieve the above object, the program according to the ninth aspect of the present invention causes a computer to execute the following processing: continuously acquiring image information obtained by optically photographing a subject lying on a bed, and controlling to display the first line when a difference between a position of a first line corresponding to a position of a preset part of the subject in the image displayed by the image information at the current time point and a position of a second line corresponding to the position of the preset part of the subject in the image displayed by the most recent past image information exceeds a preset threshold.

[0021] Advantageous Effects of the Invention

[0022] According to the present invention, it is possible to more effectively suppress display jitter caused by the display of a line indicating the photographing range of a positioning scan image than in the prior art. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 It is a perspective view showing the outline of a CT apparatus to which the information processing apparatus according to the embodiment is applied.

[0024] Figure 2 It is a view of the CT apparatus to which the information processing apparatus according to the embodiment is applied, observed from the side.

[0025] Figure 3 It is a block diagram showing the schematic structure of the information processing apparatus according to the embodiment.

[0026] Figure 4 It is a block diagram showing the functional structure of the information processing apparatus according to the embodiment.

[0027] Figure 5 It is a view for explaining the characteristic points according to the embodiment.

[0028] Figure 6 It is a view showing an example of the line display screen according to the embodiment.

[0029] Figure 7 It is a flowchart showing an example of the information processing flow according to the first embodiment.

[0030] Figure 8 It is a view for explaining the processing according to the second embodiment, and is a side view showing an example of the state when the bed moves up and down.

[0031] Figure 9 It is a view for explaining the processing according to the second embodiment, and is a view showing an example of the state of the line display screen when the bed moves up and down.

[0032] Figure 10 It is a flowchart showing an example of the information processing flow according to the second embodiment.

[0033] Figure 11 It is a flowchart showing an example of the second information processing flow according to the second embodiment.

[0034] Figure 12 It is a flowchart showing an example of the third information processing flow according to the second embodiment.

[0035] Figure 13 It is a view showing an example of the line display screen according to other embodiments.

[0036] Figure 14 It is a view showing an example of the line display screen according to other embodiments.

[0037] Symbol Explanation

[0038] 1-CT apparatus, 2-gantry, 2A-display device, 2B-operation button, 3-bed, 3A-bed plate part, 3B-bed base part, 3C-drive part, 4-control console, 5-opening, 7-camera, 10-information processing device, 11-CPU, 12-information processing program, 13-memory, 14-display, 15-input device, 16-memory, 17-network I / F, 18-bus, 20-photography control part, 21-camera control part, 22-feature point detection part, 22A-detection model, 23-photography range determination part, 24-display control part, 31-positioning scan image start line, 32-positioning scan image end line, 33-median line, 34A, 34B-lines, 35-line, 36-line, 37-line, H-subject. Detailed implementation mode

[0039] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0040] [First Embodiment]

[0041] Figure 1 is a perspective view showing an outline of a CT apparatus to which the information processing device according to the embodiment of the present invention is applied, Figure 2 is a view of the CT apparatus to which the information processing device according to the embodiment of the present invention is applied as viewed from the side.

[0042] As Figure 1 and Figure 2 shown, the CT apparatus 1 according to the present embodiment includes a gantry 2, a bed 3, and a control console 4. In addition, the combination of the gantry 2 and the bed 3 corresponds to the radiation image photographing apparatus of the present invention, and the combination of the gantry 2, the bed 3, and the control console 4 corresponds to the medical image photographing apparatus of the present invention.

[0043] The gantry 2 has a tunnel-shaped structure with an opening 5 in the center thereof. Inside the gantry 2, an X-ray source unit that emits X-rays and a detection unit that detects X-rays to generate a radiation image are provided (both not shown). The X-ray source unit and the detection unit can rotate along the annular shape of the gantry 2 while maintaining their opposed positional relationship. And, a control unit for controlling the operation of the CT apparatus 1 is provided inside the gantry 2.

[0044] And, a display device 2A is provided at the center of the upper part on the front side (the side where the bed 3 is arranged) of the gantry 2, and an operation button 2B is provided on the left side of the front view on this front side. The display device 2A according to the present embodiment can display the detailed content of various information including a line display screen described later under the control of the control console 4. And, the operation button 2B according to the present embodiment is a button that is pressed by the operator when positioning of the subject with respect to the bed 3 is completed and a positioning scan image for obtaining a two-dimensional image is photographed or a formal photograph for obtaining a three-dimensional image is taken.

[0045] On the other hand, the bed body 3 has a bed board portion 3A for the subject to lie on, a bed base portion 3B that supports the bed board portion 3A, and a drive portion 3C that reciprocally moves the bed board portion 3A in the direction of arrow A. The bed board portion 3A can slide relative to the bed base portion 3B in the direction of arrow A through the drive portion 3C. When taking a CT image, the subject H lying on the bed board portion 3A is carried into the opening 5 of the gantry 2 by the sliding of the bed board portion 3A.

[0046] In addition, a camera 7 is provided above the bed body 3. The camera 7 is a camera that can capture R (red) G (green) B (blue) color images by detecting the reflected light of the subject H. The camera 7 has imaging elements such as a lens and a CCD (Charge Coupled Device), and acquires a camera image as a moving image by capturing the subject H on the bed body 3 at a preset frame rate and outputs it to the console 4. In addition, the camera 7 can be a camera that integrates an RGB camera and an NIR (Near InfraRed) camera. At this time, the NIR camera is a stereo camera, and the depth direction information of the subject H can be obtained through parallax. By setting the NIR camera of the camera 7 as a stereo camera, the depth direction information of the subject H on the bed body 3 can be obtained. In addition, the NIR camera can take pictures even when the light amount is insufficient. Therefore, when the brightness in the examination room is insufficient for taking pictures with the RGB camera, the subject H can be photographed with the NIR camera.

[0047] The photography of the subject through the drive of the gantry 2, the drive of the bed body 3, and the camera 7 is performed by the input of the operator from the console 4. The console 4 incorporates the information processing device according to the present embodiment.

[0048] Next, the information processing device according to the present embodiment incorporated in the console 4 will be described. First, refer to Figure 3 to describe the hardware structure of the information processing device according to the present embodiment.

[0049] As Figure 3As shown, the information processing apparatus 10 is a computer such as a workstation, a server computer, or a personal computer, and includes a CPU (Central Processing Unit) 11, a non-volatile memory 13, and a memory 16 as a temporary storage area. Further, the information processing apparatus 10 includes a display 14 such as a liquid crystal display, an input device 15 such as a keyboard and a mouse, and a network I / F (InterFace) 17 connected to the CT apparatus 1. The CPU 11, the memory 13, the display 14, the input device 15, the memory 16, and the network I / F 17 are connected to a bus 18. Additionally, the CPU 11 is an example of the processor in the present invention. The display 14 and the input device 15 are also illustrated in Figure 1 and Figure 2 .

[0050] The memory 13 is implemented by an HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, or the like. An information processing program 12 installed in the information processing apparatus 10 is stored in the memory 13 as a storage medium. The CPU 11 reads the information processing program 12 from the memory 13, expands it in the memory 16, and executes the expanded information processing program 12. The method of the processing executed by the information processing program 12 corresponds to the information processing method of the present invention.

[0051] Alternatively, the information processing program 12 is stored in a storage device or a network storage of a server computer connected to the network in a state accessible from the outside, and is downloaded and installed into the computer constituting the information processing apparatus 10 according to a request. Or, it is recorded on a recording medium such as a DVD (Digital Versatile Disc) or a CD-ROM (Compact Disc Read Only Memory), distributed, and installed into the computer constituting the information processing apparatus 10 from the recording medium.

[0052] Next, the functional structure of the information processing apparatus according to the present embodiment will be described. Figure 4 FIG. is a diagram showing the functional structure of the information processing apparatus according to the present embodiment.

[0053] As Figure 4 shown, the information processing apparatus 10 includes a photographing control unit 20, a camera control unit 21, a feature point detection unit 22, a photographing range determination unit 23, and a display control unit 24. Further, the CPU 11 functions as the photographing control unit 20, the camera control unit 21, the feature point detection unit 22, the photographing range determination unit 23, and the display control unit 24 by executing the information processing program 12.

[0054] The imaging control unit 20 controls the imaging unit, the detection unit, and the control unit provided on the gantry 2 according to an instruction from the input device 15 to perform imaging of the subject H. In addition, when performing CT imaging, in order to determine the imaging range, a scout scan image is taken before the official imaging for obtaining a three-dimensional CT image. The scout scan image is taken by imaging the subject H with the imaging unit and the detection unit fixed.

[0055] When performing the scout scan imaging, the imaging range of the subject H is set, and the table 3 is moved to the opening 5 of the gantry 2 to perform the scout scan imaging to image the set imaging range. The scout scan image obtained through the scout scan imaging is a two-dimensional image including the imaging range set for the subject H. The scout scan image is displayed on the display 14. The operator observes the scout scan image displayed on the display 14 and sets the imaging range for the official imaging. After setting the imaging range, the operator gives an instruction for the official imaging by pressing the operation button 2B, thereby performing the official imaging and obtaining a three-dimensional CT image of the subject H. The obtained scout scan image and CT image are stored in the memory 13.

[0056] The camera control unit 21 controls the imaging of the subject H on the table 3 by the camera 7. The imaging of the subject H by the camera 7 is performed to set the imaging range for the scout scan imaging. The imaging of the subject H by the camera 7 starts from the preparation stage before imaging. That is, the camera control unit 21 starts the imaging by the camera 7 from the time point before the subject H lies on the table 3 and causes the camera 7 to obtain a camera image. Moreover, when the operator gives an instruction to start the scout scan imaging, the camera control unit 21 stops the imaging by the camera 7. The obtained camera image is stored in the memory 16 to determine the imaging range described later.

[0057] The feature point detection unit 22 uses a pre-constructed detection model 22A to detect a plurality of feature points on the subject H included in the camera image. Figure 5 This is a diagram for explaining the feature points according to the present embodiment. As Figure 5 shown, in the present embodiment, the detection model 22A is constructed to detect 17 feature points on the subject H included in the camera image. The 17 feature points are the two eyes, the nose, the two ears, the two shoulders, the two elbows, the two hands, the two waists, the two knees, and the two feet. In addition, the midpoint of the collarbone can be added to these 17 feature points to use 18 feature points.

[0058] The detection model 22A according to this embodiment is constructed by performing machine learning on a neural network. In this neural network, training images that include the entire human body and for which 17 feature points are known, obtained by photographing a human body with the camera 7, are used for learning. In addition, in the same manner as in the case of an actual examination, the training images are obtained, for example, by photographing a person wearing an examination gown with the camera 7.

[0059] The detection model 22A according to this embodiment derives, for each pixel in the camera image, a probability indicating the likelihood of each of the 17 feature points. Moreover, the feature point detection unit 22 detects, for each of the 17 feature points, the pixel for which the highest probability has been derived as the feature point. For example, when detecting the right eye as a feature point, the feature point detection unit 22 compares the probabilities for all pixels in the camera image derived by the detection model 22A for the right eye, and detects the pixel that becomes the maximum probability as the feature point of the right eye.

[0060] The imaging range determination unit 23 determines the imaging range of the subject H during the positioning scan imaging based on the 17 feature points detected by the feature point detection unit 22. Therefore, the imaging range determination unit 23 first determines the detection accuracy of the feature points detected by the feature point detection unit 22. As described above, the feature point detection unit 22 detects, for each of the 17 feature points, the pixel for which the highest probability has been derived as the feature point. The higher the probability output by the detection model 22A for the detected feature points, the better the detection accuracy. Therefore, the imaging range determination unit 23 compares the representative value of the probabilities derived by the detection model 22A for the 17 feature points with a preset threshold value, and determines that the detection accuracy is good when the representative value is equal to or greater than the threshold value, and determines that the detection accuracy is poor when the representative value is less than the threshold value. As the representative value, an average value, a median value, a weighted average value corresponding to the imaging part, etc. can be used, but it is not limited to these.

[0061] The imaging range determination unit 23 performs processing to determine the imaging range when it determines that the detection accuracy is good. On the other hand, when it determines that the detection accuracy is poor, the imaging range determination unit 23 performs a warning display on the display 14. Here, when the movement of the subject H is too large, or the subject H is covered with a thick blanket, or the entire body of the subject H is not included in the imaging range of the camera 7, even if the detection model 22A is used, the feature points cannot be detected with high accuracy, and the detection accuracy deteriorates. At this time, the imaging range determination unit 23 determines that the detection accuracy is poor.

[0062] In addition, when a warning is displayed, the operator manually sets the imaging range for the positioning scan image photography. That is, the operator measures the distance from the initial position of the bed to the start line of the positioning scan image described later, further measures the distance between the start line of the positioning scan image and the end line of the positioning scan image described later, and inputs the measured distances from the input device 15. Based on the input distances, the movement of the bed 3 during the positioning scan image photography is controlled.

[0063] The imaging part of the subject H is included in the examination order provided by the doctor during the shooting. The operator refers to the examination order and uses the input device 15 to set the imaging part. In addition, the imaging parts of the subject H include the head, chest, abdomen, lower limbs, and the whole body, etc.

[0064] Hereinafter, the process of determining the imaging range by the imaging range determination unit 23 will be described. For example, when the imaging part is the chest, the positioning scan image sets the range from the tip of the mandible to the middle part of the abdomen as the imaging range. Therefore, among the feature points detected by the feature point detection unit 22, the imaging range determination unit 23 sets the line connecting the two shoulders as the start line of the positioning scan image, and sets the central line of the line connecting the two elbows and the line connecting the two hands as the end line of the positioning scan image. Moreover, the imaging range determination unit 23 derives the distance D1 between the start line of the positioning scan image and the end line of the positioning scan image. The range of the distance D1 between the start line of the positioning scan image and the end line of the positioning scan image becomes the imaging range.

[0065] Here, before the positioning scan image photography, the bed 3 is at the initial position and the subject H lies on the bed 3. Therefore, the distance from the end of the bed 3 to the start line of the positioning scan image can be known from the camera image. Therefore, the imaging range determination unit 23 calculates the distance D2 from the end of the bed 3 to the start line of the positioning scan image as the movement amount of the bed from the initial position to the start line of the positioning scan image, that is, the movement amount of the bed 3 until the start position of the positioning scan image in the CT device 1 is reached.

[0066] When the imaging range determination unit 23 determines the imaging range in the positioning scan image photography, the display control unit 24 performs control to display in real time on the display device 2A an image obtained by overlapping the start line and end line of the positioning scan image and the midline connecting the midpoints of the start line and end line of the positioning scan image on the camera image. Hereinafter, the screen displayed on the display device 2A at this time is called the "line display screen".

[0067] Figure 6 It is a diagram showing an example of the line display screen according to the embodiment. As Figure 6As shown, in the line display screen related to this embodiment, the positioning scan image start line 31, the positioning scan image end line 32, and the center line 33 are shown together with the image of the subject H (hereinafter referred to as the "subject image") 30. The operator confirms the positioning scan image start line 31, the positioning scan image end line 32, and the center line 33 displayed on the display device 2A. When there is no problem after confirmation, the operator gives an instruction to start the positioning scan image photography by pressing the operation button 2B.

[0068] By the instruction to start the positioning scan image photography, the information of the distances D1 and D2 is output to the CT device 1. The photography control unit 20 controls the CT device 1 to start the positioning scan image photography after the drive unit 3C moves the bed 3 by the distance D2 and end the positioning scan image photography when the drive unit 3C moves the bed 3 by the distance D1.

[0069] The positioning scan image obtained by the positioning scan image photography is displayed on the display 14. The operator confirms the positioning scan image displayed on the display 14 and sets the photography range for the formal photography. Then, by pressing the operation button 2B, a photography instruction for the formal photography is given, thereby performing the formal photography, and within the set photography range of the formal photography, a three-dimensional CT image of the photographed part of the subject H is obtained.

[0070] Thus, in the positioning scan image photography related to this embodiment, before performing this photography, the line display screen is displayed in real time, but at this time, each line indicating the photography range is overlapped and displayed with the camera image in real time in units of photography frames. Therefore, there is a problem that display jitter is likely to occur in the line display screen displayed on the display device 2A.

[0071] Therefore, the display control unit 24 related to this embodiment controls the display of the first line when the difference D between the position of the first line corresponding to the position of the preset part of the subject H in the camera image displayed by the image information of the current time point in the image information representing the camera image obtained by the camera 7 and the position of the second line corresponding to the position of the above-mentioned preset part of the subject H in the image displayed by the image information of the most recent past (in this embodiment, one frame before the current time point) exceeds the preset threshold. In contrast, the display control unit 24 related to this embodiment controls the display of the second line when the difference D is below the above threshold.

[0072] In this embodiment, as the first line and the second line, each line of the above-mentioned positioning scan image start line 31, the positioning scan image end line 32, and the center line 33 (hereinafter also simply referred to as "line") is applied. Here, the difference between the first line and the second line is that the first line represents the line at the current time point, and the second line represents the line of the most recent past.

[0073] That is, in the display control unit 24 according to the present embodiment, the offset amount between the position of the line indicating the imaging range of the positioning scan image at the current time point and the position of the line indicating the imaging range of the positioning scan image in the most recent past is derived as the difference D. Further, when the derived difference D is equal to or greater than the above threshold value, the display control unit 24 performs control to display the line at the current time point, which is the latest line, instead of the line up to now on the line display screen.

[0074] On the other hand, when the derived difference D is less than the above threshold value, the display control unit 24 performs control to display the line in the most recent past, which is the line displayed up to now, on the line display screen. Therefore, according to the display control unit 24 according to the present embodiment, when the difference D, that is, the deviation amount of the imaging range of the positioning scan image from the most recent past is small, the line displayed on the line display screen is not changed. Therefore, it is possible to suppress the occurrence of display jitter on the above line display screen. In addition, in the display of the line in the most recent past performed here, it is not necessary to display this line again. In the line display screen, when the display state of the line displayed up to now is maintained so as to be visually recognizable, it is not necessary to perform control to display this line again.

[0075] In addition, in the present embodiment, the maximum distance among the distances between the positioning scan image start lines 31 of the first line and the second line, the distances between the positioning scan image end lines 32, and the distances between the center lines 33 is applied as the difference D, but it is not limited thereto. For example, it may be configured to apply the minimum distance or the intermediate distance among the distances between the positioning scan image start lines 31 of the first line and the second line, the distances between the positioning scan image end lines 32, and the distances between the center lines 33 as the difference D. Further, in the present embodiment, the distance between the midpoints of the corresponding lines is applied as the distance between the corresponding lines here, but it is not limited thereto. For example, it may be configured to apply the maximum distance between the corresponding lines as the distance between the corresponding lines.

[0076] Further, in the present embodiment, as the above threshold value, a fixed value is applied as a value at which a failure occurs when the display of the imaging range of the positioning scan image in the line display screen is not updated when the difference D exceeds this value, but it is not limited thereto. For example, it may be configured such that the operator appropriately sets the above threshold value according to the accuracy required for the positioning scan image imaging, the behavior of the subject H, and the like.

[0077] In addition, in the present embodiment, the position obtained from the image displayed by the single image information in the most recent past is applied as the position of the second line. As a result, compared with the case where the position obtained from the moving average of the images displayed by using a plurality of pieces of image information in the most recent past is applied as the position of the second line, the processing time can be further shortened and the storage capacity for storing the image information can be further reduced.

[0078] Next, the information processing performed in the first embodiment will be described. Figure 7 It is a flowchart showing the process of the information processing performed in the first embodiment. The information processing starts with an instruction to start photographing from the input device 15.

[0079] In step S100, the CPU 11 controls the camera 7 to start shooting. In step S102, the CPU 11 acquires one frame of camera image. In step S104, the CPU 11 detects feature points from the camera image using the detection model 22A.

[0080] In step S106, the CPU 11 determines whether the detection accuracy of the feature points is good. When the determination is negative, it moves to step S108, where the CPU 11 performs a warning display and then moves to step S122. As described above, when a warning display is performed, the operator manually sets the shooting range for the positioning scan image photography.

[0081] On the other hand, when the determination in step S106 is affirmative, it moves to step S110, where the CPU 11 determines the shooting range in the positioning scan image photography and stores it in the memory 16. In step S112, the CPU 11 determines whether this storage is a storage after the second time. When the determination is negative, it moves to step S118, and when the determination is affirmative, it moves to step S114.

[0082] In step S114, the CPU 11 derives the above-mentioned difference D. In step S116, the CPU 11 determines whether the difference D exceeds the threshold TH. When the determination is negative, it moves to step S120, and when the determination is affirmative, it moves to step S118.

[0083] In step S118, the CPU 11 controls the display device 2A to display a line display screen showing the shooting range determined by the processing in the most recent step S110.

[0084] In step S120, the CPU 11 determines whether the operator has instructed to perform the positioning scan image photography by determining whether a pressing operation has been performed on the operation button 2B. When the determination is negative, it returns to step S102, and when the determination is affirmative, it moves to step S122.

[0085] In step S122, after stopping the shooting by the camera 7, the CPU 11 ends this information processing.

[0086] Thus, in the information processing according to this embodiment, when the difference D is equal to or less than the threshold value TH, the update of the line display screen is not performed, but it is not limited to this. As described above, when the difference D is equal to or less than the threshold value TH, it may be a method of updating the line display screen using the imaging range stored one time before the processing in the most recent step S110.

[0087] Then, the positioning scan image is acquired by the positioning scan imaging performed by the imaging control unit 20 and displayed on the display 14. After the operator confirms the positioning scan image, the imaging range for the formal imaging is set. Further, the operator gives an instruction for the formal imaging by pressing the operation button 2B, whereby the formal imaging is performed to acquire the three-dimensional CT image of the subject H.

[0088] As described above, according to the information processing apparatus 10 according to this embodiment, the following processing is performed: continuously acquiring the image information obtained by optically imaging the subject lying in the lying position on the bed; and controlling the display of the first line when the difference between the position of the first line corresponding to the position of the preset part of the subject in the image displayed by the image information at the current time point and the position of the second line corresponding to the position of the preset part of the subject in the image displayed by the most recent past image information exceeds the preset threshold value. Therefore, the update frequency of the line can be reduced, and as a result, the display jitter caused by the display of the line indicating the imaging range of the positioning scan image can be suppressed more than in the conventional technology.

[0089] [Second Embodiment]

[0090] In this second embodiment, a mode example will be described in which the position obtained by using the moving average of the images displayed by a plurality of most recent past image information is applied as the position of the second line and the bed board part 3A of the bed 3 is configured to be movable in the vertical direction while coping with the accidental movement of the subject H.

[0091] That is, the bed 3 according to this embodiment can move the bed board part 3A in the vertical direction under the control of the information processing apparatus 10. However, it is not limited to this mode, and it may be set to be able to move the bed board part 3A in the vertical direction by the manual operation of the operator.

[0092] The structure of the information processing apparatus 10 according to this embodiment is substantially the same as the structure according to the first embodiment, except for some processing based on the display control unit 24.

[0093] The display control unit 24 according to this embodiment uses the position obtained by the moving average of the images displayed using a plurality of pieces of image information of the most recent past as the position of the second line. Here, any number can be applied as the number of objects for the moving average, but in this embodiment, the number of 10 frames in the camera image is applied. Thus, in this embodiment, a fixed number is applied as the number of objects for the moving average, but it is not limited thereto. For example, it may be configured such that the operator appropriately sets the number of objects for the moving average by input according to the imaging conditions of the positioning scan image or the operator's own preferences, etc.

[0094] In addition, in order to cope with an unexpected movement of the subject H, the display control unit 24 according to this embodiment performs a process of executing control using the difference D (hereinafter, referred to as "second information process") when the subject H moves more than a preset movement amount.

[0095] On the other hand, in this embodiment, since the bed board portion 3A of the bed body 3 can move in the vertical direction, as Figure 8 shown in an example, the distance d between the camera 7 and the bed board portion 3A of the bed body 3 may change. At this time, as Figure 9 shown in an example, the subject image 30 included in the camera image captured by the camera 7 becomes larger as the height of the bed board portion 3A of the bed body 3 becomes higher. In addition, in Figure 9 the example shown, the left figure is an example of the camera image when the height of the bed board portion 3A in Figure 8 is the height H1, and the right figure is an example of the camera image when the height of the bed board portion 3A in Figure 8 is the height H2. Therefore, the distance per pixel of the camera image also changes, and thus the higher the height of the bed board portion 3A, the more likely the difference D is to exceed the threshold TH.

[0096] Therefore, in the display control unit 24 according to this embodiment, a process of executing control using the above-described difference D (hereinafter, referred to as "third information process") is performed when the distance between the bed board portion 3A and the camera 7 changes beyond a preset distance as the bed board portion 3A of the bed body 3 moves. And, as described above, when executing this third information process, the difference D is likely to exceed the threshold TH, so the threshold TH is changed according to the distance d.

[0097] Next, with reference to Figure 10 , the operation of the information processing apparatus 10 according to this embodiment when executing the information process will be described. Figure 10 is a flowchart showing the flow of the information process performed in this embodiment, and the steps performing the same process as the information process shown in Figure 7 are labeled with the same step numbers as Figure 7 , and the description thereof is omitted.

[0098] exist Figure 10 In step S112B, the CPU 11 determines whether the photographic range stored based on the processing of step S110 is stored for the N+1th or later time. If the determination is negative, the process proceeds to step S118. On the other hand, if the determination is positive, the process proceeds to step S114B.

[0099] In step S114B, the CPU 11 derives the difference between the position of the second line and the position of the first line obtained by the above-mentioned moving average as a difference D.

[0100] In step S119 , the CPU 11 applies the position of the second line derived along with the derivation of the difference value D in the process of the immediately preceding step S114B as the position of each line indicating the imaging range, and controls the display device 2A to display the line display screen.

[0101] Next, refer to Figure 11 , the function of the information processing device 10 according to this embodiment when executing the second information processing will be described. Figure 11 This is a flowchart showing the flow of the second information processing performed in this embodiment. Figure 10 The information shown is processed in the same steps as the Figure 10 The same step numbers are used and their descriptions are omitted. The second information processing according to this embodiment is executed every predetermined time (0.1 seconds in this embodiment).

[0102] like Figure 11 As shown, the second information processing according to the present embodiment is the same as the information processing according to the present embodiment in terms of the processing of steps S102 to S119 , and differs only in that the processing of step S100A is added.

[0103] That is, in Figure 11 In step S100A, CPU 11 determines whether it has detected movement of subject H exceeding a preset movement threshold. If the determination is negative, CPU 11 terminates the second information processing. If the determination is positive, CPU 11 proceeds to step S102. In this embodiment, the determination of whether subject H has moved exceeding the preset movement threshold is performed by determining whether the two-dimensional movement of feature points detected by feature point detection unit 22 between temporally adjacent frames in the camera image exceeds a preset amount. However, the present invention is not limited to this embodiment.

[0104] This second information processing allows for handling even when the subject H makes unexpected movements.

[0105] Next, refer to Figure 12 , the function of the information processing device 10 according to this embodiment when executing the third information processing will be described.Figure 12 is a flowchart showing the process of the third information processing performed in the present embodiment. Steps that perform the same processing as the information processing shown in Figure 10 are marked with the same step numbers as Figure 10 and their descriptions are omitted. The third information processing according to the present embodiment is also executed at preset time intervals (0.1 second in the present embodiment).

[0106] As Figure 12 shown, compared with the information processing according to the present embodiment, the third information processing according to the present embodiment differs only in that the processing of steps S102 to S119 other than step S116 is the same, while step S116 becomes step S116B and the processing of step S100B is added.

[0107] That is, in Figure 12 step S100B of, the CPU 11 determines whether the movement of the height of the bed plate portion 3A of the bed body 3 has exceeded a preset distance. When the determination is negative, this third information processing ends. On the other hand, when the determination is positive, the process proceeds to step S102.

[0108] Moreover, in step S116B, the CPU 11 applies a preset threshold value as the threshold value TH based on the height of the bed plate portion 3A of the bed body 3, and determines whether the difference value D exceeds the threshold value TH. When the determination is negative, the process proceeds to step S119. On the other hand, when the determination is positive, the process proceeds to step S118.

[0109] Through this third information processing, it is possible to accurately respond even when the height of the bed plate portion 3A of the bed body 3 changes.

[0110] As described above, according to the information processing apparatus 10 according to the present embodiment, the position obtained by using the moving average of the images displayed by using a plurality of pieces of image information of the recent past is applied as the position of the second line. Therefore, it is possible to cope with the unevenness of the camera images between frames. As a result, it is possible to more effectively suppress the display jitter caused by the display of the line indicating the imaging range of the positioning scan image.

[0111] In addition, according to the information processing apparatus 10 according to the present embodiment, the following processing is performed: when the bed plate portion 3A of the bed body 3 can move in the vertical direction and the camera 7 is fixed above the bed body 3, control using the difference value D is performed when the distance between the bed plate portion 3A and the camera 7 changes and exceeds a preset distance as the bed plate portion 3A moves. Therefore, it is possible to more accurately suppress the above display jitter even when the bed plate portion 3A moves in the vertical direction.

[0112] Moreover, according to the information processing apparatus 10 according to the present embodiment, the threshold value TH is changed according to the distance d. Therefore, even when the bed plate portion 3A moves in the vertical direction, the above-described display jitter can be more accurately suppressed.

[0113] In addition, the line display screen applicable to each of the above embodiments is an example and is not limited to the illustrated example. For example, as an example, as Figure 13 shown, it may be set to a mode in which lines 34A and 34B indicating the range in the left-right direction within the imaging range of the positioning scan image are also displayed on the line display screen.

[0114] Moreover, in each of the above embodiments, the case where the imaging range when the subject H is viewed from above is applied as the imaging range of the positioning scan image has been described, but it is not limited thereto. For example, it may be set to a mode in which the imaging range when the subject H is viewed from the side is applied as the imaging range of the positioning scan image. In this mode, the camera 7 is also provided on the side of the subject H, or a camera including the above-described NIR camera is applied as the camera 7.

[0115] In Figure 14 an example of the line display screen in this mode is shown. In addition, in Figure 14 the positioning scan image start line is line 35, the positioning scan image end line is line 36, and the center line is line 37.

[0116] Furthermore, the types of lines shown in the above example modes are not limited to the solid lines or dotted lines shown in the drawings, and other types such as single-dot dash lines and double-dot dash lines can be applied. Moreover, from the viewpoint of visual recognition ease, it may also be set to a mode in which the display state such as the color or thickness of the line, blinking display, or reverse display is changed for each use of each line.

[0117] Moreover, in each of the above embodiments, the CT apparatus is applied to the information processing apparatus based on the present invention, but it is not limited thereto. In the case of a imaging apparatus that acquires a positioning scan image for setting the imaging range before formal imaging, the information processing apparatus based on the present invention can be applied to an MRI apparatus or the like.

[0118] Moreover, in each of the above embodiments, the information processing apparatus includes the imaging control unit 20, but it is not limited thereto. The imaging control unit 20 may also be provided separately from the information processing apparatus.

[0119] Further, in the above-described embodiments, for example, as the hardware structure of processing units (Processing Unit) that execute various processes such as the photographing control unit 20, the camera control unit 21, the feature point detection unit 22, the photographing range determination unit 23, and the display control unit 24, various processors (Processor) shown below can be used. Among the above various processors, as described above, in addition to the general-purpose processor, i.e., the CPU, which executes software (program) and functions as various processing units, there are also processors such as FPGA (Field Programmable Gate Array) that can change the circuit structure after manufacturing, i.e., programmable logic devices (Programmable Logic Device: PLD), and processors such as ASIC (Application Specific Integrated Circuit) that have a circuit structure specifically designed to execute specific processes, i.e., dedicated circuits, etc.

[0120] One processing unit can be constituted by one of these various processors, or can be constituted by a combination of two or more processors of the same type or different types (for example, a combination of multiple FPGAs or a combination of a CPU and an FPGA). Also, multiple processing units can be constituted by one processor.

[0121] As an example of constituting multiple processing units by one processor, first, there is the following method: represented by computers such as a client and a server, one or more CPUs and software are combined to constitute one processor, and this processor functions as multiple processing units. Second, there is the following method: represented by a system on chip (SoC), etc., a processor that uses one IC (Integrated Circuit) chip to implement the functions of the entire system including multiple processing units is used. Thus, various processing units are configured with one or more of the above various processors as the hardware structure.

[0122] In addition, as the hardware structure of these various processors, more specifically, circuitry formed by combining circuit elements such as semiconductor elements can be used.

[0123] Based on the above description, the invention described in the following supplementary notes can be grasped.

[0124] [Supplementary Note 1]

[0125] An information processing apparatus, which includes at least one processor,

[0126] The processor performs the following processes:

[0127] Continuously obtain the image information obtained by optically photographing the subject lying in the lying position on the bed; and

[0128] When the difference between the position of the first line corresponding to the position of the preset part of the subject in the image shown by the image information at the current time point and the position of the second line corresponding to the position of the preset part of the subject in the image shown by the image information of the nearest past exceeds a preset threshold, perform the control of displaying the first line.

[0129] [Supplementary Note 2]

[0130] The information processing apparatus according to Supplementary Note 1, wherein,

[0131] When the difference is below the threshold, the processor performs the control of displaying the second line.

[0132] [Supplementary Note 3]

[0133] The information processing apparatus according to Supplementary Note 1 or 2, wherein,

[0134] The position of the second line is a position obtained by using the moving average of the images shown by a plurality of the image information of the nearest past.

[0135] [Supplementary Note 4]

[0136] The information processing apparatus according to Supplementary Note 1 or 2, wherein,

[0137] The position of the second line is a position obtained by the image shown by a single piece of the image information of the nearest past.

[0138] [Supplementary Note 5]

[0139] The information processing apparatus according to any one of Supplementary Notes 1 to 4, wherein,

[0140] The processor performs the following processing:

[0141] In the case where the bed can move in the up and down direction and the photographing device for performing the optical photographing is fixed above the bed, when the distance between the bed and the photographing device changes and exceeds a preset distance along with the movement of the bed, perform the control using the difference.

[0142] [Supplementary Note 6]

[0143] The information processing apparatus according to Supplementary Note 5, wherein,

[0144] The processor changes the threshold according to the distance.

[0145] [Supplementary Note 7]

[0146] A medical image photographing apparatus, comprising:

[0147] The information processing apparatus according to any one of Supplementary Notes 1 to 6; and

[0148] A radiation image photographing apparatus controlled by the information processing apparatus.

[0149] [Supplementary Note 8]

[0150] An information processing method, wherein

[0151] A computer performs the following processing:

[0152] Continuously acquire image information obtained by optically photographing a subject in a lying position on a bed; and

[0153] When the difference between the position of a first line corresponding to the position of a preset part of the subject in the image displayed by the image information at the current time point and the position of a second line corresponding to the position of the preset part of the subject in the image displayed by the image information of the nearest past exceeds a preset threshold value, perform control to display the first line.

[0154] [Supplementary Note 9]

[0155] A program that causes a computer to perform the following processing:

[0156] Continuously acquire image information obtained by optically photographing a subject in a lying position on a bed; and

[0157] When the difference between the position of a first line corresponding to the position of a preset part of the subject in the image displayed by the image information at the current time point and the position of a second line corresponding to the position of the preset part of the subject in the image displayed by the image information of the nearest past exceeds a preset threshold value, perform control to display the first line.

Claims

1. An information processing device, comprising a processor, wherein the processor performs the following processing: continuously acquiring image information obtained by optically photographing a subject in a lying position on a bed; and when a difference between a position of a first line corresponding to a position of a preset part of the subject in an image displayed by the image information at the current time point and a position of a second line corresponding to the position of the preset part of the subject in an image displayed by the image information of the nearest past exceeds a preset threshold, controlling to display the first line.

2. The information processing device according to claim 1, wherein when the difference is equal to or less than the threshold, the processor controls to display the second line.

3. The information processing device according to claim 1 or 2, wherein the position of the second line is a position obtained by using a moving average of images displayed by a plurality of the image information of the nearest past.

4. The information processing device according to claim 1 or 2, wherein the position of the second line is a position obtained by an image displayed by a single image information of the nearest past.

5. The information processing device according to claim 1, wherein the processor performs the following processing: when the bed can move in the vertical direction and a photographing device for performing the optical photographing is fixed above the bed, when the distance between the bed and the photographing device changes and exceeds a preset distance along with the movement of the bed, controlling to use the difference.

6. The information processing device according to claim 5, wherein the processor changes the threshold according to the distance.

7. A medical image photographing device, comprising: the information processing device according to claim 1; and a radiation image photographing device controlled by the information processing device.

8. An information processing method, wherein a computer performs the following processing: continuously acquiring image information obtained by optically photographing a subject in a lying position on a bed; and when a difference between a position of a first line corresponding to a position of a preset part of the subject in an image displayed by the image information at the current time point and a position of a second line corresponding to the position of the preset part of the subject in an image displayed by the image information of the nearest past exceeds a preset threshold, controlling to display the first line.

9. A computer program product, which causes a computer to perform the following processing: continuously acquiring image information obtained by optically photographing a subject in a lying position on a bed; and when a difference between a position of a first line corresponding to a position of a preset part of the subject in an image displayed by the image information at the current time point and a position of a second line corresponding to the position of the preset part of the subject in an image displayed by the image information of the nearest past exceeds a preset threshold, controlling to display the first line.

Images