Medical information processing device, medical information processing method, and program

Abstract

To facilitate specification of an imaging range.SOLUTION: A medical information processing device of an embodiment includes a selection part, a projection control part, and a specification part. The selection part selects an adaptation model image to be adapted to a subject lying on a couch, from among a plurality of model images. The projection control part causes the projection device to project the adaptation model image with respect to the subject. The specification part specifies the imaging range of the subject on the basis of a gesture of a user who instructs the imaging range of the subject detected by an optical image obtained by imaging by a camera.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The embodiments disclosed in the present specification and drawings relate to a medical information processing device, a medical information processing method, and a program. [Background technology]

[0002] In examinations using an X-ray computed tomography (CT) device (hereinafter referred to as an X-ray CT device), an imaging range including a region of interest such as an organ to be imaged is imaged. To determine the imaging range, a positioning image such as a scanogram is used. A user such as a technician specifies the imaging range using the positioning image displayed on the console, thereby identifying the imaging range.

[0003] However, there is a concern that specifying the imaging area using a positioning image such as a scanogram may increase the chance of radiation exposure. To address this issue, one technique involves projecting a marker onto the subject using a projector, and then determining the imaging area based on an image captured by a camera as the user gestures to move the marker to indicate the imaging area. While this technique can eliminate radiation exposure for capturing a scanogram, it is difficult for the user to appropriately indicate the imaging area, including the region of interest. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Special Publication No. 2010-512915 [Patent Document 2] Patent Publication No. 2021-154060 Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the embodiments disclosed in this specification and the drawings is to make it easier to specify the imaging range. However, the problem to be solved by the embodiments disclosed in this specification and the drawings is not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described below can also be positioned as other problems. [Means for solving the problem]

[0006] The medical image processing apparatus of the embodiment includes a selection unit, a projection control unit, and an identification unit. The selection unit selects a suitable model image suitable for a subject placed on a bed from among a plurality of model images. The projection control unit causes a projection device to project the suitable model image onto the subject. The identification unit identifies an imaging range of the subject based on a user's gesture indicating an imaging range of the subject detected from an optical image captured by a camera. [Brief explanation of the drawings]

[0007] [Figure 1] 1 is a diagram showing an example of the configuration of a hospital system 1 including a medical information processing apparatus 100 according to an embodiment. [Figure 2] FIG. 2 is a configuration diagram showing an example of an X-ray CT device 4. [Figure 3] FIG. 1 is a block diagram showing an example of the configuration of a medical information processing apparatus 100. [Figure 4] 4 is a flowchart showing an example of processing in the medical information processing apparatus 100. [Figure 5] FIG. 10 is a diagram showing an example of a standard model image. [Figure 6] FIG. 2 is a diagram showing an example of a state in which an image of a subject P placed on a tabletop 33 is being captured. [Figure 7] FIG. 2 is a diagram showing an example of an image of a subject P. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, a medical information processing apparatus, a medical information processing method, and a program according to an embodiment will be described with reference to the drawings.

[0009] (First embodiment) 1 is a diagram showing an example of the configuration of an in-hospital system 1 including a medical information processing device 100 of the embodiment. The in-hospital system 1 of the embodiment includes, for example, a Hospital Information System (hereinafter, referred to as HIS) 2, a Radiology Information System (hereinafter, referred to as RIS) 3, an X-ray CT apparatus 4, a Picture Archiving and Communication System (PACS) 5, an in-lab device 80, and the medical information processing device 100. The HIS 2, the RIS 3, the X-ray CT apparatus 4, the PACS 5, and the in-lab device 80 can communicate with each other via a network NW.

[0010] HIS2 is a computer system that supports operations within the hospital. Specifically, HIS2 has various subsystems, such as an electronic medical record system, a medical accounting system, a medical appointment system, a hospital reception system, and an admission and discharge management system.

[0011] The HIS2 includes a computer such as a server device or a client terminal that includes a processor such as a CPU (Central Processing Unit), memory such as a ROM (Read Only Memory) or RAM (Random Access Memory), a display, an input interface, and a communication interface.

[0012] A user inputs and references information about a patient using an electronic medical record system included in the HIS 2. The user issues an order for an imaging examination to the HIS 2. The HIS 2 transfers order information corresponding to the imaging examination order to other systems such as the RIS 3 and the medical information processing device 100.

[0013] RIS3 is a computer system that supports operations in the imaging diagnostic department. RIS3 manages reservations for imaging examination orders in cooperation with HIS2, as well as links reservation information to examination equipment and manages examination information. RIS3 includes computers such as server devices and client terminals equipped with processors such as CPUs, memories such as ROMs and RAMs, displays, input interfaces, and communication interfaces.

[0014] The X-ray CT device 4 performs imaging (photography) in accordance with imaging conditions (photography protocol) determined based on, for example, an image examination instruction. The hospital system 1 may include modalities other than the X-ray CT device 4, such as an X-ray diagnostic device, a magnetic resonance imaging device, an ultrasound diagnostic device, or a nuclear medicine diagnostic device, instead of or in addition to the X-ray CT device 4. Medical images (image data) generated by imaging with the X-ray CT device 4 are transmitted to the PACS 5 or the medical information processing device 100.

[0015] The PACS5 is a computer system that receives medical images sent by modalities such as the X-ray CT scanner 4 and stores them in a database. The PACS5 transmits (transfers) the medical images stored in the database in response to requests from clients. The PACS5 includes a server computer that includes a processor such as a CPU, memory such as ROM and RAM, a display, an input interface, and a communication interface.

[0016] 2 is a configuration diagram showing an example of an X-ray CT apparatus 4. The X-ray CT apparatus 4 includes, for example, a gantry 10, a bed apparatus 30, and a console apparatus 40. For convenience of explanation, FIG. 2 shows both a view of the gantry 10 from the Z-axis direction and a view of the gantry 10 from the X-axis direction, but in reality, there is only one gantry 10. In the first embodiment, the rotation axis of the rotating frame 17 in a non-tilted state or the longitudinal direction of the tabletop 33 of the bed apparatus 30 is defined as the Z-axis direction, an axis perpendicular to the Z-axis direction and horizontal to the floor surface is defined as the X-axis direction, and a direction perpendicular to the Z-axis direction and perpendicular to the floor surface is defined as the Y-axis direction.

[0017] The gantry device 10 includes, for example, an X-ray tube 11, a wedge 12, a collimator 13, an X-ray high voltage device 14, an X-ray detector 15, a data acquisition system (hereinafter referred to as DAS: Data Acquisition System) 16, a rotating frame 17, and a control device 18.

[0018] The X-ray tube 11 generates X-rays by irradiating thermoelectrons from a cathode (filament) to an anode (target) when a high voltage is applied from the X-ray high voltage device 14. The X-ray tube 11 includes a vacuum tube. For example, the X-ray tube 11 is a rotating anode type X-ray tube that generates X-rays by irradiating a rotating anode with thermoelectrons.

[0019] The wedge 12 is a filter for adjusting the amount of X-rays irradiated from the X-ray tube 11 to the subject P who is the subject of image diagnosis. The wedge 12 attenuates the X-rays that pass through it so that the distribution of the X-ray dose irradiated from the X-ray tube 11 to the subject P becomes a predetermined distribution. The wedge 12 is also called a wedge filter or a bow-tie filter. The wedge 12 is made by processing aluminum to have, for example, a predetermined target angle and a predetermined thickness.

[0020] The collimator 13 is a mechanism for narrowing the irradiation range of the X-rays that have passed through the wedge 12. The collimator 13 narrows the irradiation range of the X-rays, for example, by forming a slit using a combination of multiple lead plates. The collimator 13 is sometimes called an X-ray aperture. The narrowing range of the collimator 13 may be mechanically drivable.

[0021] The X-ray high voltage device 14 includes, for example, a high voltage generator and an X-ray control device. The high voltage generator has an electric circuit including a transformer and a rectifier, and generates a high voltage to be applied to the X-ray tube 11. The X-ray control device controls the output voltage of the high voltage generator according to the X-ray dose to be generated by the X-ray tube 11. The high voltage generator may be one that boosts voltage using the above-mentioned transformer, or one that boosts voltage using an inverter. The X-ray high voltage device 14 may be provided on the rotating frame 17, or may be provided on the side of the fixed frame (not shown) of the gantry device 10.

[0022] The X-ray detector 15 detects the intensity of X-rays generated by the X-ray tube 11 and incident upon the subject P. The X-ray detector 15 outputs an electrical signal (which may be an optical signal, etc.) corresponding to the intensity of the detected X-rays to the DAS 16. The X-ray detector 15 has, for example, multiple X-ray detection element rows. Each of the multiple X-ray detection element rows has multiple X-ray detection elements arranged in the channel direction along an arc centered on the focal point of the X-ray tube 11. The multiple X-ray detection element rows are arranged in the slice direction (column direction, row direction).

[0023] The X-ray detector 15 is, for example, an indirect detector having a grid, a scintillator array, and a photosensor array. The scintillator array has a plurality of scintillators. Each scintillator has a scintillator crystal. The scintillator crystal emits light with an amount of light corresponding to the intensity of the incident X-rays.

[0024] The grid is disposed on the surface of the scintillator array on which X-rays are incident, and has an X-ray shielding plate that has the function of absorbing scattered X-rays. The grid is also sometimes called a collimator (one-dimensional collimator or two-dimensional collimator). The photosensor array has a photosensor such as a photomultiplier tube (PMT). The photosensor array outputs an electrical signal corresponding to the amount of light emitted by the scintillator. The X-ray detector 15 may be a direct conversion type detector having a semiconductor element that converts incident X-rays into an electrical signal.

[0025] The DAS 16 includes, for example, an amplifier, an integrator, and an A / D converter. The amplifier amplifies the electrical signals output by each X-ray detection element of the X-ray detector 15. The integrator integrates the amplified electrical signals over a view period. The A / D converter converts the electrical signals indicating the integration results into digital signals. The DAS 16 outputs detection data based on the digital signals to the console device 40.

[0026] The rotating frame 17 is an annular member that supports the X-ray tube 11, wedge 12, collimator 13, and X-ray detector 15 in opposing positions. The rotating frame 17 is an annular member that has two circular side surfaces with a circular opening formed in the center, an inner side surface that connects the inner circles on both sides, and an outer side surface that connects the outer circles on both sides. Both side surfaces of the rotating frame 17 are flat, and the inner and outer surfaces are curved.

[0027] The rotating frame 17 is supported by a fixed frame (not shown) so as to be rotatable around the subject P introduced therein. The rotating frame 17 also supports the DAS 16. Detection data output by the DAS 16 is transmitted by optical communication from a transmitter having a light-emitting diode (LED) provided on the rotating frame 17 to a receiver having a photodiode provided on a non-rotating portion of the gantry device 10 (e.g., the fixed frame), and then transferred to the console device 40 by the receiver. Note that the method of transmitting the detection data from the rotating frame 17 to the non-rotating portion is not limited to the above-mentioned method using optical communication, and any non-contact transmission method may be adopted. The rotating frame 17 is not limited to being an annular member, but may also be an arm-like member as long as it can support and rotate the X-ray tube 11 and the like.

[0028] The X-ray CT device 4 is, for example, a Rotate / Rotate-Type X-ray CT device (third generation CT) in which both the X-ray tube 11 and the X-ray detector 15 are supported by a rotating frame 17 and rotate around the subject P, but is not limited to this and may also be a Stationary / Rotate-Type X-ray CT device (fourth generation CT) in which multiple X-ray detection elements arranged in a circular ring are fixed to a fixed frame and the X-ray tube 11 rotates around the subject P.

[0029] The control device 18 has, for example, a processing circuit having a processor such as a CPU (Central Processing Unit), and a drive mechanism including a motor, an actuator, etc. The processing circuit realizes these functions by, for example, a hardware processor executing a program stored in a storage device (storage circuit).

[0030] The control device 18, for example, rotates the rotating frame 17, tilts the gantry of the gantry device 10, moves the top board 33 of the bed device 30 by vertical movement or the like, and causes the X-ray tube 11 to emit (irradiate) X-rays. The control device 18 may be provided in the gantry device 10 or in the console device 40.

[0031] The bed device 30 is a device on which the subject P to be scanned is placed, moved, and introduced into the rotating frame 17 of the gantry device 10. The bed device 30 includes, for example, a base 31, a bed vertical movement device 32, and a tabletop 33. The base 31 includes a housing that supports a support frame on which the subject P is placed so that the support frame can move in the vertical direction (Y-axis direction). The tabletop 33 is an example of a bed.

[0032] The console device 40 includes, for example, a memory 41, a display 42, an input interface 43, and a processing circuit 50. In the first embodiment, the console device 40 is described as being separate from the gantry device 10, but the gantry device 10 may include some or all of the components of the console device 40.

[0033] The memory 41 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory), a flash memory, a hard disk, an optical disk, etc. The memory 41 stores, for example, detection data, projection data, reconstructed image data, CT image data, etc. These data may be stored in an external memory with which the X-ray CT apparatus 4 can communicate, instead of (or in addition to) the memory 41. The external memory is controlled by, for example, a cloud server that manages the external memory, by the cloud server accepting a read / write request.

[0034] The display 42 displays various types of information. For example, the display 42 displays medical images (CT images) generated by the processing circuitry 50, GUI (Graphical User Interface) images that accept various operations by operators such as doctors and engineers, and the like. The display 42 is, for example, a liquid crystal display, a CRT (Cathode Ray Tube), an organic EL (Electroluminescence) display, or the like. The display 42 may be provided on the gantry device 10. The display 42 may be a desktop type, or may be a display device (for example, a tablet terminal) that can wirelessly communicate with the main body of the console device 40.

[0035] The input interface 43 receives various input operations from the operator and outputs an electrical signal indicating the content of the received input operation to the processing circuitry 50 .

[0036] The processing circuitry 50 controls the overall operation of the X-ray CT device 4. The processing circuitry 50 includes, for example, a control function 51, a pre-processing function 52, a reconstruction processing function 53, and an image processing function 54. The processing circuitry 50 realizes these functions by, for example, a hardware processor executing a program stored in a storage device (storage circuit).

[0037] Each component of the console device 40 or the processing circuitry 50 may be distributed and realized by multiple pieces of hardware. The processing circuitry 50 may not be a component of the console device 40, but may be realized by a processing device capable of communicating with the console device 40. The processing device is, for example, a workstation connected to one X-ray CT device, or a device (e.g., a cloud server) connected to multiple X-ray CT devices and collectively executing processing equivalent to that of the processing circuitry 50 described below. Each function included in the processing circuitry 50 may be distributed among multiple circuits, or may be made available by launching application software stored in the memory 41.

[0038] The control function 51 controls various functions of the processing circuit 50 based on input operations received by the input interface 43. For example, the control function 51 controls the X-ray high voltage device 14, the DAS 16, the control device 18, and the bed vertical movement device 32 to perform processing such as collection of detection data in the gantry device 10.

[0039] The pre-processing function 52 performs pre-processing such as logarithmic conversion processing, offset correction processing, inter-channel sensitivity correction processing, and beam hardening correction on the detection data output by the DAS 16, generates projection data, and stores the generated projection data in the memory 41.

[0040] The reconstruction processing function 53 performs reconstruction processing on the projection data generated by the preprocessing function 52 using a filtered back projection method, an iterative reconstruction method, or the like to generate reconstruction processed image data for generating CT image data, and stores the generated reconstruction processed image data in the memory 41.

[0041] The image processing function 54 generates three-dimensional data or cross-sectional image data by converting the reconstructed image data into three-dimensional image data or cross-sectional image data of an arbitrary cross section using a known method based on the input operation received by the input interface 43. The conversion into three-dimensional image data may be performed by the pre-processing function 52.

[0042] 1, the examination room device 80 includes, for example, a camera 81 and a projector 82. The camera 81 and the projector 82 are installed together, for example, on the ceiling of the examination room R in which the X-ray CT device 4 is installed. The camera 81 is, for example, an optical camera, and as shown in FIG. 2, is placed at a position where it can image the entire body of the subject P placed on the bed device 30, and captures an optical image of the subject P. The camera 81 transmits the captured image to the medical information processing device 100.

[0043] The projector 82 projects various images onto the body surface of the subject P. For example, based on projection instruction information transmitted by the medical information processing device 100, the projector 82 projects operation knob images serving as markers used by the user for instructions by gestures and model images including information on potential regions of interest such as organs and bones onto the body surface of the subject P. The camera 81 also captures the operation knob images and model images (compatible model images) projected by the projector 82, together with the subject P.

[0044] The medical information processing device 100, for example, causes the projector 82 to display a model image or an operation knob image on the body surface of the subject P, and executes various processes based on images captured by the camera 81. Fig. 3 is a block diagram showing an example of the configuration of the medical information processing device 100.

[0045] The medical information processing device 100 includes, for example, a communication interface 110, an input interface 120, a display 130, a processing circuit 140, and a memory 150. The communication interface 110 communicates with external devices such as an HIS 2, an RIS 3, an X-ray CT device 4, and a PACS 5 via a network NW such as a LAN (Local Area Network). The communication interface 110 includes, for example, a communication interface such as a NIC (Network Interface Card).

[0046] The input interface 120 accepts various input operations from a user such as a doctor, converts the accepted input operations into electrical signals, and outputs the electrical signals to the processing circuitry 140. For example, when an input operation is performed by a user, the input interface 120 generates information corresponding to the input operation. The input interface 120 outputs the generated information corresponding to the input operation to the processing circuitry 140.

[0047] The input interface 120 includes, for example, a mouse, a keyboard, a trackball, a switch, a button, a joystick, a touch panel, etc. The input interface 120 may be, for example, a user interface that accepts audio input from a microphone, etc. The input interface 120 may also have a display function as the display 130, such as a touch panel, for example.

[0048] In this specification, the input interface is not limited to an interface having physical operation parts such as a mouse, keyboard, etc. For example, an example of an input interface also includes an electrical signal processing circuit that receives an electrical signal corresponding to an input operation from an external input device provided separately from the device and outputs this electrical signal to a control circuit.

[0049] The display 130 is a display unit that displays various types of information. For example, the display 130 displays images generated by the processing circuit 140, a GUI (Graphical User Interface) for receiving various input operations from the user, etc. For example, the display 130 is an LCD (Liquid Crystal Display), a CRT (Cathode Ray Tube) display, an organic EL (Electro Luminescence) display, etc.

[0050] The processing circuitry 140 includes, for example, an acquisition function 141, a selection function 142, an adjustment function 143, a projection control function 144, and a specification function 145. The processing circuitry 140 realizes these functions by, for example, a hardware processor (computer) executing a program stored in memory 150.

[0051] The hardware processor refers to a circuit such as a CPU, a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD) or a complex programmable logic device (CPLD)), or a field programmable gate array (FPGA).

[0052] Instead of storing the program in the memory 150, the program may be directly embedded in the circuit of the hardware processor. In this case, the hardware processor realizes its functions by reading and executing the program embedded in the circuit. The program may be stored in the memory 150 in advance, or may be stored in a non-transitory storage medium such as a DVD or CD-ROM, and installed into the memory 150 from the non-transitory storage medium by inserting the non-transitory storage medium into a drive device (not shown) of the medical information processing device 100.

[0053] The hardware processor is not limited to being configured as a single circuit, but may be configured as a single hardware processor by combining multiple independent circuits to realize each function, or multiple components may be integrated into a single hardware processor to realize each function.

[0054] The memory 150 is realized by, for example, a semiconductor memory element such as RAM or flash memory, a hard disk, or an optical disk. These non-transitory storage media may also be realized by other storage devices connected via a communication network, such as a network-attached storage (NAS) or an external storage server device. The memory 150 may also include other non-transitory storage media, such as a read-only memory (ROM) or a register.

[0055] The memory 150 stores a model image database (hereinafter referred to as DB) 151. The model image DB 151 is a DB including a plurality of model images. The model image DB 151 includes a standard model image DB 152 and a previous subject image DB 153. The standard model image DB 152 includes a plurality of standard model images for each subject's body type, posture, body shape, and other subject information. The standard model images are model images of a standard human body for the entire subject.

[0056] The previous subject image DB 153 includes a plurality of previous subject images when the subject P was imaged in the past. The previous subject images also include previous subject images of a plurality of subjects. A subject ID is assigned to the previous subject image, making it possible to distinguish whether the previous subject image is of the subject himself or of another person. The previous images include, for example, a registration image used in registration of the subject P and an examination image captured and used during a past examination.

[0057] The acquisition function 141 in the processing circuitry 140 acquires subject information. For example, when specifying the imaging range of the subject P by the X-ray CT device 4, the acquisition function 141 transmits imaging information for capturing an external image of the subject P to the camera 81. The camera 81 captures an optical image including the external image of the subject P based on the imaging information. The camera 81 transmits the captured optical image to the medical information processing device 100.

[0058] The acquisition function 141 acquires optical images of the subject P captured by the camera 81, which are transmitted by the camera 81 and received by the communication interface 110. The acquisition function 141 performs image processing on the acquired optical images to acquire subject information such as the subject's body structure, posture, body shape, sex, and age. The posture includes information such as prone, supine, sideways, and head-to-tail orientation relative to the gantry. The body shape includes specific numerical values such as height, weight, and chest circumference, as well as concepts such as guidelines other than specific numerical values (for example, large body, thin body). The acquisition function 141 is an example of an acquisition unit.

[0059] The selection function 142 selects a suitable model image suitable for the subject P placed on the tabletop 33 from a plurality of model images included in the model image DB 151. The selection function 142 selects the suitable model image based on, for example, the subject information acquired by the acquisition function 141. The selection function 142 is an example of a selection unit.

[0060] The adjustment function 143 performs non-rigid registration of the matching model image selected by the selection function 142 to the subject P. For example, the adjustment function 143 compares the subject P included in the optical image acquired by the acquisition function 141 with the matching model image selected by the selection function 142, and adjusts the shape of the matching model image to perform non-rigid registration. The adjustment function 143 is an example of an adjustment unit.

[0061] The projection control function 144 controls the projector 82 when the projector 82 projects an image. The projection control function 144 includes, for example, a model projection control function 161 and an operation knob projection control function 162. The model projection control function 161 transmits projection instruction information to the projector 82 to project the adapted model image adjusted by the adjustment function 143 toward the subject P.

[0062] The operation knob projection control function 162 transmits projection instruction information to the projector 82 to project the operation knob image toward the subject P. When the identification function 145 detects a gesture of operating the operation knob image, the operation knob projection control function 162 moves and projects the operation knob image in accordance with the detected user operation. The projection control function 144 is an example of a projection control unit.

[0063] The identification function 145 identifies the imaging range of the subject P based on a user's gesture indicating the imaging range of the subject P detected from the optical image captured by the camera 81. The identification function 145, for example, performs image analysis on the optical image transmitted by the camera 81, thereby recognizing the operation knob projected by the projector 82 and the user's hand operating the operation knob.

[0064] The identification function 145 detects a user gesture of operating the operation knob image to specify an imaging range of the subject P from the recognized hand movement of the user. The identification function 145 identifies an imaging range of the subject P based on the detected gesture. The identification function 145 is an example of an identification unit. When projecting the matching model image onto the subject P, the projection control function 144 may cause the projector 82 to project the imaging range of the subject P previously identified by the identification function 145 together with the matching model image.

[0065] Next, a description will be given of processing in the medical information processing device 100. Fig. 4 is a flowchart showing an example of processing in the medical information processing device 100. Fig. 4 explains a procedure in which the medical information processing device 100 specifies an imaging range when imaging the subject P using the X-ray CT device 4.

[0066] 4 is executed, the medical information processing apparatus 100 stores in advance in a model image DB 151 a plurality of model images as candidates for suitable model images to be projected onto the subject P. The standard model image DB 152 included in the model image DB 151 is stored, for example, at the time of shipping of the medical information processing apparatus 100.

[0067] The medical information processing apparatus 100 also acquires the order information transferred by the HIS 2. After the medical information processing apparatus 100 acquires the order information, the subject P is placed on the table 33 of the bed apparatus 30. After that, the medical information processing apparatus 100 starts the process shown in FIG.

[0068] The medical information processing device 100 transmits imaging information capturing an external image of the subject P to the camera 81, and automatically acquires the optical image transmitted by the camera 81 and received by the communication interface 110 (step S101). Subsequently, the acquisition function 141 performs image processing on the acquired optical image to acquire subject information of the subject P (step S103). Furthermore, the acquisition function 141 acquires subject information from information other than the optical image, for example, order information transferred by the HIS2.

[0069] Next, the selection function 142 automatically selects a suitable model image suitable for the subject P placed on the tabletop 33 from among the model images included in the standard model image DB 152 stored in the memory 150, based on the subject information acquired by the acquisition function 141 (step S105). The standard model image DB 152 stores a plurality of model images.

[0070] 5 is a diagram showing an example of a standard model image. The standard model images included in the standard model image DB 152 include a first model image MG1, a second model image MG2, a third model image MG3, a fourth model image MG4, and so on. The first model image MG1 is a standard model image of a heavier than standard body type. The second model image MG2 is a standard model image of a standard body type. The third model image MG3 is a standard model image of a thinner than standard body type. The fourth model image MG4 is a standard model image of a shorter than standard body type.

[0071] The selection function 142 selects, as a suitable model image, from among these standard model images MG1, MG2, MG3, MG4, ..., a model image that is closest to the appearance of the subject P image-processed by the acquisition function 141. The selection function 142 determines whether the appearances are similar based on, for example, whether the difference in height or width between the image of the subject P and the model image is small, or whether the head-to-tail orientation or orientation (sideways or supine) matches.

[0072] Next, the adjustment function 143 performs non-rigid alignment of the matching model image selected by the selection function 142 with the image of the subject P (step S107). Next, the projection control function 144 outputs projection instruction information to the projector 82, and projects the matching model image and the operation knob image non-rigidly aligned by the adjustment function 143 onto the body surface of the subject P (step S109).

[0073] The projector 82 projects the matching model image, allowing the user to easily recognize the region of interest, such as the organ to be imaged. The user adjusts the imaging range appropriately by making a gesture to move the operation knob image. The camera 81 captures the user's gesture and transmits the optical image to the medical information processing device 100.

[0074] 6 is a diagram showing an example of a state in which an image of a subject P placed on the table 33 is captured. The subject P is placed on the table 33 of the bed device 30 so that the head of the subject P is positioned toward the gantry device 10 of the X-ray CT device 4. An image is projected from above the subject P by a projector 82, and the subject P and the image projected onto the subject P are captured by a camera 81.

[0075] 7 is a diagram showing an example of an image obtained by capturing an image of a subject P. The image projected by the projector 82 includes a fitted model image PS, a first operation knob image N1, a second operation knob image N2, a third operation knob image N3, and a fourth operation knob image N4. The imaging range PA is a rectangle whose four corners are the first operation knob image N1, the second operation knob image N2, the third operation knob image N3, and the fourth operation knob image N4. The user can specify the imaging range PA by making a gesture to operate the first operation knob image N1, the second operation knob image N2, the third operation knob image N3, or the fourth operation knob image N4.

[0076] Next, the identification function 145 recognizes the user's hand by performing image analysis on the optical image transmitted by the camera 81. The identification function 145 detects a user gesture of operating the operation knob image to specify an imaging range of the subject P from the recognized movement of the user's hand, and determines whether or not an imaging range has been specified (step S111).

[0077] If it is determined that an imaging range has been specified, the specifying function 145 adjusts and specifies the imaging range in accordance with the user's specification (step S113). Subsequently, the specifying function 145 determines whether or not the user's specification has ended and the specification of the imaging range has been completed (step S115). Even if it is determined in step S111 that an imaging range has not been specified, the specifying function 145 determines whether or not the user's specification has ended and the specification of the imaging range has been completed (step S115).

[0078] If it is determined that the identification of the imaging range has not been completed, the identification function 145 returns the process to step S111 and determines whether the user has specified the imaging range. If the identification function 145 determines that the identification of the imaging range has been completed, the medical information processing device 100 ends the process shown in FIG.

[0079] The medical information processing apparatus 100 of the first embodiment selects a suitable model image suitable for the subject P from among multiple model images using a selection function 142, performs non-rigid positioning of the suitable model image using an adjustment function 143, and causes the projector 82 to project it using a projection control function 144. Furthermore, when projecting the suitable model image toward the subject P, the projection control function 144 may also cause the projector 82 to project an imaging range of the subject P previously identified by an identification function 145 together with the suitable model image. This makes it easier for the user to specify the imaging range by indicating a specific region of the subject P, for example, by a gesture. This reduces the number of times images are captured over an excessively large range or the need to retake images due to an imaging range that is too narrow.

[0080] (Second embodiment) Next, a second embodiment will be described. The medical information processing device 100 of the second embodiment has the same configuration as the first embodiment. The medical information processing device 100 of the second embodiment differs in that a model image of a specific body part for a part of the subject is stored in the memory 150. The specific part may be any part. For example, the specific part may be an organ such as the lungs, stomach, or intestines, or may be a limb such as a hand or foot, or an organ such as an ear or nose. The specific part may include multiple of these organs or organs.

[0081] Furthermore, in the second embodiment, the projection control function 144 differs from the first embodiment in that it highlights a portion of the image to be projected. For example, the projection control function 144 may identify a region of interest included in the matching model image and highlight only the region of interest. The highlighting may be in any manner, for example, the region of interest may be displayed in a color that stands out more than the color displayed in other regions, or may be displayed with a higher brightness or luminosity than other regions. The projection control function 144 may display regions other than the region of interest in monochrome, or may not display them at all. Other aspects are the same as those of the first embodiment.

[0082] The medical information processing device 100 of the second embodiment achieves the same effects as the first embodiment. Furthermore, the medical information processing device 100 of the second embodiment uses a specific part of the body as a model image, thereby preventing the projection of images more than necessary. Furthermore, the medical information processing device 100 of the second embodiment highlights the region of interest and makes regions other than the region of interest less noticeable. This makes it easier for the user to recognize the region of interest, etc., thereby reducing the effort required for the user to specify the imaging range using gestures. As a result, it becomes easier for the user to specify the imaging range.

[0083] (Third embodiment) Next, a third embodiment will be described. The medical information processing device 100 of the third embodiment has the same configuration as that of the first embodiment. In the medical information processing device 100 of the third embodiment, the selection function 142 selects a suitable model image from past subject images included in the past subject image DB 153 in the model image DB 151.

[0084] In the medical information processing apparatus 100 of the third embodiment, after the acquisition function 141 acquires the subject information, the selection function 142 automatically selects a matching model image from the past subject images included in the past subject image DB 153 based on the subject information. The selection function 142 selects, for example, the most recently aligned image as the matching model image. The selection function 142 may select the matching model image based on the same criteria as in the first embodiment, or may select the matching model image from the images at the time of examination. Other points are the same as in the first embodiment.

[0085] The medical information processing apparatus 100 of the third embodiment has the same effects as those of the first embodiment. Furthermore, the medical information processing apparatus 100 of the third embodiment selects from among past subject images included in the past subject image DB 153. Therefore, it is possible to select a suitable model image that is likely to match the subject P, thereby reducing the effort required for non-rigid registration by the adjustment function 143.

[0086] According to at least one of the embodiments described above, the medical information processing device can make it easier to specify an imaging range by having a selection unit that selects a suitable model image that is suitable for a subject sitting on a bed from among a plurality of model images, a projection control unit that causes a projection device to project the suitable model image onto the subject, and an identification unit that identifies the imaging range of the subject based on a user's gesture that indicates the imaging range of the subject detected from an optical image captured by a camera.

[0087] Although several embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, as well as within the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0088] 1. In-hospital system 2 HIS (Hospital Information System) 3 RIS (Radiology Information System) 4 X-ray CT device 5 PACS (Picture Archiving and Communication System) 10 Mounting device 11 X-ray tube 12 Wedges 13 Collimator 14 X-ray high voltage device 15 X-ray detector 16 DAS (Data Acquisition System) 17 Rotating Frame 18 Control Device 30 Bed Device 31 Foundation 32 Bed up / down device 33 Top plate 40 Console device 41,150 memory 42,130 displays 43,120 input interfaces 50,140 Processing Circuit 51 Control Functions 52 Pre-processing function 53 Reconstruction processing function 54 Image processing functions 80 In-lab equipment 81 Camera 82 Projector 100 Medical information processing device 141 Acquisition Function 142 Selection Function 143 Adjustment function 144 Projection control function 145 Specific Functions 150 memory 151 Model Image DB 152 Standard Model Image DB 153 Subject Past Image DB 161 Model projection control function 162 Operation knob projection control function MG1 1st model image (standard model image) MG2 2nd model image (standard model image) MG3 3rd model image (standard model image) MG4 4th model image (standard model image) N1 1st operation knob image N2 2nd operation knob image N3 3rd operation knob image N4 4th operation knob image NW Network P Subject PA imaging range R Examination Room

Claims

1. a selection unit that selects a suitable model image that is suitable for a subject placed on the bed from among a plurality of model images; a projection control unit that causes a projection device to project the fitted model image onto the subject; and a specifying unit that specifies an imaging range of the subject based on a user's gesture indicating an imaging range of the subject detected from an optical image captured by a camera. Medical information processing equipment.

2. the selection unit selects the adapted model image based on object information related to the object. The medical information processing device according to claim 1 .

3. further comprising an acquisition unit that acquires the subject information; The medical information processing device according to claim 2 .

4. the acquiring unit acquires the object information based on an optical image of the object captured by a camera. The medical information processing device according to claim 3 .

5. the model image includes at least one of a model image of a standard human body and a previous subject image obtained by previously capturing an image of the subject; The medical information processing device according to claim 2 .

6. The subject information includes at least one of information on the body type, posture, age, sex, or body shape of the subject. The medical information processing device according to claim 2 .

7. an adjustment unit that non-rigidly aligns the fitted model image selected by the selection unit with the object; The medical information processing device according to claim 1 .

8. the projection control unit projects the non-rigidly registered fitted model image onto the subject; The medical information processing device according to claim 1 .

9. the projection control unit projects the adapted model image onto the whole or part of the subject; 2. The medical information processing device according to claim 1.

10. the projection control unit projects the fitted model image highlighting a part of the object; 2. The medical information processing device according to claim 1.

11. the projection control unit projects a previously identified imaging range of the subject together with the matching model image; The medical information processing device according to claim 1 .

12. The computer selecting a suitable model image suitable for the subject on the bed from among the plurality of model images; projecting the fitted model image onto the subject using a projection device; specifying an imaging range of the subject based on a user's gesture indicating the imaging range of the subject detected from the optical image captured by the camera; Medical information processing method.

13. On the computer, selecting a suitable model image suitable for the subject on the bed from among the plurality of model images; specifying an imaging range of the subject based on a user's gesture indicating the imaging range of the subject detected from the optical image captured by the camera; program.

Images