Medical imaging apparatus, medical imaging support method, information processing apparatus, recording medium, and program product
By introducing sensors into medical imaging devices to identify the patient's position and provide a pop-up screen with position adjustment suggestions, the problem of cumbersome operation caused by inconsistent positions is solved, improving user convenience and imaging quality.
Patent Information
- Application Number
- CN202511141194.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-08-19
- Filing Date
- 2025-08-14
- Publication Date
- 2026-03-03
AI Technical Summary
Existing medical imaging devices lack an effective automated adjustment mechanism when the patient's position is inconsistent, resulting in cumbersome operation for users and reduced image quality.
Sensors are introduced into medical imaging devices to identify the subject's posture and a pop-up screen on the display device provides posture adjustment suggestions, allowing users to easily re-register the correct posture.
This improves user convenience and ensures the appropriate positioning of the examinee, thereby enhancing the imaging quality and efficiency of medical images.
Smart Images

Figure CN121587663A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to a medical imaging device, a medical imaging support method, an information processing device, and a program. Background Technology
[0002] Patent document 1 discloses a radiographic tomography device, which has the following mechanism: using a depth sensor to identify the subject's body position, determining whether the pre-set body position and other scanning conditions are appropriate, and notifying the subject when it is determined to be inappropriate.
[0003] Patent Document 2 discloses a method for acquiring a depth image of a patient on a worktable of a medical imaging system via a depth camera; correcting the depth image based on histogram data from the depth image; and extracting the patient's three-dimensional structure based on the corrected depth image. Patent Document 2 also describes a structure for determining the patient's posture based on the extracted three-dimensional structure; comparing it with the required patient posture for implementing the scanning protocol; and outputting a warning if there is a discrepancy. The term "patient" has the same meaning as "subject," and "patient's posture" has the same meaning as "subject's body position."
[0004] Patent Document 1: Japanese Patent Application Publication No. 2014-121364
[0005] Patent Document 2: Japanese Patent Application Publication No. 2021-121092
[0006] In examinations using medical imaging devices, such as magnetic resonance imaging (MRI) devices, technicians and other users open the patient registration screen on the control panel and pre-register patient information, examination sites, patient positions, and imaging plans on the patient registration screen.
[0007] The user then places the subject on a bed in the shielded room and presses the start button to begin imaging, thus commencing the examination. Before or after pressing the start button, the console screen switches to the examination window screen. That is, when instructed to begin imaging, since the console screen has already switched to the examination window screen, imaging should proceed normally, and the image reconstructed from the data obtained through imaging should be output to the examination window screen.
[0008] However, for some reason, imaging may be performed in a position different from the pre-registered subject position (hereinafter referred to as the "registered position"). For example, imaging may be performed suddenly in a position different from the registered position based on the patient's request. Furthermore, it can be assumed that the user may have registered the wrong position when pre-registering the subject's position. Alternatively, it can be assumed that although the registered position is correct, the subject may be placed on the bed in a position different from the registered position. If imaging is performed in a position different from the registered position, this may become a reason for re-imaging.
[0009] In this respect, according to the technology described in Patent Documents 1 and 2, since it is a structure that notifies the user when a body position different from the registered body position is found, it is hoped that the user will realize the error, re-register the correct body position and perform appropriate imaging.
[0010] On the other hand, in conventional technologies, in order to change the registered body position to the correct position, it is necessary to return from the examination window screen to the examinee registration screen and re-register the body position, which makes the re-registration operation cumbersome. Furthermore, in Patent Documents 1 and 2, only a mechanism for notifying inconsistencies in body position is provided, but no specific mechanism is shown that helps to eliminate inconsistencies. Summary of the Invention
[0011] The present invention was made in view of this situation, and its object is to provide a medical imaging device, medical imaging support method, information processing device and program that can improve user convenience and enable imaging of medical images of the subject through appropriate body position.
[0012] The medical imaging apparatus according to the first aspect of the present invention images a medical image of a subject. The medical imaging apparatus includes: a sensor for acquiring information for identifying the subject's body position; and a processor that performs the following processing: displaying a registration screen on a display device for registering the subject's body position; receiving an instruction to start imaging for a subject in a registered body position; identifying the subject's body position based on information acquired from the sensor; and when switching from the registration screen to an examination window screen including an image display area for displaying medical images, if the identified body position is different from the registered body position, displaying a pop-up screen including a suggestion to re-register the body position on the examination window screen.
[0013] According to the first method, when an inspection window is displayed on the display device, if a position different from the registered position is identified, a pop-up screen is displayed on the inspection window. This pop-up screen includes a suggestion to change from the registered position and re-register the position. After deciding whether to adopt the suggestion, the user can re-register the appropriate position through a simple operation.
[0014] The medical imaging device involved in the second method, in the same way as the medical imaging device involved in the first method, may have the following structure: the sensor includes a camera, and the information used to identify the subject's position includes images captured by the camera.
[0015] The medical imaging device involved in the third method, in the medical imaging device involved in the first or second method, may have the following structure: a bed with a top plate for supporting and moving the subject; and a frame with an imaging space, in which the subject is inserted by moving the top plate.
[0016] The medical imaging device involved in the fourth method, in the medical imaging device involved in the third method, may have the following structure: the bed has multiple connectors, a receiving coil for receiving signals emitted by the subject is connected to the multiple connectors, and a sensor detects at least one of the positions of the connectors connected to the receiving coils and the types of receiving coils.
[0017] The medical imaging device involved in the fifth method, in any of the medical imaging devices involved in the first to fourth methods, may have the following structure: the pop-up screen includes a portion of the registration screen.
[0018] The medical imaging device involved in the sixth method, in any of the medical imaging devices involved in the first to fifth methods, may have the following structure: the processor accepts the re-registration of the subject's position on the pop-up screen.
[0019] In the medical imaging device involved in the seventh method, the registration screen can be a screen that accepts the registration of imaging conditions including the subject's position and the registration of the subject's information.
[0020] The medical imaging device involved in Method 8, in any of the medical imaging devices involved in Methods 1 to 5, may have the following structure: displaying the registered body position and the suggested re-registered body position on a pop-up screen.
[0021] The medical imaging device involved in the 9th method, in any of the medical imaging devices involved in the 1st to 8th methods, can have the following structure: the processor displays the suggested body position corresponding to the identified body position on the pop-up screen.
[0022] The medical imaging device involved in the 10th method, in any of the medical imaging devices involved in the 1st to 9th methods, may have the following structure: displaying a button on a pop-up screen indicating to continue imaging.
[0023] The medical imaging device involved in the 11th method, in any of the medical imaging devices involved in the 1st to 10th methods, may have the following structure: the processor displays a pop-up screen in the image display area of the examination window screen.
[0024] The medical imaging device involved in the 12th method, in any of the medical imaging devices involved in the 1st to 11th methods, may have the following structure: when the processor displays the examination window screen, during the period until the identification of the subject's position is completed, it displays information indicating that the position is being identified on the examination window screen.
[0025] The medical imaging device involved in the 13th method, in any of the medical imaging devices involved in the 1st to 12th methods, may have the following structure: when the processor cannot recognize the position of the examinee, it will pop up a screen including information obtained from the sensor and display it on the examination window screen.
[0026] The medical imaging device according to the 14th method, in the medical imaging device according to the 13th method, may have the following structure: the information obtained from the sensor includes images captured by a camera that serves as the sensor.
[0027] The medical imaging device according to the 15th method, in the medical imaging device according to the 13th or 14th method, may have the following structure: the information obtained from the sensor includes coil information, which includes at least one of information indicating the type of receiving coil for receiving signals emitted by the subject and information indicating the position of the connector connected to the receiving coil.
[0028] The medical imaging device involved in the 16th method, in any of the 13th to 15th methods, may have the following structure: displaying the registered body position and the body position as a candidate for re-registration on a screen that includes information obtained from the sensor.
[0029] The medical imaging device involved in the 17th method, in any of the 13th to 16th methods, may have the following structure: the screen including information obtained from the sensor includes a portion of the registration screen.
[0030] The medical imaging support method involved in the 18th method is a medical imaging support method executed by a processor, which includes the processor performing the following processing: displaying a registration screen on a display device for registering the subject's position; receiving an instruction to start imaging for imaging medical images of the subject in the registered position; identifying the subject's position based on information obtained from a sensor; and when switching from the registration screen to an examination window screen including an image display area for displaying medical images of the subject, if the identified position is different from the registered position, displaying a pop-up screen including a suggestion to re-register the position on the examination window screen.
[0031] The processor can automatically execute each action according to the program, or it can accept input from the user and perform some or all of the processing according to the received instructions. Furthermore, the order of processing can be changed within the scope of technical inconsistency.
[0032] Regarding the medical imaging support method involved in the 18th method, it can be configured to include the same specific method of the medical imaging device involved in any of the 2nd to 18th methods.
[0033] The information processing apparatus according to the 19th method includes a processor that performs the following processing: displays a registration screen on a display device for registering the subject's body position; receives an instruction to start imaging for imaging a medical image of the subject in the registered body position; identifies the subject's body position based on information obtained from a sensor; and when switching from the registration screen to an examination window screen including an image display area for displaying the subject's medical image, if the identified body position is different from the registered body position, displays a pop-up screen on the examination window screen including a suggestion to re-register the body position.
[0034] Regarding the information processing apparatus involved in the 19th method, it can be configured to include the same specific structure as the medical imaging apparatus involved in any of the 2nd to 18th methods.
[0035] The program involved in the 20th aspect is a program that enables a computer to function as the information processing apparatus involved in the 19th aspect. A non-transitory and tangible computer-readable storage medium storing the program involved in the 20th aspect is also included in this invention. The program involved in the 20th aspect and the storage medium storing the program involved in the 20th aspect can be configured to include the same specific structure as the medical imaging apparatus involved in any of the 2nd to 18th aspects.
[0036] Invention Effects
[0037] According to the present invention, user convenience can be improved and medical images of the examinee can be imaged through appropriate body positioning. Attached Figure Description
[0038] Figure 1 This is a perspective view showing the appearance of an illustrative MRI device.
[0039] Figure 2 This is a diagram showing a schematic internal structure of the MRI device according to the embodiment.
[0040] Figure 3 This is another example of the camera configuration in an MRI apparatus.
[0041] Figure 4 This is a block diagram illustrating an example of the hardware structure of an information processing device used in an MRI apparatus.
[0042] Figure 5 This is an example of a screen showing the registration process for those being examined.
[0043] Figure 6 This is an example of inspecting the window screen.
[0044] Figure 7 This is a flowchart illustrating an example of an action performed using an MRI device.
[0045] Figure 8 This is an example of a pop-up window that appears on the inspection window screen.
[0046] Figure 9 This is an example of a screen showing the display location of a pop-up on an inspection window screen.
[0047] Figure 10 This is an example of a screen display that includes camera images and coil information.
[0048] Figure 11 This is a plan view of a bed supporting a subject, on which a receiving coil is installed as a neurocoil for the head and neck.
[0049] Figure 12 This is a block diagram illustrating the functional structure of an information processing apparatus for implementing the medical imaging support method involved in the embodiments.
[0050] Symbol Explanation
[0051] 10-MRI device, 12-gantry, 14-bed, 15-ceiling plate, 16-legs, 18-imaging space, 20A, 20B, 20C, 20D-bed-side connectors, 102-static magnetic field generating magnet, 104-gradient magnetic field coil, 106-RF transmitting coil, 110-receiving coil, 110A-receiving coil, 112-receiver, 114-gradient magnetic field power supply, 116-high frequency magnetic field generator, 118-sequencer, 120-control unit, 122-operating unit, 130-subject, 140, 141-camera, 150-receiving side cable, 15 2-Receiver connector, 200-Information processing device, 202-Processor, 204-Memory, 206-Storage device, 208-Input / output interface, 210-Bus, 212-Input device, 214-Display device, 220-Subject registration screen generation unit, 222-Position registration GUI module, 224-Registration information receiving unit, 226-Imaging condition registration unit, 227-Position registration unit, 228-Imaging control unit, 230-Camera image acquisition unit, 232-Coil information acquisition unit, 234-Position recognition unit, 236-Matching determination unit, 240-Detection Check the window generation section, 242-Pop-up generation section, 243-Re-registration suggestion generation section, 246-Re-registration acceptance section, 250-Image processing section, 260-Display control section, 400-Examinee registration screen, 401-Examinee information area, 402-Examination site area, 403-Position registration area, 404-Examination condition area, 405-Program area, 406-Button section, 410-Examination window start button, 500-Examination window screen, 501-Switch tab, 502-Examinee information area, 503-Program area, 504-Series list, 505- Menu bar, 506-Toolbar, 507-Task execution screen, 508-Start button, 509-Stop button, 510-Imaging condition area, 512-Image display area, 600-Pop-up screen, 601-Action message, 602-Position, 603-Suggested position, 604-Continue imaging button, 700-Pop-up screen, 701-Action message, 702-Camera image, 703-Coil information, 704-Bedside connector, 705-Coil name, 706-Position registration area, 707-OK button, S60~S69-MRI device operation steps. Detailed Implementation
[0052] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this specification, the same reference numerals are used to denote the same constituent elements, and repeated descriptions are omitted where appropriate.
[0053] [Overview of Magnetic Resonance Imaging (MRI) Devices]
[0054] Figure 1 This is a perspective view showing the appearance of an exemplary MRI apparatus 10. The MRI apparatus 10 includes a gantry 12 and a table 14, which serve as the main body of the imaging device. The gantry 12 has a cylindrical imaging space 18 called a magnet aperture. A static magnetic field generating magnet, a gradient magnetic field coil, and various other coils for generating a magnetic field in the imaging space 18 are arranged on the gantry 12.
[0055] The bed 14 includes a top plate 15 and legs 16 supporting the top plate 15, and is disposed on the front side of the frame 12. The top plate 15 can enter and exit the imaging space 18 via a drive mechanism (not shown) provided on the legs 16. Alternatively, the bed 14 can be a structure fixed to the frame 12, or it can be a movable, dockable bed that can be mounted and detached from the frame 12.
[0056] In the MRI apparatus 10, three apparatus axes are defined as three-dimensional orthogonal coordinate axes encompassing the actual space of the imaging space 18. The orientation of each of the three apparatus axes is uniquely determined by the gantry 12 and the table 14. Figure 1 In the diagram, the Z direction is the direction of the static magnetic field, the Y direction is the vertical direction, and the X direction is the direction orthogonal to both the Y and Z directions.
[0057] Figure 2 This diagram shows a schematic internal structure of the MRI apparatus 10. The MRI apparatus 10 includes: a static magnetic field generating magnet 102, a gradient magnetic field coil 104, an RF (Radio Frequency) transmitting coil 106, a receiving coil 110, a receiver 112, a gradient magnetic field power supply 114, a high-frequency magnetic field generator 116, a timing unit 118, a control unit 120, and an operation unit 122. Furthermore, the MRI apparatus 10 includes a camera 140 for identifying the position of the subject 130.
[0058] A static magnetic field generating magnet 102 generates a uniform static magnetic field in the imaging space 18. The static magnetic field generating magnet 102 includes permanent magnet, conventionally conductive, or superconducting static magnetic field generating sources. A gradient magnetic field coil 104 generates a gradient magnetic field within the imaging space 18. The gradient magnetic field coil 104 consists of gradient magnetic field coils along the three axes (X, Y, and Z) that form the actual spatial coordinate system (stationary coordinate system). Each gradient magnetic field coil is connected to a gradient magnetic field power supply 114 and is supplied with current. Thus, gradient magnetic fields are generated along the three axes (X, Y, and Z).
[0059] The subject 130 is supported on the top plate 15 of the bed 14, and a receiving coil 110 corresponding to the examination area is installed on the subject 130. By moving the top plate 15 supporting the subject 130 into the imaging space 18, the examination area of the subject 130 is located at the center of the static magnetic field within the imaging space 18.
[0060] Camera 140 is an example of a sensor capable of acquiring information related to the position of the subject 130. Camera 140 is typically an optical camera, comprising: a photographic optical system including a lens; and an imaging element that images the optical image formed by the photographic optical system and converts it into an electrical signal. The imaging element is, for example, a CMOS (Complementary Metal-Oxide Semiconductor) type color image sensor. Alternatively, the imaging element is not limited to CMOS; it can also be a CCD (Charge Coupled Device) type image sensor. Furthermore, camera 140 may be configured to include an image processing circuit that processes the electrical signal obtained from the imaging element to digitize it into an image. Camera 140 captures images of the subject 130 on the bed 14, and the subject 130's position is identified based on the images acquired via camera 140. In this specification, the images acquired via camera 140 are referred to as "camera images." Infrared cameras or millimeter-wave cameras may also be used instead of or in combination with camera 140.
[0061] The RF transmitting coil 106 is a coil that irradiates the subject 130 with high-frequency magnetic field pulses, i.e., RF pulses. The RF transmitting coil 106 is connected to the high-frequency magnetic field generator 116 and supplies high-frequency pulse current from the high-frequency magnetic field generator 116.
[0062] The timer 118 sends commands to the high-frequency magnetic field generator 116 and the gradient magnetic field power supply 114 according to the imaging pulse sequence. As a result, the appropriately amplified signals are sent to the RF transmitting coil 106 and the gradient magnetic field coil 104, respectively.
[0063] The high-frequency magnetic field generator 116 is driven according to instructions from the timer 118, modulates the amplitude of high-frequency pulses, and supplies amplified high-frequency pulse current to the RF transmitting coil 106. The RF transmitting coil 106 applies a pulsed high-frequency magnetic field (RF pulse) to the subject 130 according to the signal from the high-frequency magnetic field generator 116. Preferably, the timer 118 sends instructions to the receiving coil 110 according to the imaging pulse sequence and turns off the receiving coil 110 during the application of the RF pulse.
[0064] By applying a high-frequency magnetic field, nuclear magnetic resonance (NMR) is induced in the atomic spins of the biological tissues constituting the subject 130. The receiving coil 110 is a multi-channel RF coil unit comprising multiple coil elements, used to receive the NMR signal generated in the subject 130. Figure 2 The example shown is a blanket receiving coil 110 used for imaging the chest and abdomen, but the type of receiving coil 110 can vary depending on the examination site. For example, receiving coils for the head, spine, abdomen, legs, arms, etc., can be used to image various sites.
[0065] The NMR signal generated from the subject 130 is detected by the receiving coil 110, amplified by a preamplifier (not shown) within the receiving coil 110, and transmitted to the receiver 112. In the receiver 112, the amplified NMR signal undergoes AD (analog-to-digital) conversion and necessary signal processing to generate data. The generated data is sent to the control unit 120. This data is also referred to as the received signal or measurement data.
[0066] A receiver-side cable (not shown) is connected to the receiver coil 110, which outputs the NMR signal received by the receiver coil 110. Figure 2 The diagram is omitted, but a receiver-side connector is connected to the end of the receiver-side cable. The receiver-side connector connects to a bed-side connector located on the bed 14. The bed-side connector connects to a bed-side cable located inside the bed 14, and the bed-side cable connects to the control unit 120. Thus, the receiver coil 110 communicates with the control unit 120 and the sequencer 118.
[0067] In addition, Figure 2 Examples of receiver-side cables, receiver-side connectors, and bedside connectors (not shown) will be described later. Figure 11 The figure shows the receiving-side cable 150, the receiving-side connector 152, and the bedside connectors 20A, 20B, 20C, and 20D connected to the receiving coil 110A.
[0068] The connection between the receiving coil 110 and the control unit 120 and the sequencer 118 is not limited to a wired connection such as a cable, but can also be a wireless connection. In this case, the receiving coil 110 or the bed 14 also includes at least an AD conversion module and a wireless communication module.
[0069] The timer 118 controls each component to operate at pre-programmed times and intensities. In particular, the program that records the timing and intensity of RF pulses, gradient magnetic fields, and signal reception is called a pulse sequence. Various pulse sequences are known depending on the purpose, but their detailed descriptions are omitted here.
[0070] The control unit 120 receives various instruction inputs from the operation unit 122 and centrally controls each part of the MRI apparatus 10 via the timer 118. Before starting MRI imaging, the control unit 120 identifies the patient's position based on camera images captured by the camera 140 and compares the identified position with pre-registered positions to determine the matching degree. Not limited to camera images, the control unit 120 can also identify the patient's position based on coil information such as the type of receiving coil 110 and the position of the bedside connector connected to the receiving-side connector. In this specification, the position identified based on camera images and / or coil information is referred to as the "identified position".
[0071] When the registered body position matches the identified body position, MRI imaging is performed. The control unit 120 performs inverse Fourier transform on the received signal in the spatial frequency region received by the receiver 112 and converts it into an image of the actual space, thereby generating an MRI image. When the registered body position does not match the identified body position, the control unit 120 displays a screen suggesting re-registering the body position based on the identified body position. A detailed example of this pop-up display can be found using... Figures 8-10 This will be described later.
[0072] The operation unit 122 includes input devices such as a mouse and keyboard, and display devices such as an LCD. The operation unit 122 functions as a user interface (UI), allowing users such as technicians to start, stop, and pause the MRI device 10, select pulse sequences, and input imaging or processing conditions.
[0073] The timer 118 and control unit 120 can be configured using a computer. Furthermore, the processing functions of the timer 118 and control unit 120 can be implemented using a computer system that includes multiple computers.
[0074] [Regarding camera 140]
[0075] Figure 2The camera 140 shown is configured to capture images of the subject 130 inserted into the imaging space 18. For example, the camera 140 is configured to capture images of the subject 130 from above within the magnet hole at an angle, obtaining a relatively wide image including the chest of the subject 130. The camera 140 is preferably configured to capture the entire body of the subject 130. A wide-angle lens or a fisheye lens is preferably used in the photographic optics system of the camera 140.
[0076] The camera 140 can be a structure that optically captures continuous images at a frame rate of at least a preset frame rate. For example, it is preferable that the camera 140 can capture more than 30 images per second. Alternatively, the camera 140 can also be a structure that captures still images.
[0077] Since the imaging space 18 of the frame 12 is a structure in which indoor lighting light and other light from the shielded room cannot easily penetrate, when using the camera 140 that captures images inside the magnet hole, in order to improve the signal-to-noise ratio (SNR) of the image of the camera 140, it is preferable to equip the imaging space 18 with an illumination device for illuminating light.
[0078] Furthermore, the camera 140 has a structure that shields electromagnetic noise, so that the frame 12 will not generate noise due to the electromagnetic noise generated by the camera 140.
[0079] Furthermore, the camera 140 has a structure that shields these magnetic fields and high frequencies, so that it can function as a camera even when subjected to a static magnetic field generated by the static magnetic field generating magnet 102, a gradient magnetic field that varies greatly over time applied by the gradient magnetic field coil 104, and a high-frequency magnetic field pulse (RF pulse) irradiated from the RF transmitting coil 106.
[0080] exist Figure 2 The image shows an example where a camera 140 is installed on the entrance side when the subject 130 is inserted into the magnet hole in the rack 12, but the configuration and number of cameras 140 are not limited to this example. Figure 2 Examples. For example, such as Figure 3 As shown, the structure can have cameras 140 and 141 respectively arranged on the entrance side and inside side of the magnet hole, or it can have a camera 141 arranged only on the inside side of the magnet hole. By using multiple cameras to capture images of the subject 130 from multiple directions, the position of the subject 130 can be identified with good accuracy.
[0081] As another example of camera configuration, a camera can be positioned outside the magnet hole, instead of cameras 140, 141, or in combination with them, to capture images of the magnet hole. For example, a configuration could be such that a camera is positioned on the upper part of the front side (the side facing the bed) of the frame 12 to capture images of the subject 130 before or during its movement into the magnet hole. Furthermore, the camera can be mounted on the ceiling or wall of the shielded room.
[0082] [Hardware structure of information processing device]
[0083] Figure 4 This is a block diagram illustrating an example of the hardware structure of the information processing device 200 used in the MRI apparatus 10. The information processing device 200 can be a personal computer, a workstation, or a server computer. The computer can also be a virtual machine. The information processing device 200 is applied to the control console of the MRI apparatus 10 and can serve as a control unit 120 and an operation unit 122 (see reference). Figure 2 It functions as a timer. The information processing device 200 can function as a timer 118.
[0084] The information processing device 200 includes a processor 202, a memory 204 as a main storage device, a storage device 206 as an auxiliary storage device, an input / output interface 208, and a bus 210.
[0085] Processor 202 includes a CPU (Central Processing Unit). Processor 202 may include a GPU (Graphics Processing Unit). Furthermore, processor 202 may be configured as one or more hardware devices including a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), and a PLD (Programmable Logic Device).
[0086] The processor 202 is connected to the memory 204, storage device 206, input / output interface 208, input device 212 and display device 214 via bus 210.
[0087] Memory 204 includes RAM (Random Access Memory). Memory 204 may include ROM (Read Only Memory). Storage device 206 may be, for example, a hard disk drive (HDD) or a solid state drive (SSD) or a combination thereof. Furthermore, storage device 206 may include external storage devices such as removable media.
[0088] The storage device, including memory 204 and storage device 206, stores programs and data that implement various functions of the MRI apparatus 10. The processor 202 implements various functions by executing the programs stored in memory 204. The processor 202 centrally controls and performs various processes on the various parts of the information processing device 200, the various devices and units of the MRI apparatus 10, etc.
[0089] The input / output interface 208 includes a communication interface for connecting to telecommunications lines such as a local area network (LAN) and a connection interface for connecting to external devices. For example, the connection interface for connecting to external devices can utilize Universal Serial Bus (USB) or HDMI (High-Definition Multimedia Interface) (HDMI is a registered trademark).
[0090] The processor 202 communicates with various devices of the MRI apparatus 10 via the input / output interface 208, thereby receiving and sending the required information.
[0091] The input device 212 may consist of, for example, a keyboard, a mouse, a numeric keypad, and various switches and buttons. The input device 212 may include a voice input device. Furthermore, the input device 212 may also be a touch panel type input device integrated with the display screen of the display device 214.
[0092] Display device 214 may be, for example, a liquid crystal display, an organic electroluminescence (OEL) display, a projector, or a suitable combination thereof. In addition to the MRI images imaged by the MRI device 10, display device 214 also displays various information such as camera images and coil information. Display device 214 serves as part of the user interface when receiving input from input device 212. Furthermore, display device 214 is not limited to a single device; it may also be a multi-monitor configuration with multiple display devices.
[0093] [Summary of MRO imaging procedures]
[0094] The typical imaging procedure performed using the MRI device 10 is roughly as follows.
[0095] [Step 1] Technicians and other users use input devices 212 such as a mouse and keyboard to register the patient's information, imaging site, patient's position, imaging plan, and other information required for the examination on the patient registration screen. The term "registration" includes the concept of "setting". The term "user" includes the concepts of technicians, operators, and other related terms.
[0096] The subject information includes the subject's name, subject code, etc. The subject's position includes the insertion direction of the subject 130 into the gantry 12 and the subject's posture. The imaging plan includes the imaging type and sequence, etc. Some or all of this information required for the examination can be manually entered by the operator via the input device 212, or information pre-stored in a recording medium, etc. Furthermore, the parameters set automatically or entered are ultimately confirmed by the operator and manually set as needed via the input device 212.
[0097] [Step 2] The subject 130 is supported on the top plate 15 of the bed 14, and the receiving coil 110 is installed on the subject 130. The user connects the receiving-side connector of the receiving-side cable connected to the receiving coil 110 to the bed-side connector on the top plate 15. Furthermore, multiple bed-side connectors are provided on the top plate 15. Depending on the type of receiving coil 110 used and the position of the subject 130, the receiving-side connector is connected to the nearest bed-side connector. The position of the bed-side connector that can be connected to the receiving-side connector is limited depending on the combination of the type of receiving coil 110 and the position of the subject 130.
[0098] [Step 3] After connecting the receiving coil 110 to the bedside connector, use the rack operation panel (not shown) or foot switch to move the top plate 15 to the imaging space 18 and move the subject 130 to the center of the static magnetic field of the rack 12.
[0099] [Step 4] Then, the user presses the start button indicating that imaging has begun, thereby executing a scan image imaging process to acquire a positioning image. In the scan image imaging, multiple slices are imaged from one or more sections in the axial plane, coronal plane, and sagittal plane. Furthermore, the slice thickness in the scan image imaging can be set to a value greater than the slice thickness in the actual imaging. When an instruction to start imaging is received, an inspection window screen is displayed on the display device 214 of the operation unit 122.
[0100] [Step 5] After the scanning image is completed, the positioning image is reconstructed and displayed on the display device 214.
[0101] [Step 6] The user sets the imaging position for the formal imaging based on the scanned image. In the MRI device 10, the imaging position, including the slice position (section position) measured by the formal imaging, is automatically calculated based on the scanned image, and a recommended imaging position is suggested to the user. The user confirms the suggested slice position, etc., and manually adjusts the imaging position as needed via the input device 212 of the operation unit 122. Furthermore, the user sets the imaging parameters applied to the formal imaging. Some or all of the imaging parameters can be input by the user via the operation unit 122, or they can be set automatically or input manually. Regarding the automatically set (automatically input) parameters, the operator ultimately confirms them and manually sets them as needed via the input device 212 of the operation unit 122.
[0102] [Step 7] Perform formal imaging according to the imaging parameters and imaging position set as described above.
[0103] [Step 8] After the formal imaging, the image is reconstructed and displayed on the display device 214.
[0104] [Step 9] For the displayed reconstructed image, the user sets a window value suitable for diagnosis via input device 212 and obtains an image for diagnosis.
[0105] [Step 10] After imaging is completed, remove the top plate 15 from the imaging space 18 and remove the subject 130 from the gantry 12. Then, help the subject 130 off the bed 14 to end the MRI examination.
[0106] [Example 1 of the display on the control panel: Example of a candidate registration screen]
[0107] Figure 5 This is an example of a patient registration screen 400. The patient registration screen 400 is used to register information related to the patient 130 and the examination content. The patient registration screen 400 includes: a patient information area 401 for registering patient information, an examination site area 402 for registering the examination site, a position registration area 403 for registering the patient 130's position, an examination condition area 404 for registering examination conditions, a plan area 405 for registering the imaging plan, and a button area 406.
[0108] The subject information area 401 is used to display information identifying the subject 130 and information related to the attributes of the subject 130. The examination site area 402 is used to display information related to the examination site specified in the examination instructions. The subject 130's position is generally divided into head-in or feet-in, and head-in or feet-in is further subdivided into supine, prone, right lateral, or left lateral positions.
[0109] The position registration area 403 includes eight icons corresponding to each of the eight positions. The subject 130's position is registered by selecting the appropriate icon. The selected position's icon is visually distinguished from other unselected icons through highlighting or other differentiated display methods. The subject 130's position can be automatically set by associating it with the examination site or imaging scheme specified in the examination instructions, or it can be manually selected by the user.
[0110] The inspection conditions area 404 includes a button for selecting whether to perform the inspection in standard operating mode or in first-level management operating mode.
[0111] The imaging scheme corresponding to the inspection instructions specified in the inspection command is displayed in scheme area 405.
[0112] Button section 406 includes, for example, an appointment button, a button for making an appointment and registering the next appointment, a check window start button 410, a cancel button, etc. The examinee registration screen 400 is an example of a "registration screen" in this invention.
[0113] After registering the necessary information on the subject registration screen 400, if the user presses the inspection window start button 410, the system will switch to the inspection window screen. Furthermore, regarding GUI (Graphical User Interface) buttons, the terms "press" or "press" encompass the action of inputting the corresponding instruction through actions such as clicking, touching, selecting, or specifying.
[0114] [Example 2 of display on the console: an example of inspecting the window screen]
[0115] Figure 6 This is an example of the inspection window screen 500. The inspection window screen 500 is a screen used to perform a series of tasks defined in the imaging protocol. The inspection window screen 500 includes: a toggle tab 501, a subject information area 502, a protocol area 503, a series list 504, a menu bar 505, a toolbar 506, a task execution screen 507, a start button 508, a stop button 509, and an imaging conditions area 510.
[0116] The subject's name is displayed in the label section of the switching label 501. The attribute information of the subject 130 registered in the subject information area 401 of the subject registration screen 400 is displayed in the subject information area 502.
[0117] The task execution screen 507 includes an image display area 512 for displaying MRI images obtained through imaging. Before imaging begins, no MRI images are obtained to be displayed in the image display area 512; therefore, the image display area 512 can be a blank state without any MRI images displayed. MRI images obtained by imaging the subject 130 are displayed in the image display area 512. Multiple images, such as images of different cross-sections, can be displayed side-by-side in the image display area 512. Furthermore, Figure 6 The image display area 512 shown is an example of an area used to read and display the positioning images acquired through scanning imaging, namely, the axial plane image, the coronal plane image, and the sagittal plane image. The MRI images acquired through imaging can be automatically displayed in the image display area 512.
[0118] [Regarding the method for switching from the examinee registration screen 400 to the examination window screen 500]
[0119] Not limited to the following methods: press the examination window start button 410 in the subject registration screen 400 to switch to the examination window screen 500, and press the start button 508 in the examination window screen 500 to input the instruction to start imaging.
[0120] A start button 508 can be configured on the subject registration screen 400, and when the start button 508 is pressed on the subject registration screen 400, the examination window screen 500 can be switched.
[0121] [Summary of the medical imaging support method involved in the implementation]
[0122] When the start button 508 or other device is pressed to indicate the start of imaging and the screen switches to the inspection window 500, the information processing device 200 uses the camera image or other means to identify the actual body position of the subject 130. If a body position different from the pre-registered body position of the subject 130 is identified, imaging is stopped and a suggestion to re-register the body position is displayed on the inspection window 500.
[0123] Figure 7This is a flowchart illustrating an example of an action performed using the MRI device 10. In step S60, the user registers imaging conditions such as the patient's position on the patient registration screen 400. That is, in step S60, the processor 202 displays the patient registration screen 400 on the display device 214 and accepts the registration of imaging conditions, including the patient's position.
[0124] After registering the required examination information on the subject registration screen 400, in step S61, the user places the subject 130 on the bed 14. That is, as described above, the subject 130 is placed so that the part to be examined is positioned at the center of the static magnetic field of the frame 12.
[0125] Then, in step S62, the processor 202 displays the inspection window screen 500 on the display device 214 and receives an instruction to start imaging. The transition from the subject registration screen 400 to the inspection window screen 500 can be performed in response to user operations such as pressing the inspection window start button 410, or it can be performed automatically based on signals from sensors such as those detecting the opening and closing of the shielded room door.
[0126] The instruction to start imaging can be issued by pressing the start button 508, or it can be triggered by pressing the physical imaging start button on the control panel, pressing the imaging start button on the rack monitor, pressing the imaging start button on the rack operation panel, or closing the shielded room door.
[0127] In step S63, if the processor 202 receives an instruction to start imaging via the user pressing the start button 508, etc., then proceeds to step S64. Furthermore, the order of steps S60 to S64 can be changed. For example, if the examination window start button 410 is pressed during registration in step S60, the examination window screen 500 of step S62 can be displayed immediately, and then step S61 can be performed. Also, for example, the patient 130 can be placed on the bedside table 14 in step S61 first, followed by registration in step S60. Also, for example, in cases of emergency patients, two technicians can simultaneously perform steps S60 and S61. Also, for example, step S64 can be performed immediately after the patient 130 is placed on the bedside table 14 in step S61. Furthermore, for example, a start button can be set on the subject registration screen 400, and an instruction to start imaging can be received on the subject registration screen 400. When the instruction to start imaging is received, the processor 202 can switch to the inspection window screen 500.
[0128] In step S64, the processor 202 identifies the body position of the subject 130 from the camera image. For example, the processor 202 analyzes the camera image and identifies whether the insertion direction of the subject 130 relative to the frame 12 is head-first or feet-first, and whether the subject 130's lying position is supine, prone, left lateral, or right lateral.
[0129] Regarding image recognition technology for identifying the body position of the subject 130 from camera images, for example, methods utilizing machine learning-based category classification algorithms, object detection algorithms, or region detection algorithms can be applied. Methods utilizing pattern matching image recognition processing or optical flow calculation for body feature detection, or appropriate combinations of these methods, can also be used. Furthermore, regarding techniques for calculating optical flow from camera images and selecting regions of interest, for example, the technique described in Japanese Patent Application Publication No. 2022-104170 can be applied. By detecting regions of at least one, preferably multiple body parts such as the head, chest, arms, and legs of the subject 130 from the camera image, the body position of the subject 130 can be identified based on the distribution of the body part regions shown in the detection results.
[0130] The body position recognition processing is not limited to camera images; coil information from the receiving coil 110 connected to the MRI device 10 can also be used. The coil information includes the type of receiving coil 110 and the position information of the bedside connector connected to the receiving side connector, etc.
[0131] The processor 202 can identify the body position of the subject 130 based on at least one of the camera image and connector information. The processor 202 can also use both the camera image and connector information to identify the body position of the subject 130.
[0132] In step S65, the processor 202 compares the registered body position with the identified body position and determines whether the registered body position and the identified body position are consistent. If the registered body position and the identified body position are consistent, the process proceeds to step S68 and imaging begins. Thus, imaging is performed according to the imaging plan.
[0133] On the other hand, in the determination of step S65, if it is determined that the registered body position is inconsistent with the identified body position, then proceed to step S66.
[0134] In step S66, the processor 202 displays a pop-up screen suggesting re-registering the body position (see reference). Figure 8 and Figure 9 The processor 202 displays, for example, on the inspection window screen 500. Figure 8Such a pop-up screen 600 prompts the user to re-register their position. The term "screen" includes the concept of an image displayed on the display surface of a display device such as display device 214. Furthermore, the term "screen" is not limited to a full screen that is entirely consistent with the physical area of the display surface of the display device, but also includes the concept of a sub-screen or sub-window displayed in an area smaller than the entire screen.
[0135] In step S67, the processor 202 receives the re-registration of the subject 130's position from the pop-up screen 600. In step S67, if the user confirms the subject 130's position and performs the re-registration of the position or indicates an intention to continue imaging without changing the position, then the process proceeds to step S68 and imaging begins.
[0136] Additionally, if the registered body position is correct, but the actual body position of the subject 130 placed on the bed 14 is incorrect, the user can press the stop button 509 or similar button to stop the imaging process. At this time, the process returns to step S61 and the subject 130 in the imaging space 18 is reset.
[0137] After imaging begins in step S68, imaging is performed according to the imaging plan. Once imaging is complete (step S69), the process ends. Figure 7 The flowchart.
[0138] [Example 1 of pop-up screen display]
[0139] Figure 8 This is an example of a pop-up screen 600 that appears on the inspection window screen 500. The pop-up screen 600 includes: action message 601, currently registered body position 602, and suggested body position 603, prompting the user to confirm and re-register the body position of the examinee 130.
[0140] Action message 601 is used to notify the user that the registered body position is inconsistent with the recognized body position and prompts the user to re-register the body position. For example, it could be a message like this: "A body position different from the registered body position has been detected. Please stop imaging and register the correct body position."
[0141] The pop-up screen 600 is configured as a partial screen including the subject registration screen 400, providing the same GUI as the position registration area 403, which is part of the subject registration screen 400. That is, similar to the position registration area 403, the pop-up screen 600 displays icons corresponding to each of the eight candidate positions, and highlights the icon of the currently registered position 602. Furthermore, in the pop-up screen 600, the icon of the suggested position 603 recommended from the identified positions is displayed differently, allowing it to be visually distinguished from the currently registered position 602 and other unrecommended icons.
[0142] Differentiation methods can include, for example, emphasizing the border around the icon, making the icon blink, or highlighting it with a different background color than other icons. Thus, in the pop-up screen 600, preferably after all the candidate positions are suggested, the currently registered position 602 is displayed using the first differentiation method, and the suggested position 603 is displayed using the second differentiation method, which is different from the first differentiation method. The suggested position 603 is a position that is recommended to be re-registered from the currently registered position 602, and is an example of "suggested re-registration" in this invention.
[0143] Users can re-register a position that matches the identified position by selecting the suggested position 603 icon. Additionally, pressing the suggested position 603 icon displays a confirmation pop-up (not shown) and provides instructions on whether to proceed with or cancel the re-registration.
[0144] Furthermore, the pop-up screen 600 includes a continue imaging button 604 for continuing imaging without changing the currently registered body position or stopping imaging. The continue imaging button 604 is an example of a "button indicating continued imaging" in this invention.
[0145] In addition, although Figure 8 It is not shown in the image, but it may also be displayed on the pop-up screen 600 as a basis for the suggestion, such as a camera image or coil information of the receiving coil 110 connected to the bed 14, or both.
[0146] [Example of the location displayed in the pop-up window]
[0147] Figure 9 This is an example of a screen showing the display position of a pop-up screen 600 on an examination window screen 500. The pop-up screen 600 pops up and displays within the image display area 512 of the examination window screen 500. The image display area 512 is a region located in the central part of the examination window screen 500, which is a blank (no image) state before imaging is performed.
[0148] By displaying a pop-up screen 600 within a predetermined image display area 512 that displays MRI images after imaging, it is possible to suggest and accept re-registration of patient positions without concealing patient information, protocol information, series information, imaging parameters, and other setting information.
[0149] The image display area 512 is considered to be the portion of the screen that the user is focusing on because they expect to see the MRI image acquired through imaging. Since the portion of the screen in the inspection window 500 that the user is focusing on, i.e., the image display area 512, is the area where the user's attention is concentrated, it is a preferred location for displaying the pop-up screen 600.
[0150] Furthermore, the pop-up screen 600 is not limited to being displayed as a single pop-up window; it can also be displayed as multiple windows or GUI components. For example, the motion message 601 can be displayed in a different window than the position re-registration window, and GUI components such as the continue imaging button 604 can be configured outside the position re-registration window.
[0151] [Example 2 of pop-up screen display]
[0152] exist Figure 8 and Figure 9 The example described above illustrates how a pop-up window 600 (as a smaller sub-window than the inspection window 500) overlaps with a portion of the inspection window 500. However, a full-screen pop-up window 600 can also be used instead. For example, a full-screen pop-up window 600 could be displayed as shown below. Figure 9 The pop-up screen 600 shown can also display other pop-up screens in full screen (including part or all of the content displayed in pop-up screen 600).
[0153] As a pop-up window, the examinee's registration screen can be displayed in full screen (400Hz). At this time, it is... Figure 8 Similarly, in the position registration area 403 of the pop-up subject registration screen 400, action message 601 is displayed, and the icon of suggested position 603 is displayed differently by comparing it with the currently registered position 602.
[0154] [Regarding the display indicating that body position is being recognized based on camera images]
[0155] When the examination window screen 500 is switched to, during the period until the patient's orientation is identified based on the camera image, information indicating that identification is being performed using the camera image can be displayed on the examination window screen 500, such as "detecting patient orientation".
[0156] [Example when body position cannot be identified from camera image]
[0157] When the subject's position cannot be identified from the camera image, instead of displaying a pop-up screen 600 that includes a suggested position 603, the camera image can be displayed on the examination window screen 500. In this case, it is not limited to a camera image; when coil information is present, a structure that displays coil information in addition to the camera image is preferred.
[0158] Figure 10This is an example of displaying a screen that includes camera images and coil information. When the body position of the subject 130 cannot be identified based on the camera image, the processor 202 will, for example, display the following: Figure 10 The pop-up screen 700 shown appears on the inspection window screen 500. Pop-up screen 700 is an example of "screen including information obtained from sensors" in this invention.
[0159] The pop-up screen 700 includes: motion message 701, camera image 702, coil information 703, body position registration area 706, and OK button 707.
[0160] Action message 701 is a message that notifies the user that the patient's position cannot be recognized and prompts the user to confirm the position. For example, it may display as follows: "The patient's position could not be recognized. Please confirm the patient's position or make a change."
[0161] In the display area of camera image 702, the live video captured by camera 140 can be displayed. In the display area of coil information 703, for example, the position of the bedside connector 704 to which the receiving side connector of receiving coil 110 is connected can be illustrated. Furthermore, in the display area of coil information 703, the coil name 705 indicating the type of receiving coil 110 used can be displayed.
[0162] The coil information 703 can be structured as follows: displaying information indicating the location of the bedside connector 704 connected to the receiving side connector and the coil name 705, or only one of them can be displayed.
[0163] The position registration area 706 provides the same GUI as the position registration area 403 of the subject registration screen 400, and highlights the icons of currently registered positions. Icons of other positions are displayed as candidates for re-registration. Users can select the desired position icon from the position registration area 706 to change their registered position.
[0164] The OK button 707 is used to close the pop-up screen 700. The user can press the OK button 707 after changing the registered body position, or without changing the registered body position. If the OK button 707 is pressed, imaging will begin.
[0165] [An example of a method for recognizing body position based on coil information]
[0166] [Using head and neck nerve coils]
[0167] Figure 11 This is a plan view of a bed 14 that carries a subject 130, on which a receiving coil 110A, which serves as a nerve coil for the head and neck, is installed. Figure 11The upward direction is the direction of bed movement when the subject 130 enters the magnet hole of the frame 12. Multiple bed-side connectors 20A, 20B, 20C, and 20D are provided on the top plate 15. Figure 11 The image shows an example where bedside connectors 20A, 20B, 20C, and 20D are arranged at the four corners of the top plate 15, but the number and arrangement of bedside connectors are not limited to this. Figure 11 The arrangement is shown. Bedside connectors 20A, 20B, 20C, and 20D are examples of "multiple connectors" in this invention.
[0168] Bedside connectors 20A, 20B, 20C, and 20D each have the same shape and can be connected to the receiver-side connector 152, which has a receiving coil 110. Figure 11 The diagram shows the state in which the receiving coil 110A, which is a coil for the head and neck, is connected to the bedside connector 20A via the receiving side cable 150 and the receiving side connector 152.
[0169] The head and neck receiving coil 110A is a special specification for the supine position and is fixed to the bed 14 near the frame 12. The user can connect the receiving side connector 152 of the receiving coil 110A to the bed 14 side connector 20A or bed 14 side connector 20B on the top plate 15.
[0170] If the receiver-side connector 152 of the receiver coil 110A is connected to any one of the bedside connectors 20A, 20B, 20C, and 20D, the processor 202 acquires information indicating the type of the connected receiver coil 110A and the position of the connected bedside connector, and determines the body position of the subject 130 based on the acquired coil information.
[0171] The processor 202 can automatically identify the receiving coil 110A connected to the bedside 14 and determine the position of the connected bedside connectors 20A, 20B, 20C, or 20D by using a plug-and-play function. Furthermore, for example, if the bedside connectors 20A, 20B, 20C, and 20D are respectively connected to a connection detection circuit for detecting the connection of the receiving connector 152, the processor 202 can detect the position of the bedside connectors 20A, 20B, 20C, or 20D connected to the receiving connector 152 based on signals from the connection detection circuit.
[0172] Information regarding the type of the receiving coil 110A connected to the bed 14 can be obtained by the processor 202 through digital communication, or through barcode reading, electronic tag reading, or image recognition. The circuitry for automatically identifying the receiving coil 110A connected to the bed 14 and generating the required signal, the connection detection circuitry, and the information reading device are examples of the "sensor for acquiring information for identifying the subject's position" in this invention.
[0173] The term "sensor" is interpreted broadly to include mechanisms that automatically identify the connected receiving coil 110A by transmitting information between devices when the connector is connected, or to detect the bedside connector 20A connected to the receiving coil 110A.
[0174] The correspondence between coil information and the body position of the subject 130 can be predetermined in advance using a table or the like, based on the specifications of the receiving coil 110. This table defining the correspondence is stored in a memory 204 or similar storage device, and the processor 202 can identify the body position of the subject 130 by referring to the table of correspondences and the acquired coil information.
[0175] like Figure 11 As shown, according to the specifications of the head and neck nerve coil, when the receiving coil 110A is connected to the bedside connector 20A, the subject 130 is identified as being in a head-first, supine position. Additionally, the receiving coil 110A can also be connected to the bedside connector 20B; when the receiving coil 110A is connected to the bedside connector 20B, it is also similarly identified as being in a head-first, supine position.
[0176] exist Figure 11 The example shown is a neural coil, but the receiving coil 110 can include, in addition to neural coils, spinal coils, torso coils, foot and ankle coils, hand coils, shoulder coils, and breast coils. Furthermore, depending on the type of receiving coil 110, it may be difficult to uniquely identify the body position. Therefore, a structure that uses both camera images and coil information to identify the body position of the subject 130 is preferred.
[0177] [Functional structure of information processing device 200]
[0178] Figure 12 This is a block diagram illustrating the functional structure of an information processing apparatus 200 used to implement the medical imaging support method involved in the embodiments.
[0179] The information processing device 200 includes: a subject registration screen generation unit 220, a registration information receiving unit 224, an imaging condition registration unit 226, an imaging control unit 228, a camera image acquisition unit 230, a coil information acquisition unit 232, a body position recognition unit 234, a matching determination unit 236, an inspection window generation unit 240, a pop-up generation unit 242, a re-registration receiving unit 246, an image processing unit 250, and a display control unit 260.
[0180] The functions of each processing unit in the information processing device 200 can be realized by the processor 202 executing the program stored in the memory 204.
[0181] The subject registration screen generation unit 220 generates the subject registration screen 400. The subject registration screen generation unit 220 includes a body position registration GUI module 222. The body position registration GUI module 222 is a module that constitutes the GUI of the body position registration area in the subject registration screen 400, and includes components that implement the display of icons corresponding to each of the 8 body positions.
[0182] The registration information receiving unit 224 receives information to be pre-registered via the patient registration screen 400. The user can operate the input device 212 to input the required information. Furthermore, the registration information receiving unit 224 can obtain a portion of the imaging conditions from electronic medical record systems, ordering systems, or radiology information systems (RIS) not shown in the figure.
[0183] The imaging condition registration unit 226 includes a position registration unit 227, which registers imaging conditions acquired via the registration information receiving unit 224, including the examination site, imaging plan, subject position, and various imaging parameters. Pre-registered positions (registered positions) are registered in the position registration unit 227.
[0184] The inspection window generation unit 240 generates an inspection window screen 500. The camera image acquisition unit 230 acquires camera images from the camera 140. The coil information acquisition unit 232 acquires coil information from the receiving coil 110 connected to the bed 14.
[0185] The body position recognition unit 234 identifies the body position of the subject 130 based on at least one of camera images and coil information. The body position recognition unit 234 includes an image recognition processing unit that analyzes camera images to identify the body position of the subject 130. In image recognition techniques for identifying the body position of the subject 130 based on camera images, machine learning algorithms can be applied, for example. That is, the body position recognition unit 234 may be a structure including a trained model, which has been trained through machine learning to identify the body position of the subject 130 from camera images. The trained model may, for example, be constructed using a convolutional neural network, and may be a classification model for classifying body position categories. The trained model is not limited to a classification model; it may also be a model for tasks such as object detection or region classification (semantic segmentation), and may also identify body parts such as the head, abdomen, arms, and legs of the subject 130 from camera images and identify the body position based on body structure. Furthermore, the trained model is essentially a program.
[0186] Furthermore, the body position recognition unit 234 can calculate the optical flow representing the movement of the subject 130 between frames based on the camera image, and identify the body position of the subject 130 based on the calculation result of the optical flow.
[0187] Furthermore, the body position recognition unit 234 can also recognize the body position of the subject 130 based on the coil information. The body position recognition unit 234 has a table as shown below, and can recognize the body position based on the acquired coil information and by referring to the table. The table specifies the correspondence between the combination of the type of receiving coil and the position of the bedside connector connected to the receiving side connector and the body position of the subject.
[0188] The matching determination unit 236 compares the registered body positions in the body position registration unit 227 with the identified body positions identified by the body position recognition unit 234 to determine the matching degree.
[0189] Pop-up generation unit 242 generates pop-up screens 600 and 700. When the matching determination unit 236 determines that the registered body position and the recognized body position are inconsistent, pop-up generation unit 242 outputs pop-up screen 600 on the inspection window screen 500. Pop-up generation unit 242 includes a re-registration suggestion generation unit 243. The re-registration suggestion generation unit 243 displays the body position corresponding to the recognized body position identified by the body position recognition unit 234 as a suggested body position on pop-up screen 600. Furthermore, when the body position recognition unit 234 cannot recognize the body position of the examinee 130, pop-up generation unit 242 outputs pop-up screen 700 on the inspection window screen 500.
[0190] The re-registration receiving unit 246 accepts the re-registration of the examinee 130's body position via pop-up screen 600 or pop-up screen 700. The user can operate the input device 212 to perform re-registration from pop-up screen 600.
[0191] The imaging control unit 228 controls MRI imaging according to instructions from the input device 212. The imaging control unit 228 performs MRI imaging based on imaging conditions registered in the imaging condition registration unit 226.
[0192] The image processing unit 250 performs image reconstruction processing based on measurement data obtained from imaging the subject 130 to generate an MRI image. The examination window generation unit 240 reads the MRI image generated by the image processing unit 250 and outputs it to the image display area 512.
[0193] The display control unit 260 generates display data for the display device 214. Display data such as the subject registration screen 400 generated by the subject registration screen generation unit 220, the inspection window screen 500 generated by the inspection window generation unit 240, and the pop-up screen 600 or 700 generated by the pop-up generation unit 242 are displayed on the display device 214 via the display control unit 260.
[0194] [About the processor]
[0195] In this embodiment, each process is executed by any computer. Furthermore, any computer can execute these processes via a processor, a program, or a combination thereof. This arbitrary computer can be a general-purpose computer, a special-purpose computer, a workstation, or other hardware components capable of executing programs.
[0196] A processor can be composed of one or more hardware components, and the type of hardware is not limited. For example, a processor can be composed of programmable logic devices such as CPU (Central Processing Unit), MPU (Micro Processing Unit), FPGA (Field Programmable Gate Array), special-purpose circuits such as ASIC (Application-Specific Integrated Circuit) for performing specific processing, GPU (Graphics Processing Unit), or NPU (Neural Processing Unit).
[0197] Furthermore, the processor has units or means that execute various processes in this embodiment. The hardware can be a combination of different types of hardware. When multiple hardware components are configured to execute one or more processes of a processor, these multiple hardware components can exist in physically separate devices or in the same device. In any embodiment, the order of the processes performed by the processor is not limited to the order described above and can be appropriately changed. Additionally, the hardware is composed of circuits, such as those combining semiconductor elements.
[0198] Furthermore, this embodiment can also be implemented using hardware, software, firmware, microcode, or a combination thereof. Software, firmware, and microcode consist of programs. Furthermore, a program can be, for example, a group of program modules, each of which can be implemented by a processor configured to perform its respective function. A program can be program code or multiple code segments stored in one or more non-transitory computer-readable media (e.g., storage media or other storage devices). A program can be segmented and stored in multiple non-transitory computer-readable media (existing in physically separate devices). Program code or code segments can represent any combination of steps, functions, subroutines, routines, subroutines, modules, software packages, classes, or instructions, data structures, or program statements. Program code or code segments can be connected to other code segments or hardware circuitry by receiving and sending information, data, arguments, parameters, or the contents of memory.
[0199] [Examples of applications for programs and program products]
[0200] The medical imaging support method described in the embodiments can be configured as a program or program product that enables a processor or a computer including a processor to perform the functions of each step. A program product refers to a tangible and non-transitory information storage medium, i.e., a computer-readable medium, that records a program.
[0201] It is possible to record part or all of the program that enables the computer to perform the processing functions in the information processing device 200 on an optical disc, magnetic disk or semiconductor memory, or other tangible and non-transitory storage medium, i.e., a computer-readable medium, and to provide the program through such storage medium.
[0202] Furthermore, it can also replace the method of providing the program by storing it in such a tangible and non-transitory computer-readable medium, and provide the program signal as a download service using telecommunications lines such as the Internet.
[0203] Furthermore, some or all of the processing functions in the information processing device 200 can be realized through cloud computing, and it can also be provided as SaaS (Software as a Service).
[0204] [Effects of the Implementation Method]
[0205] The MRI device 10 according to the embodiment can achieve the following effects.
[0206] (1) When switching from the subject registration screen 400 to the examination window screen 500, if a body position different from the registered body position is identified based on camera images or the like, a pop-up screen 600 including a suggested body position 603 for re-registration is displayed on the examination window screen 500. Thus, the user can determine whether the suggested body position 603 is appropriate and easily re-register from the pop-up screen 600.
[0207] (2) In the pop-up screen 600, a suggested body position 603 is displayed, reflecting the identified body position. Therefore, the user can re-register the appropriate body position that matches the identified body position through a simple operation.
[0208] (3) The patient can re-register their position from the pop-up screen 600 on the examination window screen 500 without having to return from the examination window screen 500 to the patient registration screen 400, which improves convenience.
[0209] (4) Since the pop-up screen 600 provides the same GUI as the position registration area 403 of the subject registration screen 400, the user can re-register the position with a similar feeling to the subject registration screen 400 without feeling uncomfortable.
[0210] (5) The MRI device 10 can improve user convenience and can image the MRI image of the subject 130 by means of appropriate body position.
[0211] [Variation Example 1]
[0212] The pop-up screen 600 may include a stop button 509 indicating that imaging has been stopped. Furthermore, the pop-up screen 600 may include the same button as the confirm button 707.
[0213] [Variation Example 2]
[0214] The MRI device 10 is an example of a medical imaging device. It is not limited to the tunnel-type MRI device 10 with a cylindrical magnet aperture; for example, the technology of the present invention can also be applied to medical imaging devices such as open MRI devices with open apertures, CT (Computed Tomography) devices, PET (Positron Emission Tomography) devices, or X-ray fluoroscopy diagnostic devices. Medical images obtained by the medical imaging device can be two-dimensional or three-dimensional images.
[0215] [Variation Example 3]
[0216] In the above embodiment, eight positions were shown as candidates for the subject 130's position, but depending on the type of medical imaging device, only a portion of these positions may be candidates. For example, only the head-first and feet-first positions may be considered.
[0217] 〔other〕
[0218] This invention is not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the invention.
Claims
1. A medical imaging device for imaging medical images of a subject, The medical imaging device includes: Sensors acquire information for identifying the subject's body position; and processor, The processor performs the following processing: The registration screen for registering the body position of the examinee is displayed on the display device; Accept the instruction to begin imaging of the subject in the registered position; The subject's body position is identified based on the information obtained from the sensor; and When switching from the registration screen to the examination window screen, which includes an image display area for displaying the medical images, if the identified body position is different from the registered body position, a pop-up screen with a suggestion to re-register the body position is displayed on the examination window screen.
2. The medical imaging device according to claim 1, wherein, The sensor includes a camera. The information used to identify the subject's position includes images captured by the camera.
3. The medical imaging device according to claim 1 or 2, comprising: The bed table has a top plate for supporting and moving the subject; and The frame has an imaging space, into which the subject is inserted by movement of the top plate.
4. The medical imaging device according to claim 3, wherein, The bed table has multiple connectors, and a receiving coil for receiving signals emitted by the subject is connected to these connectors. The sensor detects at least one of the position of the connector to which the receiving coil is connected and the type of the receiving coil.
5. The medical imaging device according to claim 1 or 2, wherein, The pop-up screen includes a portion of the registration screen.
6. The medical imaging device according to claim 1 or 2, wherein, The processor accepts the re-registration of the examinee's body position on the pop-up screen.
7. The medical imaging device according to claim 1 or 2, wherein, The registration screen is used to accept registration of imaging conditions, including the subject's position, and registration of the subject's information.
8. The medical imaging device according to claim 1 or 2, wherein, The pop-up screen displays the registered positions and suggested positions for re-registration.
9. The medical imaging device according to claim 1 or 2, wherein, The processor performs the following processing: The suggested body position corresponding to the identified body position will be displayed on the pop-up screen.
10. The medical imaging device according to claim 1 or 2, wherein, A button indicating that imaging should continue is displayed on the pop-up screen.
11. The medical imaging apparatus according to claim 1 or 2, wherein, The processor performs the following processing: The pop-up screen is displayed within the image display area of the inspection window.
12. The medical imaging device according to claim 1 or 2, wherein, The processor performs the following processing: When the examination window is displayed, information indicating that the body position is being identified is displayed on the examination window until the identification of the subject's body position is completed.
13. The medical imaging device according to claim 1 or 2, wherein, The processor performs the following processing: When the subject's position cannot be identified, a screen containing the information obtained from the sensor will pop up and be displayed on the examination window.
14. The medical imaging device according to claim 13, wherein, The information obtained from the sensor includes images captured by a camera that serves as the sensor.
15. The medical imaging apparatus according to claim 13, wherein, The information obtained from the sensor includes coil information, which includes at least one of: information indicating the type of receiving coil used to receive signals emitted by the subject, and information indicating the location of a connector connected to the receiving coil.
16. The medical imaging apparatus according to claim 13, wherein, The screen, which includes the information obtained from the sensor, displays the registered body positions and the body positions that can be re-registered.
17. The medical imaging apparatus according to claim 13, wherein, The image, which includes the information obtained from the sensor, includes a portion of the registration image.
18. A medical imaging support method, which is executed by a processor, The medical imaging support method includes the processor performing the following processing: The registration screen for registering the body position of the examinee is displayed on the display device; Receive an instruction to begin imaging for imaging medical images of the subject in the registered position; The subject's body position is identified based on information obtained from sensors; and When switching from the registration screen to the examination window screen, which includes an image display area for displaying medical images of the examinee, if the identified body position is different from the registered body position, a pop-up screen with a suggestion to re-register the body position is displayed on the examination window screen.
19. An information processing apparatus comprising a processor, The processor performs the following processing: The registration screen for registering the body position of the examinee is displayed on the display device; Receive an instruction to begin imaging for imaging medical images of the subject in the registered position; The subject's body position is identified based on information obtained from sensors; and When switching from the registration screen to the examination window screen, which includes an image display area for displaying medical images of the examinee, if the identified body position is different from the registered body position, a pop-up screen with a suggestion to re-register the body position is displayed on the examination window screen.
20. A program product comprising a program that, when read by a computer, causes the computer to perform the following functions: The registration screen for registering the body position of the examinee is displayed on the display device; Receive an instruction to begin imaging for imaging medical images of the subject in the registered position; The subject's body position is identified based on information obtained from sensors; and When switching from the registration screen to the examination window screen, which includes an image display area for displaying medical images of the examinee, if the identified body position is different from the registered body position, a pop-up screen with a suggestion to re-register the body position is displayed on the examination window screen.
21. A non-transitory, computer-readable recording medium containing a program that, when read by a computer, causes the computer to perform the following functions: The registration screen for registering the body position of the examinee is displayed on the display device; Receive an instruction to begin imaging for imaging medical images of the subject in the registered position; The subject's body position is identified based on information obtained from sensors; and When switching from the registration screen to the examination window screen, which includes an image display area for displaying medical images of the examinee, if the identified body position is different from the registered body position, a pop-up screen with a suggestion to re-register the body position is displayed on the examination window screen.
Citation Information
Patent Citations
Radiation tomographic apparatus and program
JP2014121364A
Systems and methods for patient structure estimation during medical imaging
JP2021121092A
Medical image pickup apparatus comprising biological signal processing system, medical imaging system, and biological signal processing method
JP2022104170A