Medical information processing system and medical information processing device

Abstract

To avoid a contact between a device whose movable range is predetermined and an obstacle.SOLUTION: A medical information processor includes a determination part, an identification part, and a report part. The determination part determines an operation area related to a device whose movable range is predetermined. The identification part identifies position coordinates in an examination room corresponding to the operation area and position coordinates in the examination room of an obstacle on the basis of a camera image photographed by an optical camera installed in the examination room. A report part reports a detection result when the position coordinates of the obstacle are included in the position coordinates in the operation area.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] Embodiments disclosed in the present specification and drawings relate to a medical information processing system and a medical information processing apparatus.

Background Art

[0002] In an examination room where examinations and procedures using medical image diagnostic apparatuses and the like are performed, many apparatuses are arranged, including apparatuses with a limited operation range (movable range) such as a C-arm, and apparatuses that can move freely within the examination room. If these apparatuses come into contact (interfere) with each other during an examination, it may cause a serious situation for patients and medical staff. For this reason, when an operator moves an apparatus that can move freely within the examination room, it is necessary to arrange the apparatus at a position where it does not interfere with other apparatuses such as apparatuses with a limited operation range. However, in order to avoid interference with other apparatuses, the operator must rely on their intuition and experience when moving the apparatus. In addition, since the operation range of other apparatuses varies depending on the content of the examination or procedure, it is difficult to avoid interference by relying only on the operator's intuition and experience.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problem to be Solved by the Invention

[0004] One of the problems to be solved by the embodiments disclosed in the present specification and drawings is to avoid contact between an apparatus with a predetermined operation range and an obstacle. However, the problems to be solved by the embodiments disclosed in the present specification and drawings are not limited to the above-mentioned problems. The problems corresponding to the respective effects of the respective configurations shown in the embodiments described later can also be positioned as other problems.

Means for Solving the Problem

[0005] The medical information processing device according to this embodiment comprises a determination unit, a specification unit, and a notification unit. The determination unit determines the operating area for a device whose range of motion is predetermined. The specification unit identifies the position coordinates within the examination room corresponding to the operating area and the position coordinates of the obstacle within the examination room, based on a camera image captured by an optical camera installed in the examination room. The notification unit notifies the detection result if the position coordinates of the obstacle are included in the position coordinates of the operating area. [Brief explanation of the drawing]

[0006] [Figure 1] Figure 1 shows an example of the configuration of a medical information processing system according to the first embodiment. [Figure 2] Figure 2 shows an example of the interior of the examination room according to the first embodiment. [Figure 3] Figure 3 is a schematic diagram showing an example of how an optical camera is installed in an inspection room according to the first embodiment. [Figure 4] Figure 4 is a flowchart illustrating the processing procedure for notification processing by the medical information processing system according to the first embodiment. [Figure 5] Figure 5 is a flowchart illustrating the processing procedure for notification processing by a medical information processing system according to a first modified example of the first embodiment. [Figure 6] Figure 6 is a flowchart illustrating the processing procedure for notification processing by a medical information processing system according to a second modified example of the first embodiment. [Figure 7] Figure 7 is a flowchart illustrating the processing procedure for notification processing by a medical information processing system according to a third modified example of the first embodiment. [Figure 8] Figure 8 shows an example of the configuration of a medical information processing system according to the second embodiment. [Figure 9] Figure 9 shows an example of the interior of an examination room according to the second embodiment. [Figure 10] Figure 10 is a flowchart illustrating the processing procedure for notification processing by the medical information processing system according to the second embodiment. [Figure 11] Figure 11 shows an example of the configuration of a medical information processing system according to the fourth embodiment. [Figure 12] Figure 12 is a flowchart illustrating the processing procedure for notification processing by the medical information processing system according to the fourth embodiment. [Modes for carrying out the invention]

[0007] The embodiments of the medical information processing system and medical information processing device will be described in detail below with reference to the drawings. In the following description, components having substantially the same function and configuration will be denoted by the same reference numeral, and redundant explanations will be given only when necessary.

[0008] (First embodiment) Figure 1 shows the configuration of the medical information processing system 1. The medical information processing system 1 is a system for supporting examinations and procedures performed based on examination protocols using medical imaging diagnostic equipment installed in the examination room. The medical information processing system 1 includes a medical information processing device 100. The medical information processing device 100 is located, for example, in the control room that manages the equipment in the examination room. In the following description, "examination" may be read as "procedure".

[0009] The medical information processing device 100 is connected via a network 200 to the Radiological Information System (RIS) 300, various devices installed in the examination room, and communication terminals 600 held by the staff in the examination room. The network 200 is, for example, a LAN (Local Area Network). The connection to the network 200 can be wired or wireless. Furthermore, the connection is not limited to a LAN, as long as security is ensured by a VPN (Virtual Private Network), etc. It may also be connected to a public communication line such as the Internet.

[0010] RIS300 is a system for managing examination information related to radiological examination work. Examination information includes examination order information and examination execution information regarding examination results. RIS300 collects examination order information entered by users, adds various setting information, and manages the collected information as examination reservation information. Examination order information includes, for example, information about the examination protocol and information about the examination to be performed. For example, examination information includes information about the equipment used when performing the examination and information about the physician performing the examination. Equipment information includes, for example, the type, model number, size, shape, and operating area of ​​the equipment. Physician information includes, for example, the physician's name, affiliation, age, gender, and tendencies in procedures. RIS300 transmits examination orders to medical imaging diagnostic equipment according to the examination reservation information. RIS300 also transmits examination execution information generated by the medical imaging diagnostic equipment when the examination is performed to the Hospital Information System (HIS), etc.

[0011] The examination room is equipped with 400 pieces of examination equipment. These pieces of equipment include, for example, medical imaging devices and monitors. Medical imaging devices are modalities used to image the inside of a subject, such as computed tomography (CT) scanners, magnetic resonance imaging (MRI) scanners, ultrasound diagnostic devices, and X-ray diagnostic devices.

[0012] The inspection equipment 400 placed in the inspection room can be classified into fixed-operation equipment, which has a predetermined range of motion, and freely moving equipment, which does not have a restricted range of motion.

[0013] The fixed-motion devices include, for example, motor-driven devices and trajectory-fixed devices. A motor-driven device is a device that operates electrically by being operated from the outside. The motion trajectory of the motor-driven device during execution of various inspection protocols is predetermined by the structure of the device or by the settings of the inspection protocol. Examples of the inspection device 400 classified as a motor-driven device include a bed of a medical image diagnostic apparatus, a holding device, a C-arm of an X-ray diagnostic apparatus, and the like. FIG. 2 is a diagram illustrating an example of the interior of an examination room. In the example of FIG. 2, a bed 411 on which a patient is placed and a C-arm 412 are arranged in the examination room as the motor-driven devices.

[0014] A trajectory-fixed device is a device that is manually operated, and its motion trajectory is determined by the structure of the device. Examples of the inspection device 400 classified as a trajectory-fixed device include a monitor that is suspended from the ceiling and moves along a rail installed on the ceiling. In the example of FIG. 2, a monitor 413 is arranged in the examination room as the trajectory-fixed device.

[0015] A freely movable device is a device arranged in the examination room, whose motion is manual and is not limited by the movable range possessed by the device itself. Examples of the inspection device 400 classified as a freely movable device include an ultrasonic diagnostic apparatus that can freely move on the floor surface of the examination room, a stretcher, an intravenous drip stand, and the like. In the example of FIG. 2, an ultrasonic diagnostic apparatus 414 is arranged in the examination room as the freely movable device.

[0016] Further, to configure the three-dimensional coordinate space of the examination room, an optical camera 500 is installed in the examination room. Figure 3 is a schematic diagram showing an example of a state in which the optical camera 500 is installed in the examination room. As the optical camera 500, for example, a general camera capable of capturing moving images is used. The optical cameras 500 need only be provided in the number required to configure the three-dimensional coordinate space. For example, one optical camera 500 is provided on each of the four walls of the examination room. In the example shown in Figure 3, four optical cameras 500 are installed in the examination room. The optical cameras 500 are installed so as to be capable of photographing the interior of the examination room. The optical camera 500 is connected to the medical information processing apparatus 100 via the network 200, and transmits the captured camera image to the medical information processing apparatus 100.

[0017] The communication terminal 600 is a terminal device that is carried by each medical staff member in the examination room and is capable of communicating with the outside. The communication terminal 600 is connected to the medical information processing apparatus 100 via the network 200 and can communicate with the medical information processing apparatus 100. The communication terminal 600 receives a warning signal from the medical information processing apparatus 100 and notifies the medical staff member holding the communication terminal 600. The communication terminal 600 may be, for example, a display terminal that includes a display and displays the content of the received signal as an image or text, may be a vibrating device that receives an external signal and vibrates, or may be a voice output device that notifies the content of the received signal by voice. Further, the communication terminal 600 may be of a type that is worn by medical staff on the wrist or the like.

[0018] The medical information processing device 100 includes a memory 11, a communication interface 12, a display 13, an input interface 14, and a processing circuit 15. Hereinafter, the medical information processing device 100 will be described as a single device that performs multiple functions, but the multiple functions may be performed by separate devices. For example, each function performed by the medical information processing device 100 may be distributed and installed on different console devices or workstation devices. Furthermore, the medical information processing device 100 may be a device that does not include the communication interface 12, the display 13, and the input interface 14, and only includes the memory 11 and the processing circuit 15. Figure 3 illustrates the medical information processing device 100 without the display 13 and the input interface 14.

[0019] Memory 11 is a storage device such as an HDD (Hard Disk Drive), SSD (Solid State Drive), or integrated circuit that stores various types of information. Memory 11 may also be a portable storage medium other than an HDD or SSD, such as a CD (Compact Disc), DVD (Digital Versatile Disc), or flash memory. Furthermore, memory 11 may be a drive device that reads and writes various types of information to and from semiconductor memory elements such as flash memory or RAM (Random Access Memory). The storage area of ​​memory 11 may be located within the medical information processing device 100 or in an external storage device connected via a network.

[0020] Memory 11 stores programs executed by the processing circuit 15, various data used in the processing of the processing circuit 15, and so on. As a program, for example, a program is used that is pre-installed on the computer from a network or a non-transient computer-readable storage medium, and that enables the computer to implement each function of the processing circuit 15. The various data dealt with in this specification are typically digital data. Memory 11 is an example of a storage unit.

[0021] The communication interface 12 is a network interface that transmits and controls communication with the RIS 300, inspection equipment 400, optical camera 500, communication terminal 600, and other external devices via the network 200.

[0022] Display 13 displays various types of information. For example, display 13 outputs medical information generated by the processing circuit 15, and a GUI (Graphical User Interface) for receiving various operations from the operator. For example, display 13 is a liquid crystal display or a CRT (Cathode Ray Tube) display. Display 13 is an example of a display unit.

[0023] The input interface 14 receives various input operations from the operator, converts the received input operations into electrical signals, and outputs them to the processing circuit 15. For example, the input interface 14 receives input of medical information, various command signals, etc., from the operator. The input interface 14 is realized by a mouse, keyboard, trackball, switch buttons, a touchscreen integrating a display screen and touchpad, a non-contact input circuit using an optical sensor, and an audio input circuit, etc., for performing various processes of the processing circuit 15. The input interface 14 is connected to the processing circuit 15 and converts the input operations received from the operator into electrical signals and outputs them to the control circuit. In this specification, the input interface is not limited to those equipped with physical operating components such as a mouse or keyboard. For example, an electrical signal processing circuit that receives electrical signals corresponding to input operations from an external input device provided separately from the device and outputs these electrical signals to the processing circuit 15 is also included as an example of an input interface. The input interface 14 is an example of an input unit.

[0024] The processing circuit 15 controls the operation of the entire medical information processing device 100. The processing circuit 15 is a processor that executes the coordinate construction function 151, the determination function 152, the identification function 153, and the notification function 154 by calling and executing programs in the memory 11. The processing circuit 15 that realizes each of the coordinate construction function 151, the determination function 152, the identification function 153, and the notification function 154 is an example of the coordinate construction unit, the determination unit, the identification unit, and the notification unit, respectively.

[0025] In Figure 1, the coordinate construction function 151, decision function 152, identification function 153, and notification function 154 are described as being implemented by a single processing circuit 15. However, it is also possible to configure a processing circuit by combining multiple independent processors, with each processor executing a program to implement each function. Furthermore, the coordinate construction function 151, decision function 152, identification function 153, and notification function 154 may each be implemented as separate hardware circuits. The above description of each function performed by the processing circuit 15 is the same in the following embodiments and modifications.

[0026] Furthermore, although the medical information processing device 100 is described as performing multiple functions on a single console, the multiple functions may be performed by separate devices. For example, the functions of the processing circuit 15 may be distributed and installed on different devices. Also, each function of the processing circuit 15 of the medical information processing device 100 may be installed in a medical imaging diagnostic device installed in the examination room, or a control device installed in the operation room, etc.

[0027] In the above description, the term "processor" refers to circuits such as a CPU (central processing unit), a GPU (Graphics Processing Unit), an Application Specific Integrated Circuit (ASIC), a programmable logic device (e.g., a Simple Programmable Logic Device (SPLD)), a Complex Programmable Logic Device (CPLD), and a Field Programmable Gate Array (FPGA)). When the processor is a CPU, for example, it performs its functions by reading and executing a program stored in a memory circuit. On the other hand, when the processor is an ASIC, for example, instead of the program being stored in a memory circuit, the function is directly incorporated as a logic circuit within the processor's circuit. In this embodiment, each processor is not limited to being configured as a single circuit; multiple independent circuits may be combined to form a single processor and perform its functions. Furthermore, multiple components shown in Figure 1 may be integrated into a single processor to perform its functions. The above description of "processor" is the same in the following embodiments and modifications.

[0028] The processing circuit 15 constructs the three-dimensional spatial coordinates of the examination room using camera images acquired by the optical camera 500 through its coordinate construction function 151. The processing circuit 15 that implements the coordinate construction function 151 is an example of a coordinate construction unit. For example, as shown in Figure 2, the processing circuit 15 constructs the three-dimensional spatial coordinates of the entire examination room by defining the X and Y axes, which are horizontal and perpendicular to each other, and the Z axis, which is perpendicular to the X and Y axes and is along the vertical direction. As a method for constructing the three-dimensional spatial coordinates, known methods for recognizing three-dimensional space using camera images captured by one or more cameras can be used.

[0029] The processing circuit 15 determines the operating area for fixed-movement equipment whose range of operation (movable range) is predetermined by the determination function 152. In this process, the processing circuit 15 determines the operating area for each fixed-movement equipment installed in the inspection room. The operating area is a three-dimensional area in which the fixed-movement equipment may move due to its operation during inspection. The processing circuit 15 that implements the determination function 152 is an example of a determination unit.

[0030] When determining the operating area of ​​a specific fixed operating device, the processing circuit 15 first obtains device information related to the fixed operating device from the RIS300. The device information obtained includes, for example, the size, shape, type, and model number of the fixed operating device. Based on the obtained device information, the processing circuit 15 determines the operating area of ​​the fixed operating device in the inspection protocol to be executed. The operating area will be an area with a shape corresponding to the size and shape of the fixed operating device. The processing circuit 15 registers the determined operating area in the memory 11.

[0031] The operating area is the area in which fixed-motion equipment may move during an examination. Therefore, if a freely moving device is left unattended within the operating area, it may come into contact with a moving fixed-motion equipment. Thus, the operating area is the area in which interference between the fixed-motion equipment and obstacles may occur. Obstacles include people in the examination room and freely moving equipment that can move freely within the examination room. People in the examination room include, for example, operators of freely moving equipment, doctors, medical staff such as laboratory technicians, etc. Hereafter, the operating area will also be referred to as the range of motion or the interference area.

[0032] The processing circuit 15, using its identification function 153, identifies the position coordinates within the inspection room corresponding to the operating area and the position coordinates of the obstacle within the inspection room, based on the camera image captured by the optical camera 500 installed in the inspection room. The processing circuit 15 that implements the identification function 153 is an example of an identification unit.

[0033] When determining the position coordinates of the operating area, the processing circuit 15 applies the three-dimensional spatial coordinates constructed by the coordinate construction function 151 to the operating area determined by the determination function 152, thereby determining the position coordinates of the operating area within the inspection room.

[0034] Furthermore, when identifying the position coordinates of an obstacle, the processing circuit 15 detects the obstacle from the camera image acquired from the optical camera 500. As a method for detecting obstacles from the camera image, for example, known image recognition technology may be used. For example, using known image recognition technology, an object that is not registered in advance as a fixed operating device can be detected as an obstacle. Alternatively, an object moving within the inspection room can be detected and compared with the operation of a pre-registered fixed operating device. If the operation does not match that of the fixed operating device, the detected object is detected as an obstacle. Furthermore, using known image recognition technology, it may be further determined whether the object detected as an obstacle is a person. Furthermore, if the object detected as an obstacle is a person, the detected person may be identified by referring to pre-registered body size information, etc., using known image recognition technology. Furthermore, the type of device of the detected object may be identified by referring to the shape of the device, etc., of the device that was pre-registered, using known image recognition technology. After detecting an obstacle, the processing circuit 15 identifies the position coordinates of the obstacle within the inspection room by applying the three-dimensional spatial coordinates constructed by the coordinate construction function 151 to the detected obstacle.

[0035] The processing circuit 15 notifies the detection result via the notification function 154 when the position coordinates of an obstacle are included in the position coordinates of the operating area.

[0036] Specifically, the processing circuit 15 compares the position coordinates of the obstacle identified by the specific function 153 with the position coordinates of the operating area in real time to determine whether or not the obstacle is located within the operating area. If the obstacle is located within the operating area, the processing circuit 15 notifies the person in the inspection room. For example, if at least one of the position coordinates of the obstacle matches the position coordinates of the operating area, it is determined that the obstacle is located within the operating area. Alternatively, if a predetermined percentage or more of the position coordinates of the obstacle are included in the position coordinates of the operating area, it may be determined that the obstacle is located within the operating area.

[0037] Methods of notification include, for example, emitting a warning sound, communicating the risk of interference via voice, or displaying the information on a monitor in the examination room. The processing circuit 15 that implements the notification function 154 is an example of a notification unit.

[0038] Next, the operation of the notification process performed by the medical information processing system 1 will be described. The notification process involves acquiring camera images captured by the optical camera 500 in real time and issuing a warning when an obstacle is about to be placed in a position where it will enter the interference area during the execution of an examination. Figure 4 is a flowchart showing an example of the notification process procedure. Note that the processing procedures for each process described below are merely examples, and each process can be modified as appropriate as possible. Furthermore, depending on the embodiment, steps in the processing procedures described below can be omitted, replaced, and added as appropriate.

[0039] (Notification processing) (Step S101) The processing circuit 15 acquires camera images from the optical camera 500 inside the inspection room.

[0040] (Step S102) Next, the processing circuit 15 uses the coordinate construction function 151 to construct the three-dimensional spatial coordinates of the entire examination room based on the acquired camera images.

[0041] (Step S103) Next, the processing circuit 15 obtains inspection information related to the inspection to be performed from the RIS300 using the decision function 152. This allows the processing circuit 15 to obtain information regarding the operating range of the fixed-motion equipment used for the inspection, and the operations performed by the fixed-motion equipment during the inspection.

[0042] (Step S104) Next, the processing circuit 15 uses the determination function 152 to determine the operating area of ​​the fixed-motion device based on the acquired inspection information, and the identification function 153 to identify the position coordinates of the operating area of ​​the fixed-motion device in three-dimensional space. For example, the operating area of ​​a C-arm is the trajectory of the C-arm. Since the operation of the C-arm in each inspection protocol is predetermined, the operating area of ​​the C-arm can be calculated by acquiring information on the size and shape of the C-arm and information on the operation of the C-arm in the inspection protocol to be executed.

[0043] (Step S105) Next, the processing circuit 15 uses a specific function 153 to perform predetermined image processing on camera images continuously acquired from the optical camera 500, thereby detecting obstacles placed in the inspection room and identifying the position coordinates of the detected obstacles in three-dimensional space.

[0044] (Step S106) Next, the processing circuit 15 determines, using the identification function 153, whether the position coordinates of the identified obstacle are included in the operating area of ​​the fixed operating device. If there are multiple fixed operating devices whose operating areas have been determined, it is determined whether the position coordinates of the identified obstacle are included in at least one of the multiple operating areas.

[0045] (Step S107) If the position coordinates of the obstacle are included in the position coordinates of the operating area of ​​the stationary device (step S106-Yes), the processing circuit 15 uses the notification function 154 to notify that an obstacle is located within the operating area of ​​the stationary device. For example, the processing circuit 15 sends a signal to a control device that controls a speaker installed in the inspection room, causing the speaker to emit a warning sound or a warning message. Alternatively, a warning message may be displayed on a monitor in the inspection room.

[0046] (Step S108) If the position coordinates of the obstacle are not included in the position coordinates of the operating area of ​​the fixed-motion device (step S106-No), or if, in the processing of step S107, the processing circuit 15 is notified that an obstacle is located within the operating area of ​​the fixed-motion device, then it acquires information on the progress of the inspection and information on imaging by the medical imaging diagnostic device, and determines whether the inspection has been completed based on the acquired information.

[0047] The processing circuit 15 repeats the processes from step S105 to step S107 until the inspection is completed. This allows the processing circuit 15 to identify the position coordinates of any obstacles each time a new camera image is acquired, and to warn any person in the inspection room if an obstacle is located within the operating range of the fixed-motion device. When an obstacle that was located within the operating range of the fixed-motion device moves outside the operating range, the processing circuit 15 stops issuing warnings.

[0048] Once the inspection is complete (step S108-Yes), the processing circuit 15 terminates the notification process.

[0049] The effects of the medical information processing system 1 according to this embodiment will be described below.

[0050] The medical information processing device 100 of the medical information processing system 1 according to this embodiment determines the operating area for equipment whose range of operation (movable range) is predetermined, identifies the position coordinates within the examination room corresponding to the operating area and the position coordinates of an obstacle within the examination room based on a camera image taken by an optical camera 500 installed in the examination room, and can notify the detection result if the position coordinates of the obstacle are included in the position coordinates of the operating area.

[0051] Obstacles include, for example, people in the examination room and freely moving equipment that can move freely within the examination room. Fixed-operation equipment includes, for example, electrically operated equipment that is controlled from the outside, such as a bed or C-arm, and equipment with a limited range of movement, such as a monitor.

[0052] With the above configuration, the medical information processing device 100 of the medical information processing system 1 according to this embodiment can construct coordinate axis information for the entire examination room using camera images acquired from multiple optical cameras 500 placed in the examination room, and acquire positional information of obstacles such as freely moving devices. Then, if an obstacle is placed within the operating range (interference range) of a fixed moving device whose operating trajectory is determined during the execution of an examination or procedure, it can notify a person in the examination room that there is a possibility of interference between the fixed moving device and the obstacle. For example, if it is detected that the ultrasound diagnostic device 414 in Figure 2 is placed within the movable range of the examination table 411, the operator of the ultrasound diagnostic device 414 can be warned, for example by voice, and prompted to take action to avoid interference. By confirming the warning when the operator attempts to place the freely moving device on the operating trajectory of other devices, it becomes easier for the operator to place the freely moving device in a position where it will not become an interference source. Alternatively, the presence of an obstacle within the movable range of a fixed moving device can be notified to an unspecified staff member in the examination room, allowing the staff member who confirms the notification to remove the obstacle. This configuration can prevent contact accidents. Furthermore, if no warning is issued, the freely moving device can be safely placed in its originally intended position. As described above, the medical information processing device 100 of the medical information processing system 1 according to this embodiment can contribute to the rapid and safe execution of examinations and procedures.

[0053] Furthermore, individuals such as medical staff within the examination room can also be used as obstacles. In this case, if any person in the examination room moves into the operating range of the fixed-motion device, that person can be warned. The medical staff member who receives the warning can move to a position where they do not come into contact with the fixed-motion device by moving to a range where the warning is released. This configuration can prevent contact accidents.

[0054] Furthermore, electric devices that do not have interference control functions can also be used as obstacles. For example, the movable parts of older medical imaging devices that do not have interference control functions can be detected from camera images, their position coordinates can be determined, and a warning can be issued if the movable parts move into the operating area of ​​other electric devices.

[0055] (First modification of the first embodiment) A first modification of the first embodiment will now be described. This modification is a modification of the configuration of the first embodiment as follows. The medical information processing system 1 and medical information processing device 100 of this modification issue a warning only when an obstacle is stationary within the operating area of ​​the fixed operating device. The configuration, operation, and effects similar to those of the first embodiment will not be described.

[0056] In this modified example, the processing circuit 15 uses the notification function 154 to determine the movement status of the obstacle based on the camera image, and notifies the detection result if the obstacle is stationary and its position coordinates are included in the position coordinates of the operating area.

[0057] Next, the operation of the notification process performed by the medical information processing system 1 will be described. Figure 5 is a flowchart showing an example of the procedure for the notification process performed by the processing circuit 15 according to this modified example. The processes in steps S201-S206 and S208-S209 are the same as the processes in steps S101-S108 in Figure 4, so their explanation will be omitted.

[0058] (Image generation process) (Step S207) If the position coordinates of the freely moving device are included in the position coordinates of the operating area of ​​the fixed operating device (step S206-Yes), the processing circuit 15 determines whether the freely moving device is moving or not using the notification function 154. In this case, the processing circuit 15 continuously acquires the position coordinates of the freely moving device identified from the camera image, for example, and determines that the freely moving device is stopped if the time during which the position coordinates have not changed exceeds a predetermined time. Otherwise, the processing circuit 15 determines that the freely moving device is moving. If the freely moving device is moving, the process proceeds to step 209 without notifying that the freely moving device is located within the operating area of ​​the fixed operating device.

[0059] (Step S208) If the freely moving device is stopped (step S207-Yes), the processing circuit 15 uses the notification function 154 to notify that the freely moving device is located within the operating area of ​​the fixed operating device.

[0060] The effects of the medical information processing system 1 and medical information processing device 100 related to this modified example will be explained below.

[0061] There is a risk of interference between devices if a freely moving device is left within the operating area (interference area) of a fixed-operating device. On the other hand, there is no problem with a freely moving device passing through the operating area (interference area) of a fixed-operating device while it is moving. According to the medical information processing device 100 of the medical information processing system 1 in this modified example, the movement status of an obstacle is determined based on the camera image, and if the obstacle is stationary and its position coordinates are included in the position coordinates of the operating area, the detection result can be notified. With this configuration, a warning can be issued only if the freely moving device remains within the operating area of ​​the fixed-operating device for a certain period of time or longer. Furthermore, even if an obstacle is in motion, the system may notify the user by voice or other means that there is a possibility of danger if the obstacle stops in place. In this case, the processing circuit 15 will use the notification function 154 to notify the user that if the obstacle is in motion and its position coordinates are included in the operating area's position coordinates, there is a possibility of danger if the obstacle remains in place. This allows the system to alert the user that an obstacle is within the operating area of ​​a stationary operating device.

[0062] (Second modification of the first embodiment) A second modification of the first embodiment will now be described. This modification is a modification of the configuration of the first embodiment as follows. The medical information processing system 1 and medical information processing device 100 of this modification identify the person closest to a freely moving device placed in the interference area and notify that person of a warning. The same configuration, operation, and effects as in the first embodiment will not be described.

[0063] In this modified example, the processing circuit 15 identifies the position coordinates of a person in the examination room using the specific function 153. One method for identifying the position coordinates of a person in the examination room is to calculate the position coordinates of each person based on signals transmitted from communication terminals 600 distributed to each medical staff member in the examination room. Alternatively, known person detection processing may be applied to camera images acquired from the optical camera 500, and the person in the examination room may be identified by referring to pre-registered person information.

[0064] The processing circuit 15, via the notification function 154, detects a freely moving device as an obstacle, and if the position coordinates of the freely moving device are included in the position coordinates of the operating area, it notifies a person located near the freely moving device of the detection result. For example, the processing circuit 15 uses the position coordinates of each person identified by the identification function 153 and the position coordinates of the freely moving device to identify the person closest to the freely moving device placed within the operating area of ​​the fixed operating device, and notifies that person of a warning. For example, the processing circuit 15 sends a warning message to a communication terminal 600 held by the person closest to the freely moving device. Alternatively, the name of the identified person and the content of the warning may be displayed on a monitor placed in the inspection room.

[0065] Next, the operation of the notification process performed by the medical information processing system 1 will be described. Figure 6 is a flowchart showing an example of the procedure for the notification process performed by the processing circuit 15 according to this modified example. The processes in steps S301-S305 and S307 are the same as the processes in steps S101-S106 in Figure 4, so their explanation will be omitted.

[0066] (Image generation process) (Step S306) In step S305, after the position coordinates of the freely moving device are determined, the processing circuit 15 uses the identification function 153 to detect people in the inspection room and determine the position coordinates of each person.

[0067] (Step S308) If the position coordinates of the freely moving device are included in the position coordinates of the operating area of ​​the stationary device (step S207-Yes), the processing circuit 15 identifies the person closest to the freely moving device located within the operating area of ​​the stationary device.

[0068] (Step S309) The processing circuit 15 notifies the identified person of a warning via the notification function 154.

[0069] The effects of the medical information processing system 1 and medical information processing device 100 related to this modified example will be explained below.

[0070] According to the medical information processing device 100 of the medical information processing system 1 relating to this modification, the system can identify the position coordinates of a person in an examination room, detect a freely moving device that can move freely within the examination room as an obstacle, and notify a person located near the freely moving device if the position coordinates of the freely moving device are included in the operating area. With this configuration, for example, a notification can be sent to a medical staff member who is in the position that makes it easiest to move the freely moving device, prompting them to move the device. Similarly, if an electric device without interference control functionality is detected as an obstacle, the detection result may be notified to a person located near the electric device.

[0071] (Third modification of the first embodiment) A third modification of the first embodiment will now be described. This modification is a modification of the configuration of the first embodiment as follows. The medical information processing system 1 and medical information processing device 100 of this modification register in advance the freely moving devices to be placed in the examination room, and when a freely moving device is placed in an interference area, they notify the type of manual device that should be moved out of the interference area. The same configuration, operation, and effects as in the first embodiment will not be described.

[0072] In this modified example, memory 11 stores information about obstacles in the examination room. This information about obstacles includes, for example, information about freely moving devices. This information about freely moving devices includes, for example, the color, type, size, and shape of the devices.

[0073] The processing circuit 15 uses a specific function 153 to identify obstacle identification information based on information about obstacles pre-registered in the memory 11. The identification information includes, for example, a name to distinguish it from other equipment in the inspection room, such as the type and model number of the freely moving device. For example, the processing circuit 15 identifies the shape, color, and size of the freely moving device detected from the camera image and compares it with pre-registered information about the freely moving device to identify the type of the detected freely moving device.

[0074] Furthermore, the processing circuit 15, via the notification function 154, notifies the detection result and identification information of the obstacle when it detects that the position coordinates of the obstacle are included in the position coordinates of the operating area. For example, it notifies the inspection room of the type of freely moving equipment located within the operating area of ​​the fixed operating equipment.

[0075] Next, the operation of the notification process performed by the medical information processing system 1 will be described. Figure 7 is a flowchart showing an example of the procedure for the notification process performed by the processing circuit 15 according to this modified example. The processes in steps S401-S406 and S409 are the same as the processes in steps S101-S106 and S108 in Figure 4, respectively, so their explanation will be omitted.

[0076] (Image generation process) (Step S407) If the position coordinates of the freely moving device are included in the position coordinates of the operating area of ​​the fixed-operating device (step S406-Yes), the processing circuit 15 uses the identification function 153 to identify the type of the detected freely moving device by comparing its shape, color, and size with registered information.

[0077] (Step S408) The processing circuit 15, via its notification function 154, notifies the inspection room of information regarding the identified free-moving equipment. For example, by emitting a voice from a speaker installed in the inspection room, it notifies the person in the inspection room of the type of free-moving equipment and the serial number of the equipment that is placed within the operating range of the fixed-operating equipment.

[0078] The effects of the medical information processing system 1 and medical information processing device 100 related to this modified example will be explained below.

[0079] According to the medical information processing device 100 of the medical information processing system 1 in this modified example, the device can identify obstacle identification information based on information about obstacles pre-registered in the memory 11, and when it is detected that the position coordinates of the obstacle are included in the position coordinates of the operating area, it can notify the detection result in addition to the obstacle identification information. With this configuration, it is possible to specifically notify which of the multiple freely moving devices placed in the examination room is located within the operating area of ​​the fixed-operating device. Medical staff in the examination room can immediately move the notified device, thus accurately preventing the risk of interference between devices.

[0080] (Second embodiment) A second embodiment will now be described. This embodiment is a modification of the configuration of the first embodiment as follows. In this embodiment, the operating area of ​​the fixed-operation device is projected onto the floor or other surface in the inspection room. The configuration, operation, and effects, which are the same as those of the first embodiment, will not be described.

[0081] Figure 8 shows the configuration of the medical information processing system 1 according to this embodiment. Figure 9 shows an example of the interior of an examination room according to this embodiment. In this embodiment, a projection device 700 is installed in the examination room to project the operating area of ​​fixed-motion equipment into the examination room. As the projection device 700, for example, a projector is used that is attached to the ceiling of the examination room or to a medical imaging diagnostic device and projects the interference area onto the floor of the examination room. In the example in Figure 9, an electric device, a bed 411 and a C-arm 412, a freely moving device, an ultrasound diagnostic device 414, and the operator P of the ultrasound diagnostic device 414 are arranged in the examination room.

[0082] The projection device 700 projects light onto the floor of the examination room in the shape of an interference region having three-dimensional spatial coordinates projected vertically (hereinafter referred to as the projected shape). Alternatively, projection light in the shape of a simple circle or rectangle, including the projected shape, may be projected. Furthermore, the projection device 700 may use multiple projectors, combining the projection light emitted from multiple projectors to create projection light with complex shapes.

[0083] In addition to the functions described in the first embodiment, the processing circuit 15 also performs a projection function 155. The projection function 155 causes the processing circuit 15 to project the operating area of ​​the fixed-operation equipment identified by the identification function 153 onto a projection device 700 installed in the inspection room.

[0084] Next, the operation of the notification process performed by the medical information processing system 1 will be described. Figure 10 is a flowchart showing an example of the procedure for the notification process performed by the processing circuit 15 according to this embodiment. The processes in steps S501-S504 and S506-S509 are the same as the processes in steps S101-S108 in Figure 4, so their explanation will be omitted.

[0085] (Image generation process) (Step S505) In step S504, after the operating area of ​​the fixed-operation equipment is identified, the processing circuit 15 controls the projection device 700 with the projection function 155 to project light onto the floor of the inspection room in the shape formed when the operating area of ​​the fixed-operation equipment is projected onto the floor. This projection continues until the inspection is completed.

[0086] The effects of the medical information processing system 1 and medical information processing device 100 according to this embodiment will be described below.

[0087] In this embodiment as well, if a freely moving device is placed within the operating area, the freely moving device is detected based on the camera image, and if it is determined that the freely moving device is placed within the operating area of ​​the fixed operating device, a warning is notified to the examination room. In addition, according to the medical information processing device 100 of the medical information processing system 1 according to this embodiment, the operating area of ​​the fixed operating device can be projected onto a projection device 700 installed in the examination room. With this configuration, the projected shape of the operating area of ​​the fixed operating device is projected onto the floor surface of the examination room until the examination is completed. When the operator of the freely moving device moves the freely moving device within the examination room, they can easily avoid placing the freely moving device in the area projected onto the floor surface, thereby preventing the freely moving device from being placed within the operating area of ​​the fixed operating device. In other words, according to this embodiment, the operator can be prompted to place the manual device in a position that avoids the interference area.

[0088] Alternatively, instead of projecting the operating area onto the floor, Augmented Reality (AR) technology can be used to allow the operator to visually perceive the operating area. In this case, for example, the operator could wear AR goggles. With AR goggles, a virtual interference area would be superimposed onto the space within the examination room. Furthermore, by displaying the operating area of ​​a fixed motion device in three-dimensional space using AR technology, Even when moving freely moving equipment that can move through the air in an examination room, such as equipment suspended from the ceiling, interference with other equipment can be effectively prevented.

[0089] (Third embodiment) A third embodiment will now be described. This embodiment is a modification of the configuration of the first embodiment as follows. In this embodiment, the operating range is changed according to the type of examination or procedure. The configuration, operation, and effects, which are the same as those of the first embodiment, will not be described.

[0090] The processing circuit 15 determines the operating area of ​​fixed-operating equipment according to the inspection protocol using the determination function 152. For example, when determining the interference area of ​​an electric motor according to the inspection protocol to be executed, the processing circuit 15 first obtains equipment information of the electric motor, as well as inspection information related to the inspection protocol to be executed, from the RIS 300. The inspection information to be obtained includes, for example, the operation of the electric motor that is pre-configured in the inspection protocol to be executed, and information on operations that may be performed by the operator in the inspection protocol. Based on the acquired equipment information and inspection information, the processing circuit 15 determines the interference area of ​​the electric motor according to the inspection protocol to be executed.

[0091] For example, the operating range of the fixed-motion device is determined according to the area being examined. For instance, the range of movement of the examination table and C-arm during an examination of the heart will differ from that of an examination of the abdomen. Therefore, by setting only the range of movement of the examination table and C-arm as the interference area in an examination of the heart, the interference area can be set to its minimum size.

[0092] Furthermore, in examinations and procedures using biplane X-ray diagnostic equipment with two arms, X-ray imaging may be performed using only one arm. In such cases, the interference area can be minimized by setting the operating range of the X-ray diagnostic equipment to the range of motion of only the arm being used.

[0093] When the area set as the operating area becomes larger, the range in which the freely moving device can be placed within the examination room becomes smaller, making the freely moving device difficult to use. According to the medical information processing device 100 of the medical information processing system 1 of this embodiment, the interference area can be set to a minimum size without making it unnecessarily large. Therefore, the operator can secure a larger space to move the freely moving device.

[0094] (Modified version of the third embodiment) Furthermore, the tendencies and preferences for the shooting angle when performing X-ray imaging differ among operators. In this case, the area in which the C-arm operates during examinations and procedures will differ depending on the operator. For this reason, the tendencies and preferences of operators may be stored in advance, and the operating area settings may be changed according to the operator's tendencies. In this case, the processing circuit 15 determines the operating area according to the operator's operating tendencies using the determination function 152. For example, the angles of the C-arm that the operator frequently uses may be stored in advance as part of the operator's tendencies. By changing the operating area according to the operator's tendencies and preferences, the interference area can be set to a minimum size, and a larger space can be secured for the operator to move the freely moving device.

[0095] (Fourth embodiment) A fourth embodiment will now be described. This embodiment is a modification of the configuration of the first embodiment as follows. In this embodiment, the risk of interference is determined, and the alert level is changed according to the determination result. The configuration, operation, and effects, which are the same as those of the first embodiment, will not be described.

[0096] Figure 11 shows the configuration of the medical information processing system 1 according to this embodiment. In this embodiment, the processing circuit 15 performs a determination function 156 in addition to the functions described in the first embodiment. The processing circuit 15 uses the determination function 156 to estimate the position where the fixed motion device moves during the examination or procedure and to determine the risk of interference occurring in the operating area of ​​the fixed motion device (hereinafter referred to as interference possibility).

[0097] The possibility of interference may be determined to one of several predefined levels, or to a numerical value between 1% and 100%. Furthermore, the possibility of interference may be determined for each coordinate in the three-dimensional spatial coordinate system constructed within the laboratory, or the three-dimensional spatial coordinate system constructed within the laboratory may be divided into multiple regions and the possibility of interference determined for each region. The possibility of interference may also be referred to as interference risk or interference level.

[0098] When determining the possibility of interference, the processing circuit 15, for example, determines the possibility of interference based on the position to which the fixed motion device is to move (hereinafter referred to as the target movement position) and the direction of movement of the fixed motion device. The target movement position is, for example, the position of the C-arm when X-ray imaging is performed. The target movement position can be estimated, for example, based on the contents of the examination protocol or the operation information of the fixed motion device during the examination. If the target movement position or direction of movement of the fixed motion device is unknown, the possibility of interference may be set according to the examination protocol and the characteristics of the operator.

[0099] The processing circuit 15 notifies the detection result using a notification method that corresponds to the possibility of interference, via the notification function 154. For example, the content and volume of the audio notification sent within the examination room may be changed according to the possibility of interference. Alternatively, the content displayed on the communication terminal 600 may be changed according to the possibility of interference. Furthermore, in combination with the second embodiment, the light intensity and color of the light projected onto the floor of the examination room may be changed according to the possibility of interference.

[0100] Next, the operation of the notification process performed by the medical information processing system 1 will be described. Figure 12 is a flowchart showing an example of the procedure for the notification process performed by the processing circuit 15 according to this embodiment. The processes in steps S601-S604, S606-S607, and S609 are the same as the processes in steps S101-S106 and S108 in Figure 4, respectively, so their explanation will be omitted.

[0101] (Image generation process) (Step S605) In step S604, after the operating area of ​​the fixed operating device is identified, the processing circuit 15 uses the determination function 156 to determine the possibility of interference for each position within the identified operating area. Here, we will describe an example using three levels of interference possibility: "high," "medium," and "low."

[0102] The processing circuit 15 first acquires the operation signals of the fixed motion device being operated by the operator using a joystick or the like, and identifies the target movement position of the fixed motion device. For example, if the imaging position and imaging angle are determined by the examination protocol, the target movement positions of the C-arm and the examination table can be identified in advance. The processing circuit 15 determines that there is a high risk of interference with obstacles in the area near the identified target movement position, and sets the interference possibility in the area near the target movement position within the operating range of the fixed motion device to "high".

[0103] Furthermore, the processing circuit 15 identifies the current direction of movement of the fixed operating device based on the operation signal of the fixed operating device, and determines that there is a reasonably high risk of interference with obstacles in the area through which the fixed operating device will move when it moves in the identified direction (hereinafter referred to as the passage area), and sets the interference possibility of the passage area within the operating area of ​​the fixed operating device to "medium".

[0104] Furthermore, the processing circuit 15 determines that the risk of interference with obstacles is low in areas other than the vicinity of the target movement position and the passage area, and sets the possibility of interference in areas other than the vicinity of the target movement position and the passage area within the operating range of the fixed-movement device to "low".

[0105] (Step S608) If the position coordinates of the freely moving device are included in the position coordinates of the operating area of ​​the stationary device (step S607-Yes), the processing circuit 15 uses the notification function 154 to notify the detection result using a notification method corresponding to the interference possibility determined in step S605. For example, if the freely moving device is placed in an area of ​​the operating area of ​​the stationary device where the interference possibility is "low", notification is given using only a warning sound at a low volume, and if the freely moving device is placed in an area where the interference possibility is "high", notification is given using a warning message in addition to a warning sound at a high volume.

[0106] The processing circuit 15 repeats the processes from step S605 to step S609 until the inspection is completed. As a result, each time a new camera image is acquired, the processing circuit 15 identifies the position coordinates of the freely moving device and warns any person in the inspection room if the freely moving device is located within the operating area of ​​the fixed-operating device. In addition, each time operation information of the fixed-operating device is acquired, the possibility of interference within the operating area is reassessed, and the interference risk is notified in a manner appropriate to the possibility of interference during the inspection.

[0107] The effects of the medical information processing system 1 and medical information processing device 100 according to this embodiment will be described below.

[0108] According to the medical information processing device 100 of the medical information processing system 1 of this embodiment, the possibility of interference within the operating area of ​​a fixed-movement device can be determined, and the detection result can be notified using a notification method corresponding to the possibility of interference. For example, the possibility of interference can be determined based on the direction of movement of the fixed-movement device and the target movement position. The operator can understand the possibility of interference between devices and take appropriate action according to the situation.

[0109] According to at least one embodiment described above, it is possible to avoid contact between equipment with a predetermined operating area and obstacles.

[0110] While several embodiments have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These embodiments can be implemented in a variety of other forms, and various omissions, substitutions, modifications, and combinations of embodiments are possible without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims and their equivalents. [Explanation of Symbols]

[0111] 1…Medical information processing system 100... Medical information processing device 11…Memory 12…Communication Interface 13…Display 14…Input Interface 15…Processing circuit 151... Coordinate construction function 152...Decision function 153...Specific function 154…Notification function 155...Projection function 156... Judgment function 200… Network 400... Inspection equipment 411...Bed 412...C-arm 413…Monitor 414... Ultrasound diagnostic equipment 500… Optical camera 600... Communication terminal 700…Projection device

Claims

1. A determination unit that determines the operating range for a device with a predetermined range of motion based on the operating tendencies regarding the angle of the device used by the operator during an examination or procedure, which are stored in advance for each operator. A unit that identifies the position coordinates of the object within the inspection chamber corresponding to the operating area and the position coordinates of the object within the inspection chamber based on camera images taken by an optical camera installed in the inspection chamber, A notification unit that notifies the detection result when the position coordinates of the obstacle are included in the position coordinates of the operating area, A medical information processing device equipped with [a specific feature].

2. The determination unit determines the operating area according to the inspection protocol. The medical information processing device according to claim 1.

3. The determination unit acquires the operational tendencies regarding the angle of the equipment, which are stored in advance in association with the operator, based on the identification information of the operator performing the examination or procedure. The medical information processing device according to claim 1.

4. The identification unit identifies the identification information of the obstacle based on information about the obstacle that has been pre-registered in the storage medium. When the notification unit detects that the position coordinates of the obstacle are included in the position coordinates of the operating area, it notifies the detection result in addition to the identification information of the obstacle. The medical information processing device according to claim 1.

5. The aforementioned obstacles include persons in the examination room and freely moving devices that can move freely within the examination room. The medical information processing device according to claim 1.

6. The examination room further includes a projection unit that projects the operating area onto a projection device provided in the examination room. The medical information processing device according to claim 1.

7. The notification unit determines the movement state of the obstacle based on the camera image, and notifies the detection result if the obstacle is stationary and its position coordinates are included in the position coordinates of the operating area. The medical information processing device according to claim 1.

8. The aforementioned identification unit identifies the position coordinates of the person in the examination room, The notification unit, when a freely moving device that can move freely within the inspection room is detected as an obstacle, and the position coordinates of the freely moving device are included in the position coordinates of the operating area, notifies a person located near the freely moving device of the detection result. The medical information processing device according to claim 1.

9. The system further includes a determination unit for determining the possibility of interference in the operating region, The notification unit notifies the detection result using a notification method corresponding to the possibility of interference. The medical information processing device according to claim 1.

10. The determination unit determines the possibility of interference based on the target movement position or direction of movement of the device. The medical information processing device according to claim 9.

11. A determination unit that determines the operating range for a device with a predetermined range of motion based on the operating tendencies regarding the angle of the device used by the operator during an examination or procedure, which are stored in advance for each operator. A unit that identifies the position coordinates of the object within the inspection chamber corresponding to the operating area and the position coordinates of the object within the inspection chamber based on camera images taken by an optical camera installed in the inspection chamber, A notification unit that notifies the detection result when the position coordinates of the obstacle are included in the position coordinates of the operating area, A medical information processing system equipped with [the following features].

Images