Medical Observation System
The medical observation device addresses interruptions from irrelevant GUI operations by capturing dual images and displaying annotation distances, improving user convenience and surgical efficiency.
Patent Information
- Application Number
- JP2023070544
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-04-24
- Publication Date
- 2024-11-28
- Estimated Expiration
- 2038-08-06
AI Technical Summary
Existing medical observation devices face interruptions in medical practice due to GUI operations that are not directly related to medical actions, leading to inconvenience and potential declines in performance.
A medical observation device that captures medical images for both the right and left eyes, acquires positions of points on the observation target, and displays annotation images indicating distances between these points on the display screen, allowing for more intuitive and relevant interactions.
Improves user convenience by reducing interruptions during medical procedures and enhancing the accuracy and efficiency of surgical actions by providing real-time measurement capabilities directly relevant to medical tasks.
Smart Images

Figure 0007591604000001 
Figure 0007591604000002 
Figure 0007591604000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a medical observation device. [Background technology]
[0002] In recent years, in medical settings, for example, to support microsurgery such as neurosurgery or to perform endoscopic surgery, medical observation devices capable of magnifying and observing an observation target such as an affected area are sometimes used. Examples of medical observation devices include medical observation devices equipped with an optical microscope and medical observation devices equipped with an imaging device that functions as an electronic imaging microscope. In the following, a medical observation device equipped with the optical microscope is referred to as an "optical medical observation device." In addition, in the following, a medical observation device equipped with the imaging device may be referred to as an "electronic imaging medical observation device" or simply as a "medical observation device." In addition, in the following, an image (moving image or still image; the same applies hereinafter) of an observation target captured by an imaging device equipped in a medical observation device is referred to as a "medical captured image."
[0003] With the improvement in image quality of imaging devices and displays on which the captured images are displayed, electronic imaging medical observation devices can provide image quality equal to or better than that of optical medical observation devices. In addition, users of electronic imaging medical observation devices (e.g., medical personnel such as surgeons and assistants to the surgeon; hereinafter the same) do not need to look into the eyepiece of an optical microscope as they do when using optical medical observation devices, and can therefore move the position of the imaging device more freely. Therefore, the use of electronic imaging medical observation devices has the advantage of being able to support microsurgery and the like more flexibly, and the use of electronic imaging medical observation devices in medical settings is increasing.
[0004] In this situation, techniques related to GUI (Graphical User Interface) for medical images have been developed. An example of such techniques is the technique described in Patent Document 1 below. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Special Publication No. 2007-521864 Summary of the Invention [Problem to be solved by the invention]
[0006] For example, by using the technology described in Patent Document 1, it is possible to display a GUI object such as a diameter measurement object on a medical imaging image. As an example, by using the technology described in Patent Document 1, it is possible to display a diameter measurement object for a contour included in a medical imaging image. As described above, when a diameter measurement object is displayed for a contour included in a medical imaging image, a person viewing the medical imaging image displayed on the display screen can visually recognize the diameter of the contour.
[0007] However, when the technology described in Patent Document 1 is used, a person viewing a medical imaging image cannot recognize the diameter of a contour unless a diameter measurement object is displayed for the contour included in the medical imaging image by operating the GUI. Here, the operation of the GUI is considered to be an operation that is less related to "medical procedures performed by medical personnel such as surgeons (operators) and assistants using a medical observation device." Therefore, when the technology described in Patent Document 1 is used, for example, the medical procedures may be interrupted by operating the GUI, and interruption of the medical procedures may cause a decrease in convenience for medical personnel using the medical observation device. In the following, a person who uses the medical observation device, such as a surgeon or an assistant, is referred to as a "user of the medical observation device" or simply as a "user."
[0008] The present disclosure proposes a new and improved medical observation device that can improve the convenience for users of the medical observation device. [Means for solving the problem]
[0009] According to the present disclosure, there is provided a medical observation device including an imaging unit having a first imaging device that captures a medical image for a right eye of an observation object and a second imaging device that captures a medical image for a left eye of the observation object, an acquisition unit that acquires positions of at least two points on the observation object identified based on a predetermined action on the observation object, and a display control unit that displays the medical image for the right eye, the medical image for the left eye, and an annotation image indicating the distance between the two points whose positions have been acquired, on a display screen of a display device. Effect of the Invention
[0010] According to the present disclosure, it is possible to improve the convenience for users of medical observation devices.
[0011] It should be noted that the above effects are not necessarily limiting, and any of the effects shown in this specification or other effects that can be understood from this specification may be achieved in addition to or instead of the above effects. [Brief description of the drawings]
[0012] [Figure 1] FIG. 1 is an explanatory diagram showing a first example of the configuration of a medical observation system according to an embodiment of the present invention. [Diagram 2] FIG. 1 is an explanatory diagram showing an example of a use case in which the medical observation system according to the present embodiment is used. [Diagram 3] 2 is an explanatory diagram for explaining an example of the configuration of an imaging device provided in the medical observation apparatus according to the present embodiment. FIG. [Figure 4] FIG. 2 is an explanatory diagram showing a second example of the configuration of the medical observation system according to the present embodiment. [Diagram 5]1 is a functional block diagram showing an example of the configuration of a medical observation device according to an embodiment of the present invention. [Figure 6] 1 is an explanatory diagram for explaining an example of an annotation image displayed by a display control method according to the present embodiment. FIG. [Figure 7] 11 is an explanatory diagram for explaining another example of an annotation image displayed by the display control method according to the embodiment. FIG. [Figure 8] 3 is a functional block diagram showing a first example of the configuration of a processing unit included in the medical observation apparatus according to the present embodiment. FIG. [Figure 9] 5 is a flowchart showing an example of processing in an acquisition unit of a processing unit provided in the medical observation apparatus according to the present embodiment. [Figure 10] 5 is a flowchart showing an example of processing in a distance calculation unit included in a processing unit provided in the medical observation apparatus according to the present embodiment. [Figure 11] 4 is a functional block diagram showing a second example of the configuration of the processing unit included in the medical observation equipment according to the present embodiment. FIG. [Figure 12] FIG. 11 is a functional block diagram showing a third example of the configuration of a processing unit included in the medical observation equipment according to the present embodiment. [Figure 13] 1 is an explanatory diagram for explaining an example of an image displayed by a display control method according to the embodiment; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functional configurations are denoted by the same reference numerals, and redundant description will be omitted.
[0014] The following description will be given in the following order. 1. Medical Observation System According to the Present Embodiment and Display Control Method According to the Present Embodiment [1] Configuration of medical observation system [1-1] First Example of Medical Observation System [1-2] Second Example of Medical Observation System [1-3] Functional configuration of medical observation equipment [2] Display control method according to this embodiment [2-1] Overview of the display control method according to the present embodiment [2-2] Example of processing related to the display control method according to the present embodiment [3] An example of an effect achieved by using the display control method according to the present embodiment 2. Program according to this embodiment
[0015] (Medical Observation System According to the Present Embodiment and Display Control Method According to the Present Embodiment) Hereinafter, an example of a medical observation system according to this embodiment will be described, along with a display control method according to this embodiment.
[0016] In the following, a case where the medical observation device according to the present embodiment performs the process related to the display control method according to the present embodiment will be mainly described. Note that in the medical observation system according to the present embodiment, the device capable of performing the process related to the display control method according to the present embodiment is not limited to the medical observation device according to the present embodiment. For example, in the medical observation system according to the present embodiment, the process related to the display control method according to the present embodiment may be performed by any device such as a medical controller.
[0017] [1] Configuration of medical observation system [1-1] First Example of Medical Observation System 1 is an explanatory diagram showing a first example of the configuration of a medical observation system 1000 according to this embodiment. The medical observation system 1000 shown in FIG.
[0018] The medical observation system according to the first example is not limited to the example shown in FIG.
[0019] For example, the medical observation system according to the first example may further include a medical control device (not shown) that controls various operations in the medical observation device 100. In the medical observation system 1000 shown in Fig. 1, as described later, the medical observation device 100 includes a control unit (described later), and thus the medical observation device 100 has the function of a medical control device (not shown).
[0020] Examples of the medical control device (not shown) include a "medical controller" and a "computer such as a server". The medical control device (not shown) may be, for example, an IC (Integrated Circuit) that can be incorporated into the above-mentioned devices.
[0021] The medical observation system according to the first example may have a configuration in which one or both of the medical observation devices 100 and the display devices 200 are multiple. When the medical observation system according to the first example has a configuration in which the medical observation device 100 and the display device 200 are multiple, the medical observation device 100 and the display device 200 may be in one-to-one correspondence, or multiple medical observation devices 100 may be in correspondence with one display device 200. When multiple medical observation devices 100 are in correspondence with one display device 200, the display device 200 switches which medical imaging image captured by which medical observation device 100 is to be displayed on the display screen by, for example, performing a switching operation.
[0022] The medical observation system according to this embodiment may further include a navigation device. The navigation device is a medical device for realizing a so-called medical navigation system. The navigation device detects, for example, the spatial position of a position detection probe, and displays an image corresponding to the detected spatial position on a display screen of an arbitrary display device. The navigation device is driven, for example, by power supplied from an internal power source such as a battery included in the navigation device, or by power supplied from an external power source connected to the navigation device.
[0023] When a medical navigation system is realized by a navigation device, for example, a medical professional moves a position detection probe to a position corresponding to the surgical site. In this case, the position corresponding to the surgical site is detected. The navigation device detects the spatial position of the position detection probe by any position detection method, such as an optical position detection method using infrared rays or a magnetic field position detection method, thereby detecting the position of the surgical site on the patient. A position sensor that detects the spatial position of the position detection probe may be provided in the navigation device, for example, or may be provided at any position outside the navigation device. For example, when the position of the surgical site on the patient is detected, a medical professional such as a surgeon can visually recognize which part of the patient the part being treated corresponds to by looking at an image corresponding to the detected spatial position displayed on a display screen.
[0024] The navigation device may have a function of transmitting position information indicating the spatial position of the detected position detection probe to an external device such as the medical observation device 100. The navigation device corresponds to an example of a detection device that detects a position in an observation target.
[0025] FIG. 2 is an explanatory diagram showing an example of a use case in which the medical observation system 1000 according to this embodiment is used, and shows an example of a use case in which the medical observation system 1000 according to the first example is used.
[0026] An image of a patient PA (a patient who is to undergo a medical procedure) to be observed is captured by an imaging device (described later) included in the medical observation apparatus 100. The captured image of the patient PA who is to undergo the medical procedure corresponds to an example of a medical captured image.
[0027] The medical captured images captured by the medical observation device 100 are displayed on the display screen of the display device 200. An operator OP (an example of a user of the medical observation device 100) who performs a medical procedure using the medical observation device 100 performs a medical procedure on a patient PA while viewing the medical captured images displayed on the display screen of the display device 200.
[0028] In addition, the surgeon OP operates an external operation device such as a foot switch FS of the medical observation device 100, or an operation device (described later) provided in the medical observation device 100, thereby operating an arm (described later) or an imaging device (described later) provided in the medical observation device 100, and bringing the medical observation device 100 into a desired state.
[0029] Hereinafter, each device constituting the medical observation system 1000 according to the first example shown in FIG. 1 will be described.
[0030] [1-1-1]Display device 200 The display device 200 is a display means in the medical observation system 1000 according to the first example, and corresponds to an external display device seen from the medical observation device 100. The display device 200 displays various images on a display screen, such as medical captured images captured by the medical observation device 100 and images related to a UI (User Interface). The display device 200 may also have a configuration capable of 3D display by any method. The display on the display device 200 is controlled, for example, by the medical observation device 100 or a medical control device (not shown).
[0031] In the medical observation system 1000, the display device 200 is installed at any location in the operating room, such as a wall, ceiling, or floor, where it can be viewed by someone involved in the operation, such as an operator.
[0032] Examples of the display device 200 include a liquid crystal display, an organic EL (Electro-Luminescence) display, and a CRT (Cathode Ray Tube) display.
[0033] The display device 200 is not limited to the above example. For example, the display device 200 may be any wearable device that is worn by a surgeon or the like on the body, such as a head-mounted display or an eyewear-type device.
[0034] The display device 200 is driven by, for example, power supplied from an internal power source such as a battery included in the display device 200, or power supplied from a connected external power source.
[0035] [1-1-2] Medical observation device 100 The medical observation device 100 shown in Fig. 1 is an example of an electronic imaging type medical observation device. For example, when the medical observation device 100 shown in Fig. 1 is used during surgery, the surgeon (an example of a user of the medical observation device 100; the same applies below) observes the operative site (affected area) while referring to the medical captured image captured by the medical observation device 100 and displayed on the display screen of the display device 200, and performs various treatments such as procedures according to the surgical procedure on the operative site.
[0036] As shown in FIG. 1, the medical observation device 100 includes, for example, a base 102, an arm 104, and an imaging device 106.
[0037] 1, the medical observation device 100 may include one or more processors (not shown) configured with an arithmetic circuit such as an MPU (Micro Processing Unit), a ROM (Read Only Memory, not shown), a RAM (Random Access Memory, not shown), a recording medium (not shown), and a communication device (not shown). The medical observation device 100 is driven by power supplied from an internal power source such as a battery included in the medical observation device 100, or by power supplied from a connected external power source.
[0038] The processor (not shown) functions as a control unit (described later) in the medical observation device 100. The ROM (not shown) stores control data such as programs and calculation parameters used by the processor (not shown). The RAM (not shown) temporarily stores programs executed by the processor (not shown).
[0039] The recording medium (not shown) functions as a storage unit (not shown) in the medical observation device 100. The recording medium (not shown) stores various data, such as data related to the display control method according to this embodiment and various applications. Here, examples of the recording medium (not shown) include a magnetic recording medium such as a hard disk, and a non-volatile memory such as a flash memory. The recording medium (not shown) may be detachable from the medical observation device 100.
[0040] The communication device (not shown) is a communication means provided in the medical observation device 100, and serves to perform wireless or wired communication with an external device such as the display device 200. Here, examples of the communication device (not shown) include an IEEE802.15.1 port and a transmitting / receiving circuit (wireless communication), an IEEE802.11 port and a transmitting / receiving circuit (wireless communication), a communication antenna and an RF (Radio frequency) circuit (wireless communication), or a LAN (Local Area Network) terminal and a transmitting / receiving circuit (wired communication).
[0041] [1-1-2-1] Base 102 The base 102 is a base for the medical observation device 100, and is connected to one end of the arm 104, supporting the arm 104 and the imaging device 106.
[0042] Further, for example, casters are provided on the base 102, and the medical observation device 100 is grounded to the floor surface via the casters. By providing the casters, the medical observation device 100 can be easily moved on the floor surface by the casters.
[0043] [1-1-2-2] Arm 104 The arm 104 is configured by a plurality of links connected to each other by joints.
[0044] Furthermore, the arm 104 supports the imaging device 106. The imaging device 106 supported by the arm 104 is movable three-dimensionally, and the position and orientation of the imaging device 106 after movement is maintained by the arm 104.
[0045] More specifically, the arm 104 is composed of, for example, a plurality of joints 110a, 110b, 110c, 110d, 110e, and 110f, and a plurality of links 112a, 112b, 112c, 112d, 112e, and 112f rotatably connected to each other by the joints 110a, 110b, 110c, 110d, 110e, and 110f. The rotatable ranges of the respective joints 110a, 110b, 110c, 110d, 110e, and 110f are arbitrarily set at the design stage, manufacturing stage, or the like so that a desired movement of the arm 104 is realized.
[0046] That is, in the medical observation device 100 shown in Fig. 1, six degrees of freedom are realized for the movement of the imaging device 106 by six rotation axes (first axis O1, second axis O2, third axis O3, fourth axis O4, fifth axis O5, and sixth axis O6) corresponding to six joints 110a, 110b, 110c, 110d, 110e, and 110f constituting the arm 104. More specifically, in the medical observation device 100 shown in Fig. 1, six degrees of freedom of movement are realized, that is, three degrees of translational freedom and three degrees of rotational freedom.
[0047] Each of the joints 110a, 110b, 110c, 110d, 110e, and 110f is provided with an actuator (not shown), and each of the joints 110a, 110b, 110c, 110d, 110e, and 110f rotates about a corresponding rotation axis by driving the actuator (not shown). The driving of the actuator (not shown) is controlled, for example, by a processor functioning as a control unit described later, or an external medical control device (not shown).
[0048] Each of the joints 110a, 110b, 110c, 110d, 110e, and 110f may be provided with an angle sensor (not shown) capable of detecting the rotation angle about each of the six rotation axes. The angle sensor may be, for example, a rotary encoder or an angular velocity sensor, or any other sensor capable of obtaining the rotation angle about each of the six rotation axes.
[0049] Each of the joints 110a, 110b, 110c, 110d, 110e, and 110f rotates about a corresponding rotation axis by being driven by an actuator (not shown), thereby realizing various movements of the arm 104, such as extending or retracting (folding) the arm 104.
[0050] The joint 110a has a substantially cylindrical shape, and supports the imaging device 106 (the upper end portion of the imaging device 106 in FIG. 1) at a tip portion (the lower end portion in FIG. 1) of the joint 110a so as to be rotatable about a rotation axis (first axis O1) parallel to the central axis of the imaging device 106. Here, the medical observation apparatus 100 is configured so that the first axis O1 coincides with the optical axis of the imaging device 106. That is, by rotating the imaging device 106 about the first axis O1 shown in FIG. 1, the medical imaging image captured by the imaging device 106 becomes an image whose field of view is changed so as to rotate.
[0051] The link 112a is a substantially rod-shaped member that fixedly supports the joint portion 110a. The link 112a extends, for example, in a direction perpendicular to the first axis O1, and is connected to the joint portion 110b.
[0052] The joint portion 110b has a substantially cylindrical shape and supports the link 112a so as to be rotatable about a rotation axis (second axis O2) perpendicular to the first axis O1. Further, the link 112b is fixedly connected to the joint portion 110b.
[0053] The link 112b is a generally rod-shaped member that extends in a direction perpendicular to the second axis O2. The link 112b is connected to the joints 110b and 110c.
[0054] The joint portion 110c has a substantially cylindrical shape and supports the link 112b so as to be rotatable about a rotation axis (third axis O3) perpendicular to the first axis O1 and the second axis O2. One end of the link 112c is fixedly connected to the joint portion 110c.
[0055] Here, by rotating the tip side (the side where the imaging device 106 is provided) of the arm 104 about the second axis O2 and the third axis O3, it is possible to move the imaging device 106 so that the position of the imaging device 106 in the horizontal plane is changed. That is, in the medical observation device 100, by controlling the rotation about the second axis O2 and the third axis O3, it becomes possible to move the field of view of the medical captured image in the plane.
[0056] The link 112c is a member having an approximately cylindrical shape at one end and an approximately rod-shaped shape at the other end. The joint 110c is fixedly connected to one end of the link 112c so that the central axis of the joint 110c is the same as the central axis of the approximately cylindrical shape. The joint 110d is connected to the other end of the link 112c.
[0057] The joint portion 110d has a substantially cylindrical shape and supports the link 112c so as to be rotatable about a rotation axis (fourth axis O4) perpendicular to the third axis O3. The link 112d is fixedly connected to the joint portion 110d.
[0058] The link 112d is a generally rod-shaped member and extends perpendicular to the fourth axis O4. One end of the link 112d is fixedly connected to the joint portion 110d so as to abut against a generally cylindrical side surface of the joint portion 110d. The other end of the link 112d (the end opposite to the side connected to the joint portion 110d) is connected to the joint portion 110e.
[0059] The joint 110e has a substantially cylindrical shape and supports one end of the link 112d so as to be rotatable about a rotation axis (fifth axis O5) parallel to the fourth axis O4. One end of the link 112e is fixedly connected to the joint 110e.
[0060] Here, the fourth axis O4 and the fifth axis O5 are rotation axes that can move the imaging device 106 in the vertical direction. The vertical position of the imaging device 106 changes as the tip side (the side on which the imaging device 106 is provided) of the arm 104 rotates around the fourth axis O4 and the fifth axis O5. Therefore, it is possible to change the distance between the imaging device 106 and the observation target, such as the surgical site of the patient, by rotating the tip side (the side on which the imaging device 106 is provided) of the arm 104 around the fourth axis O4 and the fifth axis O5.
[0061] Link 112e is a member formed by combining a first member having a substantially L-shape with one side extending vertically and the other side extending horizontally, and a rod-shaped second member extending vertically downward from a portion of the first member extending horizontally. A joint 110e is fixedly connected to a portion of the first member of link 112e extending vertically. A joint 110f is connected to the second member of link 112e.
[0062] The joint portion 110f has a substantially cylindrical shape and supports the link 112e so as to be rotatable about a rotation axis (sixth axis O6) parallel to the vertical direction. Further, a link 112f is fixedly connected to the joint portion 110f.
[0063] The link 112f is a generally rod-shaped member extending in the vertical direction. One end of the link 112f is connected to the joint portion 110f. The other end of the link 112f (the end opposite to the end connected to the joint portion 110f) is fixedly connected to the base 102.
[0064] By having the arm 104 configured as described above, the medical observation apparatus 100 realizes six degrees of freedom for the movement of the imaging device .
[0065] The configuration of the arm 104 is not limited to the example shown above.
[0066] For example, a brake for restricting rotation at each of the joints 110a, 110b, 110c, 110d, 110e, and 110f of the arm 104 may be provided at each of the joints 110a, 110b, 110c, 110d, 110e, and 110f. The brake according to this embodiment may be of any type, such as a mechanically driven brake or an electrically driven electromagnetic brake.
[0067] The driving of the brake is controlled, for example, by a processor functioning as a control unit described later, or an external medical control device (not shown). By controlling the driving of the brake, the operation mode of the arm 104 is set in the medical observation device 100. The operation modes of the arm 104 include, for example, a fixed mode and a free mode.
[0068] Here, the fixed mode according to the present embodiment is an operation mode in which the position and orientation of the imaging device 106 (the position and orientation of the imaging section 150, which will be described later) are fixed, for example, by restricting the rotation of each rotation axis provided on the arm 104 by a brake. When the arm 104 is in the fixed mode, the operation state of the medical observation device 100 becomes a fixed state in which the position and orientation of the imaging device 106 are fixed.
[0069] Moreover, the free mode according to this embodiment is an operation mode in which the brakes are released, so that each rotation axis provided on the arm 104 can rotate freely. For example, in the free mode, the position and attitude of the imaging device 106 (the position and attitude of the imaging section 150, which will be described later) can be adjusted by a direct operation by the surgeon. Here, the direct operation according to this embodiment means, for example, an operation in which the surgeon holds the imaging device 106 with his / her hand and moves the imaging device 106 directly.
[0070] [1-1-2-3] Imaging device 106 The imaging device 106 is supported by the arm 104, and captures an image of an observation target such as a patient's surgical site. The imaging by the imaging device 106 is controlled by, for example, a processor functioning as a control unit described later, or an external medical control device (not shown).
[0071] The imaging device 106 has a configuration corresponding to, for example, an electronic imaging microscope.
[0072] FIG. 3 is an explanatory diagram for explaining an example of the configuration of the imaging device 106 provided in the medical observation equipment 100 according to this embodiment.
[0073] The imaging device 106 has, for example, an imaging member 120 and a tubular member 122 having a substantially cylindrical shape, and the imaging member 120 is provided inside the tubular member 122 .
[0074] At the opening surface at the lower end (the lower end in FIG. 3) of the cylindrical member 122, for example, a cover glass (not shown) for protecting the imaging member 120 is provided.
[0075] Furthermore, for example, a light source (not shown) is provided inside the cylindrical member 122, and illumination light is irradiated from the light source onto the subject through a cover glass during imaging. Reflected light (observation light) from the subject irradiated with the illumination light is incident on the imaging member 120 through the cover glass (not shown), and an image signal indicating the subject (image signal indicating a medical imaging image) is obtained by the imaging member 120.
[0076] The imaging member 120 may be configured in any of a variety of known electronic imaging microscope configurations.
[0077] As an example, the imaging member 120 is composed of, for example, an optical system 120a and an image sensor 120b including an imaging element that captures an image of an observation target by light passing through the optical system 120a. The optical system 120a is composed of, for example, one or more lenses such as an objective lens, a zoom lens, and a focus lens, and optical elements such as a mirror. As the image sensor 120b, for example, an image sensor using multiple imaging elements such as a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device) can be mentioned.
[0078] The imaging member 120 functions as a so-called stereo camera by having two or more imaging devices each composed of an optical system 120a and an image sensor 120b. In the configuration of the imaging device 106 functioning as a stereo camera, the optical system may be a Galilean optical system or a Greenough optical system.
[0079] In the following, a medical observation device 100 according to this embodiment, including a medical observation device 100 constituting a medical observation system according to a second example described later, is provided with a plurality of imaging devices functioning as a stereo camera, and a plurality of medical imaging images including a medical imaging image for a right eye and a medical imaging image for a left eye are obtained by imaging with each of the plurality of imaging devices. In the following, an imaging device that captures a medical imaging image for a right eye is referred to as a "first imaging device", and an imaging device that captures a medical imaging image for a left eye is referred to as a "second imaging device". In the following, the medical imaging image for the right eye and the medical imaging image for the left eye may be collectively referred to as a "medical imaging image".
[0080] The imaging device constituting the imaging member 120 is equipped with one or more functions that are generally provided in an electronic imaging microscope section, such as a zoom function (either or both of an optical zoom function and an electronic zoom function) and an AF (Auto Focus) function.
[0081] Moreover, the imaging member 120 may be configured to be capable of imaging at so-called high resolution, such as 4K or 8K. By configuring the imaging member 120 to be capable of imaging at high resolution, it is possible to display an image on the display device 200 having a large display screen, such as 50 inches or more, while ensuring a predetermined resolution (such as Full HD image quality), thereby improving the visibility of the surgeon viewing the display screen. Furthermore, by configuring the imaging member 120 to be capable of imaging at high resolution, it is possible to ensure a predetermined resolution even if the captured image is enlarged by the electronic zoom function and displayed on the display screen of the display device 200. Furthermore, when a predetermined resolution is ensured using the electronic zoom function, it is possible to suppress the performance of the optical zoom function in the imaging device 106, so that the optical system of the imaging device 106 can be made simpler and the imaging device 106 can be configured to be smaller.
[0082] The imaging device 106 is provided with, for example, various operating devices for controlling the operation of the imaging device 106. For example, in Fig. 3, a zoom switch 124, a focus switch 126, and an operation mode change switch 128 are provided on the imaging device 106. It goes without saying that the positions and shapes of the zoom switch 124, the focus switch 126, and the operation mode change switch 128 are not limited to the example shown in Fig. 3.
[0083] The zoom switch 124 and the focus switch 126 are examples of operation devices for adjusting the imaging conditions of the imaging device 106 .
[0084] The zoom switch 124 is composed of, for example, a zoom-in switch 124a for increasing the zoom factor (magnification factor) and a zoom-out switch 124b for decreasing the zoom factor. By operating the zoom switch 124, the zoom factor is adjusted, and the zoom is adjusted.
[0085] The focus switch 126 is composed of, for example, a distant focus switch 126a for increasing the focal distance to the observation target (subject) and a close-up focus switch 126b for decreasing the focal distance to the observation target. By operating the focus switch 126, the focal distance is adjusted and the focus is adjusted.
[0086] The operation mode change switch 128 is an example of an operation device for changing the operation mode of the arm 104 in the imaging device 106. The operation mode of the arm 104 is changed by operating the operation mode change switch 128. As described above, examples of the operation modes of the arm 104 include the fixed mode and the free mode.
[0087] An example of an operation on the operation mode change switch 128 is an operation of pressing the operation mode change switch 128. For example, while the surgeon is pressing the operation mode change switch 128, the operation mode of the arm 104 becomes the free mode, and when the surgeon is not pressing the operation mode change switch 128, the operation mode of the arm 104 becomes the fixed mode.
[0088] Furthermore, the imaging device 106 is provided with, for example, a non-slip member 130 and a protruding member 132 in order to improve operability and convenience when an operator operates various operation devices.
[0089] The anti-slip member 130 is a member provided to prevent slipping of an operating object such as a hand when, for example, an operator operates the cylindrical member 122 with the operating object. The anti-slip member 130 is formed, for example, from a material with a high coefficient of friction and has a structure such as projections and recesses that makes it less slippery.
[0090] The protrusion member 132 is a member provided to prevent, when an operator operates the tubular member 122 with an operating object such as a hand, the operating object from blocking the field of view of the optical system 120a, and to prevent a cover glass (not shown) from becoming dirty due to the operating object touching the cover glass when operating the tubular member 122.
[0091] It goes without saying that the positions and shapes of the anti-slip members 130 and the protruding members 132 are not limited to the example shown in Fig. 3. Moreover, the imaging device 106 does not necessarily have to be provided with either or both of the anti-slip members 130 and the protruding members 132.
[0092] An image signal (image data) generated by imaging in the imaging device 106 is subjected to image processing, for example, in a processor functioning as a control unit described later. The image processing according to this embodiment includes, for example, one or more of various types of processing such as gamma correction, white balance adjustment, image enlargement or reduction related to an electronic zoom function, or inter-pixel correction.
[0093] In addition, when the medical observation system according to this embodiment has a medical control device (not shown) that controls various operations in the medical observation device 100, the image processing according to this embodiment may be performed in the medical control device (not shown).
[0094] The medical observation device 100 transmits, for example, a display control signal and an image signal that has been subjected to the above-described image processing to the display device 200.
[0095] A medical imaging image of an observation target (e.g., an imaging image of an operative part) is displayed on the display screen of the display device 200 by transmitting the display control signal and the image signal to the display device 200. At this time, the medical imaging image of an observation target may be enlarged or reduced to a desired magnification by one or both of an optical zoom function and an electronic zoom function and displayed on the display screen of the display device 200.
[0096] The medical observation device 100 shown in FIG. 1 has the hardware configuration shown with reference to, for example, FIGS.
[0097] The hardware configuration of the medical observation apparatus according to this embodiment is not limited to the configuration shown with reference to FIGS.
[0098] For example, the medical observation device according to this embodiment may not have the base 102, and may have a configuration in which the arm 104 is directly attached to the ceiling or wall of an operating room, etc. For example, when the arm 104 is attached to the ceiling, the medical observation device according to this embodiment has a configuration in which the arm 104 is suspended from the ceiling.
[0099] 1 shows an example in which the arm 104 is configured to realize six degrees of freedom for driving the imaging device 106, but the configuration of the arm 104 is not limited to a configuration in which the degrees of freedom for driving the imaging device 106 are six. For example, the arm 104 may be configured to be able to move the imaging device 106 appropriately depending on the application, and the number and arrangement of the joints and links, the direction of the drive shaft of the joints, and the like can be set appropriately so that the arm 104 has the desired degrees of freedom.
[0100] 1 and 3 show an example in which various operation devices for controlling the operation of the imaging device 106 are provided on the imaging device 106, but some or all of the operation devices shown in FIGS. 1 and 3 do not have to be provided on the imaging device 106. As one example, the various operation devices for controlling the operation of the imaging device 106 may be provided on a portion other than the imaging device 106 constituting the medical observation apparatus according to this embodiment. As another example, the various operation devices for controlling the operation of the imaging device 106 may be external operation devices such as a foot switch FS or a remote controller.
[0101] The imaging device 106 may be configured to be capable of switching between a plurality of observation modes. Examples of the observation modes according to the present embodiment include an observation mode in which imaging is performed using natural light, an observation mode in which imaging is performed using special light, and an observation mode in which imaging is performed using an image enhancement observation technique such as NBI (Narrow Band Imaging). The special light according to the present embodiment is light in a specific wavelength band, such as light in a near-infrared wavelength band or light in a fluorescent wavelength band for fluorescent observation using 5-ALA (5-Aminolevulinic Acid).
[0102] An example of the configuration of the imaging device 106 capable of switching between a plurality of observation modes is, for example, "a configuration including a filter that transmits light of a specific wavelength band and does not transmit light of other wavelength bands, and a moving mechanism that selectively positions the filter on the optical path." Examples of the specific wavelength band that the filter according to this embodiment transmits include a near-infrared wavelength band (e.g., a wavelength band of about 0.7 [micrometers] to 2.5 [micrometers]), a fluorescent wavelength band in fluorescent observation using 5-ALA (e.g., a wavelength band of about 0.6 [micrometers] to 0.65 [micrometers]), and a fluorescent wavelength band of ICG (Indocyanine Green) (e.g., a wavelength band of about 0.82 [micrometers] to 0.85 [micrometers]).
[0103] Note that the imaging device 106 may be provided with a plurality of filters that transmit different wavelength bands. In addition, in the above example, a filter is disposed on the optical path to capture an image with light of a specific wavelength band, but it goes without saying that the configuration of the imaging device 106 for capturing an image with light of a specific wavelength band is not limited to the above example.
[0104] [1-2] Second Example of Medical Observation System The medical observation system 1000 according to this embodiment is not limited to the configuration shown in the first example in Fig. 1. Next, as another example of the medical observation system 1000, an example of the configuration of a medical observation system 1000 having a medical observation device 100 that functions as an endoscope device will be described.
[0105] Fig. 4 is an explanatory diagram showing a second example of the configuration of the medical observation system 1000 according to this embodiment. The medical observation system 1000 shown in Fig. 4 has, for example, a medical observation device 100 and a display device 200. For example, when the medical observation device 100 shown in Fig. 4 is used during surgery, the surgeon observes the surgical site while referring to the medical captured image captured by the medical observation device 100 and displayed on the display screen of the display device 200, and performs various procedures such as a procedure according to the surgical procedure on the surgical site.
[0106] The medical observation system according to the second example is not limited to the example shown in FIG.
[0107] For example, the medical observation system according to the second example may further include a medical control device (not shown) that controls various operations in the medical observation device 100, like the medical observation system according to the first example.
[0108] Moreover, the medical observation system according to the second example may have a configuration including a plurality of either or both of the medical observation devices 100 and the display devices 200, like the medical observation system according to the first example.
[0109] Hereinafter, each device constituting the medical observation system 1000 according to the second example shown in FIG. 4 will be described.
[0110] [1-2-1]Display device 200 The display device 200 is a display means in the medical observation system 1000 according to the second example, and corresponds to an external display device seen from the medical observation device 100. The display device 200 constituting the medical observation system 1000 according to the second example is similar to the display device 200 constituting the medical observation system 1000 according to the first example.
[0111] [1-2-2] Medical observation device 100 4 includes, for example, an insertion member 134, a light source unit 136, a light guide 138, a camera head 140, a cable 142, and a control unit 144. The medical observation device 100 is driven by, for example, power supplied from an internal power source such as a battery included in the medical observation device 100, or power supplied from a connected external power source.
[0112] The insertion member 134 has an elongated shape and includes an optical system for focusing incident light. The tip of the insertion member 134 is inserted, for example, into a body cavity of a patient. The rear end of the insertion member 134 is detachably connected to the tip of a camera head 140. The insertion member 134 is also connected to a light source unit 136 via a light guide 138, and light is supplied from the light source unit 136.
[0113] The insertion member 134 may be formed, for example, from a material that does not have flexibility, or may be formed from a material that has flexibility. Depending on the material from which the insertion member 134 is formed, the medical observation device 100 may be called a rigid endoscope or a flexible endoscope.
[0114] The light source unit 136 is connected to the insertion member 134 via a light guide 138. The light source unit 136 supplies light to the insertion member 134 via the light guide 138.
[0115] The light source unit 136 has, for example, a plurality of light sources that emit light of different wavelengths. The light source unit 136 has, for example, a light source that emits red light, a light source that emits green light, and a light source that emits blue light. The light source that emits red light, for example, includes one or more red light-emitting diodes. The light source that emits green light, for example, includes one or more green light-emitting diodes. The light source that emits blue light, for example, includes one or more blue light-emitting diodes. It goes without saying that the plurality of light sources that the light source unit 136 has are not limited to the above examples. The light source unit 136 has, for example, a plurality of light sources in a single chip, or a plurality of light sources in a plurality of chips.
[0116] The light source unit 136 is connected to the control unit 144 by wire or wirelessly, and the light emission in the light source unit 136 is controlled by the control unit 144 .
[0117] The light supplied to the insertion member 134 is emitted from the tip of the insertion member 134 and irradiated onto an observation target such as tissue in a patient's body cavity. Then, the light reflected from the observation target is collected by an optical system within the insertion member 134.
[0118] The camera head 140 has a function of capturing an image of an object to be observed. The camera head 140 is connected to a control unit 144 via a cable 142 which is a signal transmission member.
[0119] Camera head 140 has an image sensor, captures an image of the observation target by photoelectrically converting the reflected light from the observation target collected by insertion member 134, and outputs an image signal obtained by capturing the image (a signal indicating a medical captured image) to control unit 144 via cable 142. An example of the image sensor included in camera head 140 is an image sensor using multiple imaging elements such as CMOS or CCD.
[0120] In the medical observation apparatus 100 functioning as an endoscope apparatus, for example, the insertion member 134, the light source unit 136, and the camera head 140 function as an "imaging device that is inserted into the patient's body and captures images of the inside of the body."
[0121] The medical observation device 100 functioning as an endoscope device includes a plurality of imaging devices functioning as so-called stereo cameras. In the configuration of the imaging devices functioning as stereo cameras, the optical system may be a Galilean optical system or a Greenough optical system, similar to the medical observation device 100 constituting the medical observation system according to the first example.
[0122] The control unit 144 controls the imaging device, more specifically, the control unit 144 controls the light source unit 136 and the camera head 140, respectively.
[0123] Furthermore, the control unit 144 includes a communication device (not shown) and transmits the image signal output from the camera head 140 to the display device 200 by any wireless communication or any wired communication. The control unit 144 may transmit the image signal and a display control signal to the display device 200.
[0124] Examples of communication devices (not shown) included in the control unit 144 include an IEEE802.15.1 port and a transmitting / receiving circuit (wireless communication), an IEEE802.11 port and a transmitting / receiving circuit (wireless communication), a communication antenna and an RF circuit (wireless communication), an optical communication device (wired communication or wireless communication), or a LAN terminal and a transmitting / receiving circuit (wired communication), etc. The communication device (not shown) may be configured to be capable of communicating with one or more external devices by a plurality of communication methods.
[0125] Furthermore, control unit 144 may perform a predetermined process on the image signal output from camera head 140, and transmit the image signal after the predetermined process to display device 200. Examples of the predetermined process on the image signal include white balance adjustment, image enlargement or reduction related to an electronic zoom function, inter-pixel correction, and the like.
[0126] The control unit 144 may store a medical imaging image based on the image signal.
[0127] An example of the control unit 144 is a CCU (Camera Control Unit).
[0128] The medical observation device 100 functioning as an endoscope device has, for example, the hardware configuration shown with reference to Fig. 4. In the medical observation device 100 functioning as an endoscope device, for example, the insertion member 134, the light source unit 136, and the camera head 140 function as an imaging device, and the control unit 144 controls the imaging in the imaging device.
[0129] [1-3] Functional configuration of medical observation device 100 Next, the medical observation device 100 shown in Figures 1 and 4 will be described using functional blocks. Figure 5 is a functional block diagram showing an example of the configuration of the medical observation device 100 according to this embodiment.
[0130] The medical observation device 100 includes, for example, an imaging section 150, a communication section 152, and a control section 154.
[0131] The imaging section 150 captures an image of an observation target. The imaging section 150 may be, for example, an "imaging device 106" (in the case of the medical observation device 100 shown in FIG. 1) or an "insertion member 134, a light source unit 136, and a camera head 140." (In the case of the medical observation device 100 shown in FIG. 4), the imaging in the imaging section 150 is controlled by the control section 154, for example.
[0132] The communication unit 152 is a communication means provided in the medical observation device 100, and serves to communicate wirelessly or wired with an external device such as the display device 200. The communication unit 152 is configured, for example, with the above-mentioned communication device (not shown). The communication in the communication unit 152 is controlled, for example, by the control unit 154.
[0133] The control unit 154 is composed of, for example, the above-mentioned processor (not shown), and serves to control the entire medical observation device 100. The control unit 154 also plays a leading role in carrying out processing related to a display control method described below. Note that the processing related to the display control method in the control unit 154 may be distributed and carried out by multiple processing circuits (for example, multiple processors, etc.).
[0134] More specifically, the control unit 154 includes, for example, an imaging control unit 156 and a processing unit 158.
[0135] The imaging control unit 156 controls the imaging device constituting the imaging unit 150. Examples of the control of the imaging device include control of one or more functions generally provided in an electronic imaging type microscope unit, such as control of a zoom function (optical zoom function and electronic zoom function) and an AF function.
[0136] The processing unit 158 performs processing related to a display control method according to the present embodiment, which will be described later. An example of the functional configuration of the processing unit 158 and an example of processing related to the display control method according to the present embodiment will be described later.
[0137] The control unit 154 plays a leading role in carrying out the processing related to the display control method according to the present embodiment by, for example, having the processing unit 158. In addition, the control unit 154 plays a role in controlling the entire medical observation device 100 by, for example, having the imaging control unit 156 and the processing unit 158.
[0138] The functional configuration of the control unit 154 is not limited to the example shown in FIG.
[0139] For example, the control unit 154 can have any configuration according to how the functions of the medical observation device 100 are divided, such as a configuration according to how the processes related to the display control method according to this embodiment are divided.
[0140] As an example, when the medical observation device 100 has the configuration shown in Fig. 1, the control unit 154 may further have an arm control unit (not shown) that controls the driving of the arm 104. An example of the control of the driving of the arm 104 is, for example, "applying control signals for controlling the driving to actuators (not shown) corresponding to the joints 110a, 110b, 110c, 110d, 110e, and 110f".
[0141] The medical observation device 100 performs processing related to a display control method according to this embodiment, which will be described later, using the functional configuration shown in FIG.
[0142] The functional configuration of the medical observation apparatus according to this embodiment is not limited to the configuration shown in FIG.
[0143] For example, the medical observation apparatus according to this embodiment can include one or both of the imaging control unit 156 and the processing unit 158 shown in FIG. 5 separately from the control unit 154 (for example, realized by a separate processing circuit).
[0144] Furthermore, the functional configuration capable of executing the processing related to the display control method according to this embodiment in the medical observation device according to this embodiment is not limited to the configuration shown in FIG. 5. For example, the medical observation device according to this embodiment can have a functional configuration according to how the processing related to the display control method according to this embodiment is divided.
[0145] 1, the medical observation apparatus according to this embodiment has an arm section (not shown) constituted by the arm 104. The arm 104 constituting the arm section (not shown) supports the imaging device 106 constituting the imaging section 150.
[0146] Furthermore, for example, when communication with an external apparatus is performed via an external communication device having the same function and configuration as the communication unit 152, the medical observation apparatus according to this embodiment does not need to be equipped with the communication unit 152.
[0147] Moreover, when the medical observation system according to this embodiment has a medical control device (not shown) and the medical observation device according to this embodiment is controlled by the medical control device (not shown), the medical observation device according to this embodiment does not need to have the control unit 154.
[0148] Here, the medical control device (not shown) performs processing related to the display control method according to the present embodiment, which will be described later, by including a control unit having the same functions and configuration as the control unit 154, and also controls the operation of each component of the medical observation device according to the present embodiment, such as the imaging unit 150. The medical control device (not shown) controls the operation of each component of the medical observation device according to the present embodiment by communicating with the medical observation device according to the present embodiment via a communication device included therein or an external communication device connected thereto.
[0149] Furthermore, when the medical observation system according to this embodiment has a medical control device (not shown) and the medical observation device according to this embodiment is controlled by the medical control device (not shown), the medical observation device according to this embodiment can have a configuration that does not have some of the functions of the control unit 154.
[0150] [2] Display control method according to this embodiment Next, a display control method according to this embodiment will be described. In the following, a case where the processing related to the display control method according to this embodiment is performed by the medical observation device 100 will be taken as an example. As described above, in the medical observation system according to this embodiment, the processing related to the display control method according to this embodiment may be performed by a medical control device (not shown) or the like.
[0151] [2-1] Overview of the display control method according to the present embodiment In surgery (so-called microsurgery) performed using the medical observation device 100, there are cases where the surgeon needs to measure the length of a lesion within the observation field, as in the example shown below. Clipping of a cerebral aneurysm using the medical observation device 100 shown in Figure 1: The length of the lesion must be measured to select the optimal clip according to the shape and length of the neck of the cerebral aneurysm. Endoscopic (abdominal scar) hernia surgery performed using a medical observation device 100 (e.g., a rigid endoscope) shown in FIG. 4: The length of the hernia orifice needs to be measured in order to close the hernia orifice and trim it into a mesh shape that ensures a sufficient overlap area. Arthroscopic patch repair of a rotator cuff tear using a medical observation device 100 (e.g., a rigid endoscope) as shown in FIG. 4: The length of the tear needs to be measured to determine the size of the fascial patch required to repair the tear.
[0152] In such cases, the length of the affected area is sometimes measured using a tape measure in the medical field. However, this method is not considered to be a simple measurement method because, for example, the procedure stops when the tape measure is inserted into the affected area, and the tape measure requires time and effort to be disposed of and washed.
[0153] In addition, when it is necessary to measure the length of a lesion, since there is no simple method for measuring the length, the surgeon may estimate the length by relying on experience or intuition instead of measuring it. However, estimation based on experience or intuition does not necessarily ensure accurate measurement of the length of the lesion. In addition, taking the clipping procedure for a cerebral aneurysm as an example, if the length estimation accuracy is low, undesirable situations may occur, such as trial and error in selecting a clip, resulting in unnecessary clips and an increased risk of damage to the aneurysm.
[0154] Therefore, the medical observation device 100 displays an annotation image indicating the distance between two positions on the observation target on the display screen of the display device 200. Hereinafter, the distance between two positions on the observation target may be simply referred to as the "distance between two points."
[0155] The positions of the two points on the object are obtained based on a predetermined motion with respect to the object.
[0156] The predetermined action on the observation target includes, for example, an action of moving a predetermined medical instrument such as forceps or a position detection probe into the imaging range of the imaging device 106 functioning as the imaging section 150.
[0157] The position of the observation target based on the predetermined medical instrument is obtained, for example, by "detecting the predetermined medical instrument from one or both of the right-eye medical capture image and the left-eye medical capture image", i.e., by "detecting an object corresponding to a predetermined action from one or both of the right-eye medical capture image and the left-eye medical capture image". The detection of the object corresponding to the predetermined action from the medical capture image is performed by any image processing capable of detecting an object from an image, such as detection by pattern matching. The position of a specific part of the object detected from the medical capture image (for example, the position of the tip of the forceps) corresponds to the position obtained based on the predetermined action on the observation target.
[0158] By detecting an object in one of the right-eye medical imaging image and the left-eye medical imaging image, a position in a plane corresponding to the medical imaging image is identified as a position in the observation target, where the position in the observation target is expressed in two-dimensional coordinates with an arbitrary position as the origin.
[0159] Furthermore, by detecting an object from both the right-eye medical captured image and the left-eye medical captured image, a spatial position corresponding to the medical captured image is identified as a position on the observation target, where the position on the observation target is expressed in three-dimensional spatial coordinates with an arbitrary position as the origin.
[0160] Either or both of the image processing related to the detection and the image processing related to the position identification may be performed by the medical observation device 100, or may be performed in an external device such as a medical control device (not shown) of the medical observation device 100. Moreover, the image processing related to the detection and the image processing related to the position identification may be performed in cooperation between the medical observation device 100 and the external device.
[0161] The position of the observation target based on the position detection probe is obtained, for example, by "the above-mentioned navigation device detecting the spatial position of the position detection probe." When the detection result of the navigation device is used, the medical observation device 100 acquires position information from the navigation device (an example of a detection device that detects a position in the observation target) and specifies the spatial position indicated by the position information as the position in the observation target. In this case, the medical observation device 100 does not need to perform image processing related to the detection and image processing related to the position specification, so the processing load on the medical observation device 100 is reduced and the configuration of the medical observation device 100 can be simplified.
[0162] For example, the distance between two points corresponding to the positions of the two points specified as described above is obtained by calculating the Euclidean distance between the positions of the two points obtained. Note that the distance between the two points is not limited to the Euclidean distance, and may be a distance obtained by any method capable of expressing the distance between the two points. The process of calculating the distance may be performed by the medical observation device 100, or may be performed by an external device of the medical observation device 100, such as a medical control device (not shown).
[0163] Fig. 6 is an explanatory diagram for explaining an example of an annotation image displayed by the display control method according to the present embodiment. Fig. 7 is an explanatory diagram for explaining another example of an annotation image displayed by the display control method according to the present embodiment.
[0164] A of FIG. 6 shows an example of a medical imaging image before an annotation image is displayed. The medical imaging image shown in A of FIG. 6 may be either or both of a right-eye medical imaging image and a left-eye medical imaging image. B of FIG. 6 shows an example of a position acquired for the medical imaging image shown in A of FIG. 6, and in the example shown in B of FIG. 6, two positions, positions P1 and P2, are shown. C of FIG. 6 shows an example of a medical imaging image after annotation images AO corresponding to positions P1 and P2 shown in FIG. 6 are displayed for the medical imaging image shown in A of FIG. 6. FIG. 7 shows an example of a medical imaging image after a plurality of annotation images are displayed for the medical imaging image shown in A of FIG. 6, and in FIG. 7, annotation images AO1 and AO2 are displayed.
[0165] For example, as shown in C of Fig. 6, when the display control method according to this embodiment is used, the medical observation device 100 displays the annotation image AO superimposed on one or both of the medical captured image for the right eye and the medical captured image for the left eye. By superimposing the annotation image AO on the medical captured image as shown in C of Fig. 6, a medical professional such as an operator can visually recognize, for example, the length of a lesion within the observation field of view.
[0166] Furthermore, as shown in Fig. 7, for example, when the display control method according to this embodiment is used, the medical observation device 100 can also display multiple annotation images AO1 and AO2 superimposed on one or both of a right-eye medical imaging image and a left-eye medical imaging image. The medical observation device 100 displays annotation images corresponding to each pair of acquired two-point positions superimposed on the medical imaging image. By superimposing multiple annotation images AO1 and AO2 on the medical imaging image as shown in Fig. 7, a medical professional such as an operator can visually recognize, for example, the lengths of multiple lesions in the observation field at once.
[0167] Note that examples of annotation images according to the present embodiment are not limited to images in which the distance between two points is displayed as a numerical value, as shown in Fig. 6C and Fig. 7. For example, the annotation image according to the present embodiment may be "an image of a medical instrument corresponding to the distance between two points, such as an image of a paperclip corresponding to the distance between two points," or "an image showing the model number of a medical instrument corresponding to the distance between two points, or the name of a medical instrument corresponding to the distance between two points."
[0168] As described above, when the display control method according to the present embodiment is used, an annotation image is displayed based on the operation of moving a predetermined medical instrument such as forceps into the imaging range of the imaging device 106, or the operation of moving a position detection probe into the imaging range of the imaging device 106. In other words, when the display control method according to the present embodiment is used, an annotation image is displayed by an operation that is more closely related to "a medical procedure performed by a medical professional using the medical observation device 100" than a GUI operation. Therefore, the possibility that a medical procedure will be interrupted by a predetermined operation on an observation target according to the present embodiment is lower than when a GUI operation according to the technology described in Patent Document 1 is performed.
[0169] Therefore, by using the display control method according to this embodiment, the convenience for the user of the medical observation device 100 can be improved.
[0170] [2-2] Example of processing related to the display control method according to the present embodiment An example of processing related to the display control method according to the present embodiment will be described below. In the following, a case where the processing related to the display control method according to the present embodiment is performed in the processing unit 158 shown in FIG. 4 will be described as an example.
[0171] [2-2-1] First example of processing related to display control method Fig. 8 is a functional block diagram showing a first example of the configuration of the processing unit 158 included in the medical observation device 100 according to this embodiment. The "right eye image signal" shown in Fig. 8 indicates an image signal showing a right eye medical captured image captured by a first imaging device (hereinafter, the same applies to other figures). The "left eye image signal" shown in Fig. 8 indicates an image signal showing a left eye medical captured image captured by a second imaging device (hereinafter, the same applies to other figures).
[0172] The processing unit 158 according to the first example includes an acquisition unit 160, a distance calculation unit 162, and a display control unit 164, for example.
[0173] The acquisition section 160 acquires the positions of at least two points on the object of observation that are identified based on a predetermined action on the object of observation.
[0174] The acquisition unit 160 acquires the position of the observation target by detecting an object corresponding to a predetermined action from one or both of the right-eye medical imaging image and the left-eye medical imaging image, as described above. The acquisition unit 160 can also acquire the position of the observation target by acquiring position information from a navigation device (an example of a detection device, hereinafter the same) as described above.
[0175] The acquisition unit 160 transmits the acquired information indicating the position to the distance calculation unit 162. Examples of the information indicating the position include data indicating two-dimensional coordinates or data indicating three-dimensional spatial coordinates. When the position information is acquired from a navigation device, the acquisition unit 160 may transmit the position information acquired from the navigation device to the distance calculation unit 162 as information indicating the position, or may transmit information obtained by performing some processing on the position information to the distance calculation unit 162 as information indicating the position.
[0176] Fig. 9 is a flow chart showing an example of processing in the acquisition unit 160 of the processing unit 158 included in the medical observation device 100 according to this embodiment. Fig. 9 shows an example of processing in the case of "obtaining a position of an observation target by detecting an object corresponding to a predetermined action from a medical captured image".
[0177] The acquisition unit 160 determines whether or not a predetermined medical instrument is present within the observation field of view (S100). The acquisition unit 160 determines that the predetermined medical instrument is present when the predetermined medical instrument is detected by any image processing capable of detecting an object from an image, such as detection by pattern matching.
[0178] If it is determined in step S100 that the predetermined medical instrument is not present, the acquisition unit 160 does not proceed with the process shown in FIG.
[0179] Furthermore, if it is determined in step S100 that a predetermined medical instrument is present, the acquisition unit 160 determines whether or not a position acquisition operation has been detected (S102).
[0180] Examples of position acquisition operations include any operation such as "operation on an operation device provided in the medical observation device 100", "operation on an operation device external to the medical observation device 100 such as a foot switch FS", "operation by gesture", and "operation by voice".
[0181] When the position acquisition operation is an operation on an operation device included in the medical observation apparatus 100, or an operation on an external operation device, the acquisition unit 160 identifies the position acquisition operation based on, for example, an operation signal corresponding to the operation.
[0182] When the position acquisition operation is a gesture operation, the acquisition unit 160 identifies the position acquisition operation by the gesture, for example, based on "a gesture detection result detected by any image processing on a captured image in which a detection target of the operation is captured." The image processing related to the detection of the gesture may be performed by the medical observation device 100 or may be performed in an external device of the medical observation device 100.
[0183] When the position acquisition operation is an operation by voice, the acquisition unit 160 identifies the position acquisition operation by voice, for example, based on "a detection result of a predetermined voice detected by arbitrary signal processing of a voice acquired by a voice input device such as a microphone." The voice input device may be a voice input device included in the medical observation device 100, or may be a voice input device external to the medical observation device 100. The signal processing related to the position acquisition operation for the voice may be performed by the medical observation device 100, or may be performed in a device external to the medical observation device 100.
[0184] If it is determined in step S102 that a position acquisition operation is not detected, the acquisition section 160 repeats the process from step S100.
[0185] Furthermore, if it is determined in step S102 that a position acquisition operation has been detected, the acquisition unit 160 acquires a position corresponding to a predetermined medical instrument based on the medical captured image (S104).
[0186] The acquiring unit 160 acquires the position of the observation target by performing, for example, the process shown in Fig. 9. Note that, as described above, the example of the process in the acquiring unit 160 is not limited to the example shown in Fig. 9.
[0187] 8 again, the functional configuration of the processing unit 158 according to the first example will be described. The distance calculation unit 162 calculates the distance corresponding to the acquired two positions based on the information indicating the positions transmitted from the acquisition unit 160. When the acquisition unit 160 acquires a plurality of two-point positions, the distance calculation unit 162 calculates the distance corresponding to each pair of the acquired two-point positions. The distance calculation unit 162 calculates, for example, the Euclidean distance between the two points.
[0188] Distance calculation unit 162 transmits information indicating the calculated distance between the two points to display control unit 164. For example, the information indicating the distance may be numerical data indicating the distance. When a plurality of distances between two points are calculated, distance calculation unit 162 transmits information indicating the distance corresponding to each pair of the positions of the two points to display control unit 164. For example, the information indicating the distance may be numerical data indicating the distance.
[0189] FIG. 10 is a flowchart showing an example of processing in the distance calculation unit 162 of the processing unit 158 provided in the medical observation apparatus according to this embodiment.
[0190] The distance calculation unit 162 judges whether the information indicating the position transmitted from the acquisition unit 160 includes two points (S200). For example, the distance calculation unit 162 sets a pair of two positions in the order in which the information indicating the position is transmitted, and judges that there are two points when the pair of two positions is set. Also, if the information indicating the position includes identification information (e.g., an ID) indicating the pair of two positions, the distance calculation unit 162 may set the pair of two positions according to the identification information, and judges that there are two points when the pair of two positions is set.
[0191] If it is not determined in step S200 that there are two points, the distance calculation unit 162 does not proceed with the process in FIG. 10 until it is determined that there are two points.
[0192] If it is determined in step S200 that there are two points, the distance calculation unit 162 calculates the distance between the two points (S202).
[0193] The distance calculation unit 162 calculates the distance corresponding to the positions of the two acquired points by performing, for example, the process shown in Fig. 10. It goes without saying that the example of the process in the distance calculation unit 162 is not limited to the example shown in Fig. 10.
[0194] Referring again to Fig. 8, the functional configuration of the processing unit 158 according to the first example will be described. The display control unit 164 displays a right-eye medical captured image, a left-eye medical captured image, and an annotation image indicating the distance between two points whose positions have been acquired, on the display screen of the display device 200. For convenience, in Fig. 8, the image signal indicating the right-eye medical captured image, the image signal indicating the left-eye medical captured image, and the image signal indicating the annotation image output from the display control unit 164 are referred to as "image signals" (the same applies to diagrams of the processing unit 158 according to other examples described later).
[0195] The display control unit 164 reads out annotation images corresponding to the information indicating the distances from, for example, a recording medium (not shown) functioning as a storage unit (not shown), and displays the read annotation images on the display screen of the display device 200. When information indicating the distances corresponding to each pair of two-point positions is transmitted, that is, when a plurality of two-point positions are acquired, the display control unit 164 displays annotation images corresponding to each distance between the two points on the display screen. The annotation images corresponding to the information indicating the distances are specified, for example, by referring to a table (or database) in which distances and annotation images are associated with each other.
[0196] The display control unit 164 displays the annotation image so as to be superimposed on one or both of the right-eye medical captured image and the left-eye medical captured image, as shown in, for example, C of FIG. 6 and FIG.
[0197] The processing unit 158 that performs processing related to the display control method according to the first example has a functional configuration shown in FIG. 8, for example, to display an annotation image such as that shown in FIG. 6C or FIG. 7 together with a medical image.
[0198] The functional configuration of the processing unit 158 according to the first example is not limited to the example shown in FIG.
[0199] For example, in the processing unit 158 according to the first example, the display control unit 164 may have the function of the distance calculation unit 162 .
[0200] Furthermore, when the processing in the distance calculation unit 162 is performed in a device external to the medical observation device 100, the processing unit 158 according to the first example does not need to have the distance calculation unit 162. In this case, the display control unit 164 causes an annotation image corresponding to information indicating the distance acquired from the external device to be displayed on the display screen.
[0201] Moreover, the processing unit 158 according to the first example can have a configuration according to how the processes related to the display control method according to the present embodiment are divided.
[0202] [2-2-2] Second example of processing related to display control method FIG. 11 is a functional block diagram showing a second example of the configuration of the processing unit 158 included in the medical observation device 100 according to this embodiment.
[0203] The processing unit 158 has, for example, an acquisition unit 160, a distance calculation unit 162, and a display control unit 166. The processing unit 158 according to the second example shown in Fig. 11 has basically the same functions as the processing unit 158 according to the first example shown in Fig. 8, but the functions of the display control unit 166 are different from the functions of the display control unit 164 shown in Fig. 8. Hereinafter, of the functional configuration of the processing unit 158 according to the second example, points that are different from the processing unit 158 according to the first example shown in Fig. 8 will be described, and a description of similar points will be omitted.
[0204] The display control unit 166, like the display control unit 164 shown in FIG. 8, causes the display device 200 to display a right-eye medical captured image, a left-eye medical captured image, and an annotation image on the display screen.
[0205] Furthermore, the display control unit 166 changes the display of the annotation image so as to correspond to a change in either or both of the position and the orientation of the imaging unit 150.
[0206] A change in the position and / or the attitude of the imaging unit 150 corresponds to a change in the position and / or the attitude of the imaging device 106 functioning as the imaging unit 150. The change in the position and the attitude of the imaging device 106 is detected, for example, by an angle sensor (not shown) provided in each of the above-mentioned joints 110a, 110b, 110c, 110d, 110e, and 110f. The change in the position and the attitude of the imaging device 106 may be detected by any method capable of detecting each of the changes. In FIG. 11, data indicating the change in the position and the change in the attitude of the imaging device 106 is indicated as "imaging position and attitude information."
[0207] When one or both of the position and the posture of the imaging unit 150 change, the medical imaging image for the right eye and the medical imaging image for the left eye change. On the other hand, even when one or both of the position and the posture of the imaging unit 150 change, the positions of two points on the observation target acquired based on a predetermined operation on the observation target do not change. Therefore, the distance between two points acquired based on a predetermined operation on the observation target does not change even if one or both of the position and the posture of the imaging unit 150 change.
[0208] At this time, a predetermined operation is performed again on the observation target, and the medical observation device 100 performs the process according to the first example described above again, making it possible to "achieve display of the annotation image together with the changed medical imaging image." However, if a medical professional such as an operator must perform a predetermined operation on the observation target every time one or both of the position and the posture of the imaging unit 150 change, the medical professional may find the operation bothersome.
[0209] Therefore, the display control unit 166 moves the positions of the two points on the display screen (hereinafter, referred to as "display positions of the two points" to distinguish them from the positions of the two points on the observation target) so as to correspond to the change in one or both of the position and the attitude of the imaging unit 150. The display positions of the two points after the movement can be obtained, for example, by "a calculation using the display positions of the two points before the movement and an affine matrix corresponding to the change in one or both of the position and the attitude of the imaging unit 150". Note that the method of specifying the display positions of the two points after the movement is not particularly limited. Then, the display control unit 166 displays an annotation image corresponding to the display positions of the two points after the movement. Examples of the annotation image corresponding to the display positions of the two points after the movement include "an image obtained by performing rotation, enlargement / reduction, translation, or a combination of these in a three-dimensional space on the annotation image before the movement". The display control unit 166 reads out, for example, information indicating the distance and the annotation image corresponding to the display positions of the two points from a recording medium (not shown), and displays the read annotation image on the display screen of the display device 200. As a specific example, a recording medium (not shown) stores in advance, for example, "an annotation image rotated, enlarged, reduced, translated, or a combination thereof in a three-dimensional space" for each combination of the display positions of the two points before the movement and the display positions of the two points after the movement. The display control unit 166 reads out the above-mentioned image corresponding to the combination of the display positions of the two points before the movement and the display positions of the two points after the movement from the recording medium (not shown) as an annotation image corresponding to the display positions of the two points after the movement, and displays the read annotation image on the display screen of the display device 200. Note that examples of the annotation image corresponding to the display positions of the two points after the movement are not limited to the examples shown above. For example, the display control unit 166 may generate an annotation image corresponding to the display positions of the two points after the movement by using the annotation image read out from the recording medium as a reference image and performing affine transformation on the reference image in the same manner as in the process related to the display control method related to the first example.
[0210] The processing unit 158 that performs the processing related to the display control method according to the second example basically has the same configuration as the processing unit 158 according to the first example shown in Fig. 8. Therefore, like the processing unit 158 according to the first example shown in Fig. 8, the processing unit 158 according to the second example can display an annotation image such as that shown in C of Fig. 6 or Fig. 7 together with a medical imaging image.
[0211] Moreover, the processing unit 158 according to the second example automatically changes the display of the annotation image so as to correspond to a change in either or both of the position and the posture of the imaging unit 150. In other words, a medical professional using the medical observation device 100 that performs the process according to the display control method according to the second example does not need to perform a predetermined operation on the observation target every time either or both of the position and the posture of the imaging unit 150 change.
[0212] Therefore, the medical observation device 100 that performs the processing related to the display control method according to the second example can further improve the convenience for the user of the medical observation device 100 compared to the medical observation device 100 that performs the processing related to the display control method according to the first example.
[0213] The functional configuration of the processing unit 158 according to the second example is not limited to the example shown in FIG.
[0214] For example, in the processing unit 158 according to the second example, the display control unit 166 may have the function of the distance calculation unit 162 .
[0215] Furthermore, when the processing in the distance calculation unit 162 is performed in a device external to the medical observation device 100, the processing unit 158 according to the second example does not need to have the distance calculation unit 162. In this case, the display control unit 166 causes an annotation image corresponding to information indicating the distance acquired from the external device to be displayed on the display screen.
[0216] Moreover, the processing unit 158 according to the second example can have a configuration according to how the processes related to the display control method according to the present embodiment are divided.
[0217] [2-2-3] Third example of processing related to display control method FIG. 12 is a functional block diagram showing a third example of the configuration of the processing unit 158 included in the medical observation device 100 according to this embodiment.
[0218] The processing unit 158 has, for example, an acquisition unit 160, a distance calculation unit 162, and a display control unit 168. The processing unit 158 according to the third example shown in Fig. 12 has basically the same functions as the processing unit 158 according to the first example shown in Fig. 8, but the functions of the display control unit 168 are different from the functions of the display control unit 164 shown in Fig. 8. Hereinafter, of the functional configuration of the processing unit 158 according to the third example, points that are different from the processing unit 158 according to the first example shown in Fig. 8 will be described, and a description of similar points will be omitted.
[0219] The display control unit 168, like the display control unit 164 shown in FIG. 8, causes the display screen of the display device 200 to display a medical captured image for the right eye, a medical captured image for the left eye, and an annotation image.
[0220] Furthermore, the display control unit 168 causes an image showing a medical instrument corresponding to the distance between the two points to be displayed on the display screen. For example, the display control unit 168 causes the image showing the medical instrument to be displayed on one or both of the display screen of the display device 200 on which the medical captured image for the right eye and the medical captured image for the left eye are displayed and the display screen of the other display device.
[0221] An example of an image showing a medical instrument corresponding to the distance between two points is, for example, an image of a clip corresponding to the distance between two points, as shown as another example of an annotation image. Note that the example of an image showing a medical instrument corresponding to the distance between two points is not limited to an image of a clip, and may be any medical instrument corresponding to a surgical procedure, such as a suture needle or suture thread.
[0222] The display control unit 168 reads out an image showing a medical instrument corresponding to the distance between two points from a recording medium (not shown) functioning as a storage unit (not shown), and displays the read out image on the display screen of the display device. In Fig. 12, data showing an image showing a medical instrument corresponding to the distance between two points is shown as "image information".
[0223] Fig. 13 is an explanatory diagram for explaining an example of an image displayed by the display control method according to this embodiment. Fig. 13 shows an example in which, in addition to the medical captured image on which the annotation image shown in C of Fig. 6 is superimposed, clip images M1, M2, and M3 (examples of images showing medical instruments; the same applies below) corresponding to the distance between two points are further displayed.
[0224] For example, as shown in Fig. 13, clip images M1, M2, and M3 corresponding to the distance between two points are displayed, allowing the surgeon to easily select a clip. Furthermore, being able to easily select a clip reduces the burden on the surgeon and shortens the procedure time.
[0225] Note that examples of images displayed by the display control method according to the third example are not limited to the example shown in Fig. 13. For example, an image of a clip corresponding to the distance between two points may be displayed at the position of the annotation image AO shown in Fig. 13. That is, an image showing a medical instrument may be displayed by being superimposed on one or both of the medical imaging image for the right eye and the medical imaging image for the left eye.
[0226] The processing unit 158 that performs the processing related to the display control method according to the third example basically has the same configuration as the processing unit 158 according to the first example shown in Fig. 8. Therefore, like the processing unit 158 according to the first example shown in Fig. 8, the processing unit 158 according to the third example can display an annotation image such as that shown in C of Fig. 6 or Fig. 7 together with a medical imaging image.
[0227] Moreover, the processing unit 158 according to the third example displays an image showing a medical instrument corresponding to the distance between two points on the display screen, allowing a medical professional such as an operator to easily select a medical instrument corresponding to the distance between two points.
[0228] Therefore, the medical observation device 100 that performs the processing related to the display control method according to the third example can further improve the convenience for the user of the medical observation device 100 compared to the medical observation device 100 that performs the processing related to the display control method according to the first example.
[0229] The functional configuration of the processing unit 158 according to the third example is not limited to the example shown in FIG.
[0230] For example, in the processing unit 158 according to the third example, the display control unit 168 may have the function of the distance calculation unit 162 .
[0231] Furthermore, when the processing in the distance calculation unit 162 is performed in a device external to the medical observation device 100, the processing unit 158 according to the third example does not need to have the distance calculation unit 162. In this case, the display control unit 168 causes an annotation image corresponding to information indicating the distance acquired from the external device to be displayed on the display screen.
[0232] Moreover, the processing unit 158 according to the third example can have a configuration according to how the processes related to the display control method according to the present embodiment are divided.
[0233] [2-2-4] Other examples of processing related to the display control method Note that the examples of the processing related to the display control method according to this embodiment are not limited to the above-mentioned first to third examples. For example, the processing unit 158 included in the medical observation device 100 according to this embodiment can also perform a processing that combines the processing related to the above-mentioned second example and the processing related to the above-mentioned third example.
[0234] [3] An example of an effect achieved by using the display control method according to the present embodiment By using the display control method according to the present embodiment, for example, the following effects can be achieved. It goes without saying that the effects achieved by using the display control method according to the present embodiment are not limited to the examples shown below. - Medical professionals, including surgeons, can grasp the measurement results of the distance between two points within the observation field of view in real time within the medical image, eliminating the need for additional surgical tools such as tape measures, which is expected to improve surgical efficiency. -Being able to grasp the measurement results of the distance between two points within the observation field in real time within the medical image will improve the accuracy of selecting medical instruments such as clips, and is expected to improve surgical efficiency and reduce the risk of complications (injury).
[0235] (Program related to this embodiment) A program for causing a computer system to function as the medical observation device according to this embodiment (for example, a program capable of executing processing related to the display control method according to this embodiment) is executed by a processor or the like in the computer system, thereby improving the convenience of the user of the medical observation device. Here, the computer system according to this embodiment may be a single computer or multiple computers. The computer system according to this embodiment performs a series of processing related to the display control method according to this embodiment.
[0236] Furthermore, by executing a program for causing a computer system to function as the medical observation device of this embodiment by a processor or the like in the computer system, it is possible to achieve the effects achieved by the display realized by the processing related to the display control method of this embodiment described above.
[0237] Although the preferred embodiment of the present disclosure has been described in detail above with reference to the attached drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person having ordinary knowledge in the technical field of the present disclosure can conceive of various modified or amended examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally belong to the technical scope of the present disclosure.
[0238] For example, in the above, it has been shown that a program (computer program) for causing a computer system to function as the medical observation device according to this embodiment (or the medical observation device according to this embodiment) is provided, but this embodiment can also provide a recording medium having the above program stored therein.
[0239] The above-described configuration shows one example of this embodiment, and naturally falls within the technical scope of the present disclosure.
[0240] In addition, the effects described in this specification are merely descriptive or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that are apparent to a person skilled in the art from the description of this specification, in addition to or in place of the above effects.
[0241] Note that the following configurations also fall within the technical scope of the present disclosure. (1) an imaging unit including a first imaging device for capturing a medical image for a right eye in which an observation target is captured, and a second imaging device for capturing a medical image for a left eye in which the observation target is captured; An acquisition unit that acquires positions of at least two points on the observation target, the positions being specified based on a predetermined action with respect to the observation target; a display control unit that displays, on a display screen of a display device, the medical captured image for the right eye, the medical captured image for the left eye, and an annotation image indicating a distance between two points whose positions have been acquired; A medical observation device comprising: (2) The medical observation device according to (1), wherein the display control unit displays the annotation image by superimposing it on one or both of the medical captured image for the right eye and the medical captured image for the left eye. (3) If multiple positions of the two points are obtained, The medical observation device according to (1) or (2), wherein the display control unit causes the annotation images corresponding to the distances between the two points to be displayed on a display screen. (4) The medical observation device according to any one of (1) to (3), wherein the acquisition unit acquires the position by detecting an object corresponding to the predetermined motion from one or both of the right-eye medical captured image and the left-eye medical captured image. (5) The medical observation device according to any one of (1) to (3), wherein the acquisition unit acquires the position by acquiring position information indicating the position from a detection device that detects the position. (6) The medical observation device according to any one of (1) to (5), wherein the display control unit changes the display of the annotation image so as to correspond to a change in one or both of a position and a posture of the imaging unit. (7) The medical observation device according to any one of (1) to (6), wherein the display control unit causes an image showing a medical instrument corresponding to the distance between the two points to be displayed on a display screen of the display device or a display screen of another display device. (8) A distance calculation unit is further provided to calculate the distance between the two points, The medical observation device according to any one of (1) to (7), wherein the display control unit displays an annotation image indicating the calculated distance. (9) The robot further includes an arm including a plurality of links connected to each other by joints, The medical observation apparatus according to any one of (1) to (8), wherein the first imaging device and the second imaging device are supported by the arm. (10) The medical observation apparatus according to any one of (1) to (8), wherein the first imaging device and the second imaging device are inserted into a patient's body and capture images of the inside of the body as the observation target. [Explanation of symbols]
[0242] 100 Medical observation equipment 102 Base 104 Arm 106 Imaging Device 110a, 110b, 110c, 110d, 110e, 110f joints 112a, 112b, 112c, 112d, 112e, 112f Links 120 Imaging materials 122 Cylindrical member 124 Zoom switch 126 Focus Switch 128 Operation mode change switch 134 Insert 136 Light source unit 138 Light Guide 140 Camera Head 142 Cable 144 Control Unit 150 Imaging unit 152 Communications Department 154 Control Unit 156 Imaging control section 158 Processing section 160 Acquisition Department 162 Distance calculation unit 164, 166, 168 Display control unit 200 Display device 1000 Medical Observation System
Claims
1. an imaging unit including a first imaging device for capturing a medical image for a right eye in which an observation target is captured, and a second imaging device for capturing a medical image for a left eye in which the observation target is captured; an acquisition unit that acquires positions of at least two points on the object of observation that are designated by a predetermined action of a user on the object of observation; a display control unit that displays, on a display screen of a display device, the medical image for the right eye, the medical image for the left eye, and an annotation image indicating a distance between the two points whose positions are acquired by the acquisition unit, the annotation image includes an image in which the distance between the two points is indicated by a numerical value, and images of a plurality of different medical instruments corresponding to the distance between the two points, or an image in which model numbers or names of the plurality of medical instruments are indicated; the images of the medical instruments are images of the medical instruments for a user to select the medical instrument to be used from the plurality of medical instruments, a medical observation system, wherein the image indicating model numbers or names of the plurality of medical instruments is an image indicating model numbers or names of the plurality of medical instruments for allowing a user to select the medical instrument to be used from the plurality of medical instruments.
2. 2. The medical observation system according to claim 1, wherein the display control unit displays an annotation image indicating the distance between the two points on a display screen of the display device by superimposing the annotation image on one or both of the medical image for the right eye and the medical image for the left eye.
3. If multiple positions of the two points are obtained, The medical observation system according to claim 2 , wherein the display control unit causes the annotation images corresponding to the distances between the two points to be displayed on a display screen of the display device.
4. 2 . The medical observation system according to claim 1 , wherein the acquisition unit acquires the position by detecting an object corresponding to the predetermined motion from one or both of the right-eye medical captured image and the left-eye medical captured image.
5. The medical observation system according to claim 1 , wherein the acquisition unit acquires the position by acquiring position information indicating the position from a detection device that detects the position.
6. The medical observation system according to claim 2 , wherein the display control unit changes the display of the annotation image so as to correspond to a change in one or both of a position and a posture of the imaging unit.
7. A distance calculation unit is further provided to calculate the distance between the two points, The medical observation system according to claim 2 , wherein the display control unit causes an annotation image indicating the calculated distance to be displayed.
8. The robot further includes an arm including a plurality of links connected to each other by joints, The medical observation system of claim 1 , wherein the first imaging device and the second imaging device are supported by the arm.
Citation Information
Patent Citations
Scale display method in pseudo three dimensional picture display using center projecting method and section area measuring method for tubular site
JP1998063875A
Device for assisting medical treatment
JP2002253480A
Three-dimensional shape display device, three-dimensional shape display method, program, and recording medium
JP2004102979A
Method and apparatus for providing flexible measurement capabilities for medical images
JP2007521864A
Endoscopic device for measurement, and program
JP2009014711A
