Medical image processing device and medical image processing program
The medical image processing device addresses the challenge of accurately positioning control points by using a measurement tool with two display modes, ensuring that control points can be accurately positioned without being obscured by the cursor, thereby improving operability and measurement precision.
Patent Information
- Application Number
- JP2023170668
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-09-29
- Publication Date
- 2025-04-10
AI Technical Summary
Existing medical image processing devices face challenges in accurately adjusting control points for measurement tools due to the cursor overlapping or hiding the reference position, leading to poor operability.
The medical image processing device and program implement a measurement tool with control points that have a graphic element and an effective area, displaying the tool in two modes: a first mode with a wider effective area when no operation is enabled, and a second mode with a visible graphic element when operations are enabled, allowing for accurate positioning of control points.
This solution enables easy and accurate measurement of medical images by ensuring that control points can be accurately positioned without being obscured by the cursor, improving operability and measurement precision.
Smart Images

Figure 2025060130000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a medical image processing device and a medical image processing program for processing medical images. [Background technology]
[0002] In a device that displays medical images such as tomographic images and ultrasound images of the eye, it may be necessary to measure the distance (dimension), angle, etc. of a desired tissue position on the medical image. In this case, a pointing device such as a mouse is used to set a control point (measurement position) of a measurement tool at the position of the target measurement tissue on the medical image or to drag the control point (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2018-110751 A Summary of the Invention [Problem to be solved by the invention]
[0004] Further improvements are desired in the above medical image processing device. For example, when dragging a control point that has been set in a measurement tool having a plurality of control points (for example, a measurement tool for measuring the distance between two points), a configuration is conceivable in which the drag operation is possible after the cursor is positioned on the graphic element of the control point. However, in this case, the reference position of the control point displayed in the graphic may be hidden by the cursor or may be difficult to see due to the cursor, and the control point (measurement tool) may not be accurately aligned with the position of the desired measurement tissue, resulting in poor operability. This problem is also the same when the pointing device is a touch panel and the control point is dragged with a finger or a touch pen.
[0005] In view of the above-described conventional techniques, the present disclosure has as its technical object to provide a medical image processing device and a medical image processing program that enable measurement of medical images with good operability. [Means for solving the problem]
[0006] (1) A medical image processing device according to a first aspect of the present disclosure comprises a display unit for displaying a medical image, and a control means for controlling the display unit, the control means superimposing a measurement tool having two or more control points, each having a graphic element and an effective area in which a predetermined operation using a pointing device is effective, on the medical image and moving each of the control points to a position corresponding to the predetermined operation, and an output means for outputting measurement values based on the position of each of the control points, wherein the control means displays the measurement tool in a first aspect when the predetermined operation is not effective for any of the control points, and sets the effective area to be larger than the display area of the graphic element, and when the predetermined operation is effective for any of the control points, displays the measurement tool in a second aspect different from the first aspect, in which the medical image in the area corresponding to the graphic element is visible. (2) A medical image processing program according to a second aspect of the present disclosure is executed by a control unit of a medical image processing device having a display unit for displaying medical images, to cause the medical image processing device to execute a control step of superimposing a measurement tool having two or more control points, each control point having a graphic element and an effective area in which a predetermined operation using a pointing device is effective, on a medical image, and moving each control point to a position corresponding to the predetermined operation, and an output step of outputting measurement values based on the position of each control point, wherein in the control step, if the predetermined operation is not enabled for any of the control points, the measurement tool is displayed in a first aspect, and the effective area is set to be larger than the display area of the graphic element, and if the predetermined operation is enabled for any of the control points, the measurement tool is displayed in a second aspect different from the first aspect, in which the medical image in the area corresponding to the graphic element is visible. [Brief description of the drawings]
[0007] [Figure 1] FIG. 1 is a diagram illustrating a main configuration of a medical image processing apparatus. [Diagram 2] 11A and 11B are diagrams illustrating a screen display before the ophthalmologic image processing program of the present disclosure is applied. [Diagram 3] FIG. 11 is a diagram illustrating a control operation flow to which an ophthalmologic image processing program is applied. [Figure 4] FIG. 13 is a diagram showing an example of a screen in which a two-point distance measurement tool is displayed on the measurement screen of the display unit. [Diagram 5] FIG. 13 is a diagram showing an example of a measurement screen of a display unit on which an angle measurement tool is displayed. [Figure 6] 11A and 11B are diagrams illustrating a case where effective areas of control points of a measurement tool partially overlap each other. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0008] [overview] Hereinafter, one exemplary embodiment will be described with reference to the drawings. Note that the items grouped in <> below can be used independently or in conjunction with each other.
[0009] For example, a medical image processing device (e.g., image processing device 10) includes a display unit (e.g., display unit 52) and a control means (e.g., control unit 50). The medical image processing device may also include an output means (e.g., control unit 50).
[0010] For example, the display unit displays a medical image on a screen. The medical image is, for example, an ophthalmic image of the eye tissue of the subject's eye (for example, an eye image TMI).
[0011] For example, the control means controls the display of the display unit. For example, the control means superimposes a measurement tool (e.g., measurement tools 110, 130) having two or more control points (e.g., control point CP1, control point CP2, etc.) on the medical image. For example, the control point has a graphic element (e.g., measurement marker figure CM1, measurement marker figure CM2, etc.) and an effective area (e.g., effective area EA) in which a predetermined operation by a pointing device (e.g., mouse 60) is effective. In addition, the control means moves the control point to a position according to a predetermined operation by the pointing device for each control point. For example, the control point is displayed corresponding to a measurement position (e.g., measurement position S1, S2) that is aligned with the position of the target measurement tissue on the medical image. For example, the measurement position indicates the reference position of the measurement in the measurement tool. Note that, for example, the effective area is an invisible (transparent) area on the screen of the display unit. For example, the size of the effective area is determined to be a size such that the cursor by the pointing device does not cover the measurement position.
[0012] A representative example of the predetermined operation using a pointing device for moving a control point is a drag operation, but any operation that can move a control point may be used. Also, for example, the graphic element of the control point may be in a form that can clearly indicate or emphasize the reference position of the control point.
[0013] For example, when a predetermined operation is not enabled for any of the control points, the control means displays the measurement tool in a first aspect and sets the effective area to be larger than the display area of the graphic element in the first aspect. Then, when a predetermined operation is enabled for any of the control points, the control means displays the measurement tool in a second aspect (e.g., measurement marker figures CLM1, CLM2) different from the first aspect and in which the medical image in the area corresponding to the graphic element is visible.
[0014] The control by the control means as described above allows measurement of medical images to be performed with good operability. That is, the control point of the measurement tool can be aligned with the position of the measurement tissue in the medical image with good accuracy and operability by a predetermined operation. For example, the display mode of the control point of the measurement tool is changed, so that the operator can recognize that the control point can be dragged. In addition, since a predetermined operation is possible by specifying a position away from the measurement position of the control point, the measurement position of the control point is not hidden by the source of operation (mouse cursor, finger touch on a touch panel), and the operator can align the measurement position to the position of the measurement tissue while checking the measurement position corresponding to the control point.
[0015] For example, the measurement tool may be a distance measurement tool for measuring the distance between at least two points. Furthermore, the measurement tool may be an angle measurement tool for measuring an angle, or may be combined with a distance measurement tool.
[0016] For example, the graphic element of the control point may have a first graphic (e.g., the tip of a line graphic LG) indicating the position of the measurement position to be positioned at the position of the measurement tissue, and a second graphic (e.g., measurement marker graphics CM1, CM2) of a predetermined shape corresponding to the measurement position. In this case, the control means may display at least the second graphic in the second form. This allows the operator to accurately position the measurement position at the desired measurement tissue position by performing a predetermined operation on the control point while looking at the first graphic indicating the measurement position. Note that, when the predetermined operation is not enabled, the second graphic may be configured in the first form so that a medical image in a corresponding area inside it (e.g., an inner area of the second graphic) can be viewed.
[0017] For example, the control means may change the size of the graphic element in the first state to the second state by enlarging it to correspond to the effective area. By enlarging the graphic element to correspond to the effective area in which a predetermined operation is effective, the operator can recognize that it is now possible to grab and drag (move) the control point at a position away from the measurement position of the control point.
[0018] For example, the graphic element of each control point may be a frame-like shape such as a circle, a triangle, a rectangle, or a cross. In addition, for example, the measurement position may also serve as a graphic element.
[0019] For example, when the effective areas of the control points partially overlap, the control means may display the control point side that satisfies a predetermined condition in the second mode, thereby enabling a predetermined operation. As a result, even when the distance between the control points is short, the operator can see which control points can be dragged, and can move the control points appropriately without getting lost. For example, the predetermined condition that enables a predetermined operation may be determined by which layer is to be prioritized when the control points are drawn on the screen in a layered structure. Also, the predetermined condition may be determined by which measurement position (S1, S2, etc.) the input position (pointer) of the pointing device is closest to.
[0020] The control means may change the display of the measurement tool from the first state to the second state when the input position (pointer) of the pointing device enters an effective area for any of the control points, and may return the display of the measurement tool from the second state to the first state when the input position of the pointing device leaves the effective area. This allows the operator to recognize that dragging is no longer possible by returning the display state of the measurement tool (e.g., graphic element) to the original state, and allows the operator to move the input position of the pointing device to move the next control point.
[0021] The control means may display a cursor at an input position by the pointing device, change the display form of the cursor when the input position of the cursor enters the valid area, and return the display form of the cursor to its original state when the input position of the cursor leaves the valid area. This also allows the operator to intuitively recognize that the control point can be dragged.
[0022] For example, the output means outputs the measurement value based on the position of each control point. The control means may also function as the output means. The control means may also function as the calculation means for calculating the measurement value based on the position of each control point.
[0023] Also, for example, the medical image processing device may include a signal receiving means (for example, a control unit 50). For example, the signal receiving means receives an operation signal from a pointing device. In this case, the control means may control the display of the measurement tool based on the operation signal from the pointing device received by the signal receiving means.
[0024] In addition, the present disclosure is not limited to the device described in the present embodiment. For example, a medical image processing program (software) that performs the functions of the following embodiments is supplied to a system or device via a network or various storage media. Then, a control device (e.g., a CPU, etc.) of the system or device can read and execute the program.
[0025] For example, a medical image processing program is executed by a control unit of a medical image processing device having a display unit that displays medical images, and causes the medical image processing device to execute a control step of superimposing a measurement tool having two or more control points, each having a graphic element and an effective area in which a predetermined operation by a pointing device is effective, on the medical image, and moving each control point to a position according to the predetermined operation, and an output step of outputting a measurement value based on the position of each control point. In the control step, if the predetermined operation is not effective for any of the control points, the measurement tool is displayed in a first manner, and the effective area is set to be wider than the display area of the graphic element, and if the predetermined operation is effective for any of the control points, the measurement tool is displayed in a second manner different from the first manner, in which the medical image in the area corresponding to the graphic element can be viewed.
[0026] [Example] An embodiment of the present disclosure will be described below with reference to the drawings. Fig. 1 is a diagram illustrating the main configuration of a medical image processing device. In this embodiment, an ophthalmologic image processing device 10 will be described as an example of the medical image processing device.
[0027] The image processing device 10 includes a control unit 50, a display unit 52, a storage unit 54, and an operation unit 56. The operation unit 56 may include a mouse 60, which is an example of a pointing device.
[0028] The control unit 50 controls the image processing device 10. The storage unit 54 stores, for example, ophthalmologic image data, which is an example of a medical image of a subject. The display unit 52 displays an ophthalmologic image, which is an example of a medical image of a subject, on a screen. The operation unit 56 is operated by an examiner (user). The operation unit 56 may include a mouse 60, which is an example of a pointing device. The pointing device may be any of a touch panel, a tablet pen, a touch pad, a trackball, a joystick, and the like. The operation unit 56 may also include a user interface, such as a keyboard or a touch panel. When the operation unit 56 is operated by a user, it transmits an operation signal to the control unit 50. The control unit 50 receives the operation signal from the operation unit 56. That is, the control unit 50 functions as a signal receiving means for receiving an operation signal from the operation unit 56, such as a pointing device.
[0029] The control unit 50 controls the operation of each unit based on an ophthalmological image processing program and various control programs stored in the storage unit 54. The image processing device 10 can be used by executing this ophthalmological image processing program on a computer. Here, the control unit 50 controls the display content of the display unit 52 according to the image processing program. That is, the control unit 50 functions as a display control means. The control unit 50 also outputs various measurement values measured according to the image processing program to the screen of the display unit 52. That is, the control unit 50 functions as an output means. The measurement values may be output to a printer or other external device.
[0030] An ophthalmic imaging device 20 for capturing an image of an ocular tissue at a predetermined site of a subject's eye is connected to the image processing device 10. In Fig. 1, the ophthalmic imaging device 20 includes, for example, an imaging optical system 22 for capturing an image of an ocular tissue at a predetermined site, and a control unit 25 for obtaining a captured image based on an output of the imaging optical system 22.
[0031] For example, the photographing optical system 22 is configured with an interference optical system (OCT optical system) that obtains a tomographic image of the fundus and anterior part of the subject's eye. The interference optical system includes a scanning unit (optical scanner) that scans the fundus of the subject's eye with measurement light emitted from a light source, and a light receiving element that receives interference light obtained by combining reference light generated by the light emitted from the light source and reflected light of the measurement light irradiated on the fundus of the subject's eye, and has a device configuration of a so-called ophthalmic optical coherence tomography (OCT).
[0032] The photographing optical system 22 may be a fundus observation optical system for obtaining a front image of the fundus of the subject's eye. For example, the fundus observation optical system includes a scanning unit (optical scanner) that two-dimensionally scans the fundus of the subject's eye with measurement light emitted from a light source, and a light receiving element that receives fundus reflected light through a confocal aperture arranged at a position approximately conjugate with the fundus, and has a device configuration of a so-called ophthalmic scanning laser ophthalmoscope (SLO). The fundus observation optical system may also have a so-called fundus camera type configuration.
[0033] The detailed configuration of the ophthalmologic imaging apparatus 20 is described in, for example, Japanese Patent Application Laid-Open No. 2008-29467.
[0034] The image processing device 10 and the ophthalmic photographing apparatus 20 are connected by a communication means such as a wireless or wired connection. The control unit 50 acquires ophthalmic image data captured by the ophthalmic photographing apparatus 20 via the communication means. That is, the control unit 50 functions as an acquisition means for acquiring ophthalmic image data. The control unit 50 stores the ophthalmic image data in the storage unit 54 as a database. The control unit 50 may also acquire various photographing conditions at the time of image acquisition from the ophthalmic photographing apparatus 20 and store them in the storage unit 54.
[0035] <Control action> The following describes the operation of performing various measurements of eye tissues using an ophthalmologic image processing program in the image processing device 10. Here, the following describes an example in which a tomographic image of the eye tissues (fundus and anterior segment) of the subject eye is captured by the ophthalmologic imaging device 20 and the image is acquired by the image processing device 10.
[0036] <Comparative Example> First, as a comparative example, a measurement operation before the ophthalmologic image processing program of the present disclosure is applied will be described with reference to FIG. 2. In FIG. 2(a), for example, a fundus tomographic eye image TMI stored in the memory unit 54 is displayed on the screen of the display unit 52. On this screen, a measurement tool 110a for measuring the distance between two points is displayed at a predetermined initial position by a predetermined operation of the operation unit 56. The measurement tool 110a has a first control point CP1a and a second control point CP2a. The first control point CP1a has a circular measurement marker figure CM1a corresponding to the first measurement position S1a. The center of the circular measurement marker figure CM1a is located at the first measurement position S1a. Similarly, the second control point CP2a has a circular measurement marker figure CM2a centered on the second measurement position S2a. In addition, the measurement tool 110a has a line figure LGa connecting the first measurement position S1a and the second measurement position S2a. Here, the tip of the line graphic LGa on the first control point CP1a side coincides with the position of the first measurement position S1a, and the tip of the line graphic LGa on the second control point CP2a side coincides with the position of the second measurement position S2a. The distance between two points on the eye image TMI is measured by the first measurement position S1a on the first control point CP1a side and the second measurement position S2a on the second control point CP2a side.
[0037] Here, an arrow-shaped cursor CUa is displayed on the screen, which is moved by the mouse 60. Then, in order to move the measurement positions S1a and S2a of the measurement tool 110a to the positions of the measurement tissues in the eye image TMI, an input position corresponding to the position of the cursor CUa and a drag operation, which is an example of a predetermined operation by the mouse 60, are used. In the example of FIG. 2(a), the effective areas in which the drag operation by the mouse 60 is effective for the first control point CP1a and the second control point CP2a are within the areas of the circular measurement marker figures CM1a and CM2a, respectively.
[0038] For example, when the input position of the arrow-shaped cursor CUa is positioned in the area of the circular measurement marker figure CM1a in order to align the first control point CP1a with the position of the measurement tissue, the cursor CUa is changed to a cross-shaped display as shown in Fig. 2(b). This allows the operator (user) to recognize that the first control point CP1a can now be dragged, and the operator (user) moves the first control point CP1a by dragging it to the desired position of the measurement tissue.
[0039] However, in the case of Fig. 2(b), the first measurement position S1a indicated by the tip of the line figure LGa is likely to be overlapped or hidden by the cross-shaped cursor CUa, making it difficult for the operator to clearly recognize its position. Therefore, it is not possible to accurately align the control point CP1a (measurement position S1a) with the desired measurement tissue position, and operability is poor.
[0040] <Ophthalmological image processing program of this embodiment> Fig. 3 is a diagram for explaining a control operation flow to which the ophthalmologic image processing program of the present embodiment is applied. Fig. 4 is a diagram showing an example of a screen on which a measurement tool (a two-point distance measurement tool) is displayed on the measurement screen of the display unit 52.
[0041] In FIG. 4(a), the measurement screen of the display unit 52 displays the fundus tomographic eye image TMI stored in the storage unit 54. When the measurement tool selection button 212 is pressed by operating the mouse 60 on the screen on which the eye image TMI is displayed, a screen for selecting a plurality of predetermined measurement tools is popped up. For example, the measurement tools include a two-point measurement tool for measuring the distance between two points and an angle measurement tool for measuring an angle. When the control unit 50 receives a measurement tool selection signal (S1), the selected predetermined measurement tool is superimposed on the initial position on the eye image TMI (S2). The example in FIG. 4 is an example in which the two-point distance measurement tool 110 is selected.
[0042] As shown in FIG. 4(a), the two-point distance measuring tool 110 has a first control point CP1 and a second control point CP2, similar to the comparative example described above. The first control point CP1 has a small circular measurement marker figure CM1 which is a graphic element corresponding to the first measurement position S1. The center of the small circular measurement marker figure CM1 is located at the first measurement position S1. Similarly, the second control point CP2 has a small circular measurement marker figure CM2 centered on the second measurement position S2. The small circular measurement marker figures CM1 and CM2 are each a figure of the first mode.
[0043] Furthermore, the distance measurement tool 110 may have a line graphic LG connecting the first measurement position S1 and the second measurement position S2. The tip of the line graphic LG on the first control point CP1 side coincides with the position of the first measurement position S1, and the tip of the line graphic LG on the second control point CP2 side coincides with the position of the second measurement position S2. In other words, the tips on both sides of the line graphic LG are graphic elements indicating the positions of the measurement positions S1 and S2, respectively.
[0044] The distance between two measurement tissue positions on the eye image TMI is measured based on the position of the first control point CP1 (i.e., the first measurement position S1) and the position of the second control point CP2 (i.e., the second measurement position S2).
[0045] The measurement marker figures CM1 and CM2 are in a frame-like shape, and the eye image TMI in the internal area is visible, and the end points of the line figure LG are visible. Here, the display size of the small circular measurement marker figures CM1 and CM2 on the screen is determined to visually indicate or emphasize the measurement positions S1 and S2 indicated by the end points of the line figure LG. If the display size is too small, the end points of the line figure LG are difficult to see. Conversely, if the display size is too large and the two measurement marker figures CM1 and CM2 overlap, it is difficult to know which distance is being measured. Also, if the display size is too large, it may be difficult to intuitively understand what the figure display does. Therefore, the display size of the measurement marker figures CM1 and CM2 should be a size that allows the end points of the line figure LG to be confirmed within the frame-like figure, and is not too large compared to the thickness of the line figure LG. For example, within the measurement marker figures (CM1, CM2), the radius size of the inner area in which the eye image TMI is visible (in other words, the size of the radius of the inner circle when the line thickness of the measurement marker figures (CM1, CM2) is expressed by filling in the area between the inner and outer circles) should be 4 to 8 times the line thickness of the line figure LG. This makes it easy to distinguish and see the first measurement position S1 and the second measurement position S2 even when the distance between the positions of the measurement tissues on the eye image TMI is short.
[0046] The first control point CP1 and the second control point CP2 each have an effective area EA in which dragging by the mouse 60 is effective. Here, unlike the above-mentioned comparative example, the effective areas EA of the first control point CP1 and the second control point CP2 are set by the control unit 50 to be wider than the small circular measurement marker figures CM1 and CM2 (S3). For example, the size of the effective area EA is set to a size such that the end points (measurement positions S1, S2) of the line figure LG located at the center of the effective area EA are not covered by the cursor CU. In this embodiment, when the input position of the cursor CU enters the effective area EA, the cursor CU is changed from an arrow shape to a cross shape (see FIG. 4(b)). Therefore, the radius size of the effective area EA is set to a size such that the cursor CU changed to a cross shape is not covered by the end points (measurement positions S1, S2) of the line figure LG. For example, the preferable radius size of the effective area EA is set to a size equal to or larger than the radius size of the measurement marker figure CM1 (similar to CM2) plus the diameter size of the cursor CU (diameter of the cross shape). In FIG. 4(a), the effective area EA is indicated by a dotted line, but this is merely an explanatory illustration and is an invisible (transparent) area on the screen of the display unit 52.
[0047] Next, an operation of moving the first control point CP1 and the second control point CP2 to the position of the measurement tissue in order to measure the distance between two points on the eye image TMI will be described.
[0048] For example, the operator first moves the cursor CU closer to the measurement marker figure CM1 by operating the mouse 60 in order to move the first control point CP1 of the initially displayed distance measurement tool 110. In this case, the control unit 50 determines whether the input position of the cursor CU (mouse 60) is in the effective area EA on the first control point CP1 side (S4). Then, when the input position of the cursor CU enters the effective area EA, the display mode of the measurement marker figure CM1 (first mode) is changed by the display control of the control unit 50 to a large circular measurement marker figure CLM1 (second mode) determined corresponding to the effective area EA, as shown in FIG. 4(b) (S5). For example, the measurement marker figure CLM1 is made to have a frame-like shape, and the eye image TMI in the corresponding area inside it (in the embodiment, the inner area of the frame of the measurement marker figure CLM1) is made visible.
[0049] The operator can recognize that it is now possible to drag and move the first control point CP1 because the display mode of the small circular measurement marker figure CM1 has changed to the large circular measurement marker figure CLM1. In addition, when the input position of the cursor CU enters the valid area EA, the cursor CU is changed from an arrow shape to a cross shape. This also allows the operator to recognize that it is now possible to drag and move the first control point CP1. Note that the display shape of the cursor CU does not have to change.
[0050] Next, the operator moves the first control point CP1 to the position of the target measurement tissue by dragging the mouse 60. In this case, the control unit 50 moves the first control point CP1 on the screen based on a signal of the dragging operation of the mouse 60 (S7). At this time, as shown in FIG. 4(c), if the input position of the cursor CU by the mouse 60 is located in an effective area EA larger than the measurement marker figure CM1, the dragging operation of the first control point CP1 is possible. That is, the first control point CP1 is dragged without the cross-shaped cursor CU approaching too close to the first measurement position S1 in the first control point CP1. Therefore, the operator can easily visually recognize the position of the first measurement position S1 without it being hidden by the display of the cursor CU. In addition, the large circular measurement marker figure CLM1 is made visually recognizable in the eye image TMI in its internal area. This allows the operator to accurately and easily align the first control point CP1 (i.e., the first measurement position S1) with respect to the position of the target measurement tissue.
[0051] When the alignment of the first control point CP1 with respect to the position of the target measurement tissue is completed, the operator moves to the alignment of the second control point CP2. When the operator moves the cursor CU by operating the mouse 60, the control unit 50 judges whether the input position of the cursor CU has deviated from the effective area EA of the first control point CP1 (S8). When it is judged that the input position of the cursor CU has deviated from the effective area EA, the display of the large circular measurement marker figure CLM1 (second aspect) is returned to the small circular measurement marker figure CM1 (first aspect) (S9), as shown in FIG. 4(d). In addition, the display of the cursor CU is also returned from the cross shape to the arrow shape.
[0052] Next, when the input position of the cursor CU enters the effective area EA on the second control point CP2 side by the operation of the mouse 60 by the operator, the display mode of the measurement marker figure CM2 (first mode) is changed to a large circular measurement marker figure CLM2 (second mode) as shown in FIG. 4(e) in the same manner as in the case of the first control point CP1. The display shape of the cursor CU is also changed from an arrow shape to a cross shape. This allows the operator to recognize that the second control point CP2 can be dragged. And, regarding the second control point CP2, the second control point CP2 can be dragged without the cursor CU getting too close to the second measurement position S2, and the eye image TMI in the internal area of the measurement marker figure CLM2 can be visually confirmed. Therefore, the operator can accurately and easily align the second control point CP2 with the position of the target measurement tissue while checking the eye image TMI in the internal area of the measurement marker figure CLM2 and the position of the second measurement position S2 without being hindered by the display of the cursor CU.
[0053] When the alignment of the second control point CP2 is completed, the control unit 50 measures the distance between the first control point CP1 and the second control point CP2 (i.e., measurement positions S1, S2) based on the two points (S10). The measurement result is output and displayed in the display field 220 (see FIG. 4(a)) of the measurement screen (S11). Note that the distance between the two points measured by the distance measurement tool 110 may be measured at any time and output and displayed in the display field 220 at any time. The measurement result is stored in the memory unit 54 by a predetermined operation (for example, an operation to close the measurement screen).
[0054] Next, an example of angle measurement on the eye image TMI will be described. Fig. 5 is a diagram showing an example of a screen in which the angle measurement tool 130 is displayed on the measurement screen of the display unit 52. For example, the eye image TMI is a tomographic image of the anterior eye segment, and the angle measurement tool 130 is used to measure the angle of the anterior eye segment angle (the place where the cornea and iris intersect).
[0055] 5(a), the angle measurement tool 130 is selected from a screen that pops up when the measurement tool selection button 212 is pressed, and is displayed superimposed at an initial position on the eye image TMI. The angle measurement tool 130 has a third control point CP3 in addition to a first control point CP1 and a second control point CP2 similar to those of the two-point distance measurement tool 110. The configurations of the first control point CP1 and the second control point CP2 are basically the same as those of the two-point distance measurement tool 110, so a description thereof will be omitted.
[0056] The third control point CP3 has a small circular measurement marker figure CM3 which is a graphic element corresponding to the third measurement position S3. The center of the measurement marker figure CM3 is located at the third measurement position S3. The measurement marker figure CM3 is a figure of the first mode. The third control point CP3 also has an effective area EA in which dragging operation with the mouse 60 is effective. The effective area EA of the third control point CP3 is set to be wider than the small circular measurement marker figure CM3, like the first control point CP1 and the second control point CP2.
[0057] Furthermore, the angle measurement tool 130 includes a line graphic LG2 connecting the first measurement position S1 and the third measurement position S3, in addition to a line graphic LG1 connecting the first measurement position S1 and the second measurement position S2. The end of the line graphic LG2 on the third control point CP3 side coincides with the position of the third measurement position S3, and the end of the line graphic LG2 on the first control point CP1 side coincides with the position of the first measurement position S1. In other words, both ends of the line graphic LG2 are graphic elements indicating the positions of the measurement positions S1 and S3, respectively.
[0058] The angle measured by the angle measurement tool 130 is the angle α formed by the line figure LG1 (i.e., the line segment connecting the first measurement position S1 and the second measurement position S2) and the line figure LG2 (i.e., the line segment connecting the first measurement position S1 and the third measurement position S3) with the first control point CP1 as the reference point.
[0059] For example, when the third control point CP3 is dragged to the position of the target measurement tissue, when the input position of the cursor CU enters the effective area EA of the third control point CP3, the display of the measurement marker figure CM3 (first mode) is changed to a large circular measurement marker figure CLM3 (second mode) and the cursor CU is changed to a cross shape as shown in FIG. 5(b). The measurement marker figure CLM3 allows the eye image TMI to be viewed in its internal area. The change in the display mode of the third control point CP3 is the same as that of the first control point CP1 and the second control point CP2. This allows the operator to align each control point (CP1, CP2, CP3) with respect to the position of the target measurement tissue with high accuracy and good operability in the case of the angle measurement tool 130 as well.
[0060] The angle measurement tool 130 may be selectable between a first type in which the first line figure LG1 extends to the right and measures the angle it forms with the second line figure LG2, and a second type in which the first line figure LG1 extends to the left and measures the angle it forms with the second line figure LG2.
[0061] In the above description, the angle measurement tool 130 is moved by moving each of the control points CP1, CP2, and CP3, but this is not limiting. For example, the control point CP1 may not have an effective area EA of the same size as the other control points CP2 and CP3, and the angle measurement tool 130 may be moved in parallel by positioning and dragging the cursor CU on any of the measurement marker figure CM1, the first line figure LG1, and the second line figure LG2 of the control point CP1. Even in this case, the measurement position S1 of the control point CP1 where the first line figure LG1 and the second line figure LG2 of the angle measurement tool 130 intersect can be aligned to the position of the measurement tissue. As for the control points CP2 and CP3, the display of the measurement marker figures CM2 and CM3 (first aspect) is changed to the large circular measurement marker figures CLM2 and CLM3 (second aspect), so that they can be aligned to the positions of the target measurement tissues with high accuracy.
[0062] In the distance measurement tools 110, 130 superimposed on the eye image TMI, since the eye image TMI is a black and white grayscale image, the graphic elements of each control point (measurement marker figures CM1, CM2, CLM1, CLM2, and line figures LG, LG1, LG2, etc.) may be colored in a color other than black and white (for example, red, pink, etc.).
[0063] <When effective areas EA overlap> In the above-mentioned two-point distance measurement tool 110 and angle measurement tool 130, when the effective area EA is widened and the distance between each control point (CP1, CP2, CP3) is shortened, the effective areas EA of each control point may partially overlap. For example, in the two-point distance measurement tool 110, when the input position of the cursor CU enters an overlapping area EB where the effective area EA of the control point CP1 and the effective area EA of the control point CP2 overlap as shown in Fig. 6(a), the control unit 50 judges which control point is to be made draggable based on a predetermined judgment condition.
[0064] For example, the graphic element on the control point CP1 side and the graphic element on the control point CP2 side are drawn on the screen in a layer structure, and the effective areas EA of each are also in a layer structure. Therefore, the overlapping area EB is included in one of the effective areas EA. The judgment condition for the overlapping area EB is determined according to which layer is to be prioritized. For example, assume that the judgment condition is set so that the effective area EA in the top layer is prioritized, and the control point CP2 side is the top layer. In this case, the control point CP2 is made draggable, and the measurement marker figure CM2 of the control point CP2 is changed to a large circular measurement marker figure CLM2 as shown in FIG. 6(b). This allows the operator to know which control points are draggable, and therefore to move the control point appropriately without hesitation. If the operator wants to select the control point CP1 instead of the control point CP2, he or she can move the input position of the cursor CU away from the measurement marker figure CLM2 and toward the control point CP1.
[0065] The judgment condition for the overlapping region EB is not limited to the above. For example, the judgment condition may be whether the input position of the cursor CU (pointing device) is closest to one of the measurement positions (S1, S2, etc.).
[0066] <Example of transformation> Although typical embodiments of the present disclosure have been described above, the present disclosure is not limited to the embodiments shown here, and various modifications are possible.
[0067] For example, in the above description, the distance measurement tool 110 for the distance between two points having two control points (CP1, CP2) is selected by a predetermined operation (operation of the selection button 212) and displayed on the measurement screen (eye image TMI), but this is not limited to this. For example, when the operator positions the cursor CU on the measurement screen with the mouse 60 and clicks, a first control point is displayed (set) at the input position of the cursor CU, and then, when the operator positions the cursor at another position and clicks, a second control point is displayed (set) at the input position of the cursor CU, and a straight line (line figure LG) connecting the measurement positions (S1, S2) of each control point is displayed (set), thereby forming the measurement tool for the distance between two points.
[0068] Also, with regard to the angle measurement tool, instead of selecting and displaying the angle measurement tool 130 having three control points, the angle measurement tool 130 may be formed by sequentially displaying (setting) three control points by clicking the input position of the cursor CU using the mouse 60 in the same manner as described above.
[0069] In addition, with regard to distance measurement, an example has been described in which a distance measurement tool 110 for measuring a distance between two points having two control points (CP1, CP2) is used, but the distance measurement tool is not limited to this. For example, a third or more control points may be displayed (set) by clicking an input position of the cursor CU by the mouse 60. For example, when the cursor CU is positioned at a position other than the second control point and clicked, a third control point is displayed (set) and the second and third control points are connected by a straight line. A fourth control point may also be set. A distance measurement tool having three or more control points can continuously measure the distance of the position of the measurement tissue.
[0070] The measurement tool may be one in which three or more control points are set, allowing the selection of a measurement tool capable of measuring the area of a triangle, a quadrangle, or a polygon having five or more sides. In this case, too, each control point may be set in sequence by operating a pointing device such as the mouse 60.
[0071] In the above description, when the input position of the cursor CU by the mouse 60 (pointing device) enters the valid area EA and the drag operation is enabled, the small circular measurement marker figure (CM1, CM2, etc.) changes to a large circular measurement marker figure (CLM1, CLM2, etc.), but this is not limited to this. The change in the second mode may be such that in addition to the figure of the first mode, a large circular measurement marker figure (CLM1, CLM2, etc.) is additionally displayed.
[0072] In the above, the measurement marker figures (CLM1, CLM2, etc.) which are examples of the graphic elements of the control points are not limited to being circular. The graphic elements of the control points may have any shape that clearly indicates or emphasizes the reference position of the control point. For example, they may be in a frame shape such as a triangle or a square, or may be in the shape of an arrow or a cross. Also, the measurement position may be displayed by a different graphic element instead of the graphic element at the tip of the line figure LG.
[0073] In the above, the input position and dragging by the pointing device are described by taking the example of the cursor of the mouse 60, but are not limited to this. A touch panel may be used as the pointing device, and a finger may be used for position input and dragging. Even in this case, the effective area EA of each control point (first control point CP1, etc.) is set to be wider than the measurement marker figure (CM1, etc.), so that the measurement position (S1, etc.) of the control point is less likely to be hidden by the finger, and the control point can be aligned to the position of the desired measurement tissue with good accuracy and ease of operation. The same applies when a touch pen is used instead of a finger on a touch panel.
[0074] In the above, a drag operation is taken as an example of a predetermined operation by a pointing device to move a control point (such as control point CP1), but this is not limited to this. For example, when a mouse is used, the control point may be designated when the operator presses the mouse button, the control point is moved together with the cursor when the operator releases the mouse button and moves the cursor, and the control point is released from the cursor when the operator presses the mouse button again.
[0075] Furthermore, the medical images acquired by the image processing device 10 may be tomographic images of the eye, as well as tissue images of the anterior segment of the eye (for example, used to measure the pupil diameter and iris diameter) and ultrasonic images. The image processing program of the present disclosure can also be suitably used for these medical images. [Explanation of symbols]
[0076] 10 Image processing device 52 Display section 50 Control section 54 Memory section 60 Mouse 110 Two-point distance measurement tool 130 Angle Measurement Tool CM1, CM2 measurement marker shapes CLM1, CLM2 measurement marker shapes S1, S2 measurement positions EA validity area
Claims
1. A display unit for displaying a medical image; a control means for controlling the display unit, the control means superimposing a measurement tool having two or more control points each having a graphic element and an effective area in which a predetermined operation by a pointing device is effective on the medical image, and moving each of the control points to a position corresponding to the predetermined operation; an output means for outputting a measurement value based on the position of each of the control points; The control means if the predetermined operation is not enabled for any of the control points, displaying the measurement tool in a first manner and setting the active area to be larger than a display area of the graphic element; when the predetermined operation for any of the control points is enabled, displaying the measurement tool in a second aspect different from the first aspect, in which a medical image in an area corresponding to the graphic element is visible; 2. A medical image processing apparatus comprising:
2. 2. The medical image processing apparatus of claim 1, the graphic element includes a first graphic indicating a measurement position and a second graphic having a predetermined shape corresponding to the measurement position; The medical image processing apparatus, wherein the control means displays at least the second graphic in the second manner.
3. 3. The medical image processing apparatus according to claim 1, The medical image processing apparatus according to claim 1, wherein the control means changes the size of the graphic element in the first aspect to the second aspect by enlarging the size of the graphic element in the first aspect in accordance with the effective area.
4. In the medical image processing apparatus according to any one of claims 1 to 3, The medical image processing device is characterized in that, when the effective areas of the control points partially overlap, the control point that satisfies a specified condition is displayed in the second form, thereby enabling the specified operation.
5. In the medical image processing apparatus according to any one of claims 1 to 4, The medical image processing device is characterized in that the control means changes the display of the measurement tool from the first aspect to the second aspect when the input position of the pointing device enters the effective area for any of the control points, and returns the display of the measurement tool from the second aspect to the first aspect when the input position of the pointing device leaves the effective area.
6. A medical image processing program comprising: The control unit of the medical image processing device includes a display unit that displays a medical image, a control step of superimposing a measurement tool having two or more control points, each having a graphic element and an effective area in which a predetermined operation by a pointing device is effective, on a medical image and moving each of the control points to a position corresponding to the predetermined operation; an output step of outputting a measurement value based on the position of each control point, A medical image processing program characterized in that, in the control step, if the specified operation is not enabled for any of the control points, the measurement tool is displayed in a first mode and the effective area is set wider than the display area of the graphic element, and if the specified operation is enabled for any of the control points, the measurement tool is displayed in a second mode different from the first mode, in which a medical image in the area corresponding to the graphic element is visible.
Citation Information
Patent Citations
Medical image display apparatus
JP2018110751A