Image processing device, display control method and program

Abstract

To correctly grasp the movement of a structure from a dynamic image obtained by imaging the movement of a locomotorium.SOLUTION: A control unit 31 of an image processing device 3 receives the designation of a plurality of ROIs or points from one frame image in a dynamic image acquired by dynamic-imaging the movement of a locomotorium and sets a positioning reference on the basis of the designated ROIs or points. The control unit 31 tracks the designated ROIs or points in a plurality of frame images of the dynamic image and positions a line segment connecting the ROIs or points in the plurality of frame images on the basis of the positioning reference to be superimposed on a representative frame image of the dynamic image to be displayed on a display unit 34.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an image processing device, a display control method, and a program. [Background technology]

[0002] 2. Description of the Related Art Conventionally, techniques have been proposed for displaying dynamic images acquired by capturing dynamic images of a subject in a manner that makes it easy for doctors and other medical professionals to make a diagnosis.

[0003] For example, Patent Document 1 describes a method of extracting the diaphragm from each of multiple medical images obtained by performing continuous radiography of the chest along a time axis, and superimposing the diaphragm on one selected medical image to generate an image for display. Furthermore, Patent Document 2 describes a technology in which a region of interest is set on a bone or joint in a radiological video of a subject including multiple bones, the set region of interest is tracked in each frame image of the radiological video, and the multiple frame images are aligned based on the tracked region of interest. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2020-89612 [Patent Document 2] Patent Publication No. 2021-58570 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in dynamic images capturing the movement of musculoskeletal systems such as bones and joints, the structures surrounding the structure being observed also move, making it difficult to correctly grasp the movement of the object being observed even if the display technology of Patent Document 1 is applied as is. Furthermore, when dynamic images are displayed by aligning frame images based on fulcrum bones or joints, as with the technology described in Patent Document 2, it is possible to display the image in a manner that makes it easy to grasp the movement of the observed subject, but it is difficult to accurately grasp the movement of the observed subject between frame images.

[0006] An object of the present invention is to make it possible to accurately grasp the movement of a structure from dynamic images capturing the movement of the musculoskeletal system. [Means for solving the problem]

[0007] In order to solve the above problems, the image processing device according to the present invention comprises: a designation means for designating a plurality of areas or points on a structure included in the musculoskeletal system from one frame image of a dynamic image acquired by dynamic imaging of the movement of the musculoskeletal system; a setting means for setting a positioning reference based on the specified area or point; a control means for tracking the designated area or point in a plurality of frame images of the dynamic image, aligning a line segment connecting the area or point in the plurality of frame images based on the alignment standard, and displaying the line segment superimposed on a representative frame image of the dynamic image on a display means; Equipped with 、 The control means analyzes the measurement results for the plurality of frame images and determines whether or not there is a section among the plurality of frame images where there is an abnormality in the movement of the structure, and if it determines that there is an abnormality, highlights the line segment corresponding to the frame image of the section where the abnormality is determined to exist and is superimposed on the representative frame image.

[0008] The invention described in claim 2 is the invention described in claim 1, The control means measures at least one of the distance of the line segment, the angle formed by the plurality of line segments, or the distance ratio of the plurality of line segments from each of the plurality of frame images, and causes the display means to display the measurement result.

[0009] The invention described in claim 3 is the invention described in claim 2, The control means causes the display means to display the measurement results in a graph in chronological order.

[0011] Claim 4The invention described in claims 1 to 3 In the invention described in any one of the above, When an area on a joint is specified by the specification means, the setting means tracks the area specified on the joint in the plurality of frame images, recognizes the contact points of the joint from within the tracked area in each of the plurality of frame images, and sets the recognized contact points as the alignment reference.

[0012] Claim 5 The display control method of the invention described in A plurality of areas or points are designated on a structure included in the musculoskeletal system from one frame image of a dynamic image acquired by dynamic imaging of the movement of the musculoskeletal system. designation The process and Set alignment criteria based on the specified area or point setting The process and The specified area or point is tracked in a plurality of frame images of the dynamic image, and a line segment connecting the area or point in the plurality of frame images is aligned based on the alignment standard and displayed on a display means in a superimposed manner on a representative frame image of the dynamic image. control The process and Including fruit, The control process analyzes the measurement results for the plurality of frame images to determine whether or not there is a section among the plurality of frame images where there is an abnormality in the movement of the structure, and if it is determined that there is an abnormality, highlights the line segment corresponding to the frame image of the section where the abnormality is determined to exist, which is superimposed on the representative frame image.

[0013] Claim 6 The program of the invention described in Computer, a designation means for designating a plurality of areas or points on a structure included in the musculoskeletal system from one frame image of a dynamic image acquired by dynamic imaging of the movement of the musculoskeletal system; a setting means for setting a positioning reference based on the specified area or point; a control means for tracking the specified area or point in a plurality of frame images of the dynamic image, aligning a line segment connecting the area or point in the plurality of frame images based on the alignment standard, and displaying the line segment superimposed on a representative frame image of the dynamic image on a display means; Functions as height, The control means analyzes the measurement results for the plurality of frame images and determines whether or not there is a section among the plurality of frame images where there is an abnormality in the movement of the structure, and if it determines that there is an abnormality, highlights the line segment corresponding to the frame image of the section where the abnormality is determined to exist and is superimposed on the representative frame image. [Effects of the Invention]

[0014] According to the present invention, it is possible to accurately grasp changes in structures from dynamic images capturing the movement of the musculoskeletal system. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a diagram illustrating an example of the configuration of a radiation imaging system according to an embodiment of the present invention. [Figure 2] 2 is a block diagram illustrating an image processing device provided in the radiation imaging system of FIG. 1. FIG. [Figure 3] 3 is a flowchart showing a measurement process executed by the control unit of FIG. 2. [Figure 4] 4 is a diagram showing an example of line segments and measurement targets (angles) generated in each frame image when the processes of steps S1 to S5 in FIG. 3 are performed on dynamic images capturing bending and extension movements of the knee joint. [Figure 5] FIG. 5 is a diagram showing an example of a superimposed image obtained by aligning the line segments of each frame image shown in FIG. 4 using the ROI on the knee side of the femur as the alignment reference and superimposing the line segments on the representative frame image. [Figure 6] FIG. 10 is a diagram showing an example of a superimposed image displayed when it is determined that an abnormality exists in the section from t+1 to t+2 in the graph of the measurement results. [Figure 7] 10A and 10B are diagrams showing examples of displaying a graph of measurement results when a line segment on a superimposed image is specified by clicking or the like; [Figure 8] 10A and 10B are diagrams showing examples of superimposed images displayed when a graph of measurement results is designated by clicking or the like; [Figure 9] FIG. 10 is a diagram showing an example of a line segment and a measurement target (angle) generated with the contact point of the joint in the ROI specified on the joint as the starting point in each frame image of a dynamic image capturing bending and extension movement of the knee joint. [Figure 10]FIG. 10 is a diagram showing an example of a superimposed image obtained by aligning the line segments of each frame image shown in FIG. 9 using the contact points of joints as alignment references and superimposing the images on a representative frame image. [Figure 11] FIG. 10 is a diagram for explaining a method for extracting a bone axis. [Figure 12] FIG. 10 is a diagram showing an example of joint contact points, bone axes, and measurement targets (angles) recognized from each frame image of a dynamic image capturing bending and extension movements of a knee joint. [Figure 13] 13 is a diagram showing an example of a superimposed image obtained by aligning the bone axes of the frame images shown in FIG. 12 using the contact points of the joints as alignment references and superimposing the images on a representative frame image. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0016] Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the scope of the present invention is not limited to the following embodiments and those described in the drawings.

[0017] <Configuration of Radiography System 100> First, a description will be given of the schematic configuration of a radiation imaging system 100 according to this embodiment.

[0018] 1, the radiation imaging system 100 of this embodiment includes a radiation generating device 1, a radiation detector 2, an image processing device 3, and a server 4. These devices are capable of communicating with each other via a communication network N.

[0019] In addition, the radiation imaging system 100 may be capable of being connected to a Hospital Information System (HIS), a Radiology Information System (RIS), a Picture Archiving and Communication System (PACS), etc., which are not shown.

[0020] Although not shown in the figure, the radiation generating device 1 includes a generator that applies a voltage according to preset radiation irradiation conditions (tube voltage, tube current, irradiation time (mAs value), etc.) based on the operation of an irradiation instruction switch, and a radiation source that generates radiation (e.g., X-rays) of a dose according to the applied voltage when a voltage is applied from the generator. The radiation generating device 1 generates radiation in a manner that corresponds to the radiographic image to be captured (a dynamic image in this embodiment).

[0021] The radiation generating device 1 may be installed in an imaging room, or may be configured as a mobile device called a medical cart together with the image processing device 3 and the like.

[0022] Although not shown, the radiation detector 2 includes a substrate on which pixels are arranged two-dimensionally (in a matrix), the substrate having radiation detection elements that generate electric charges according to the dose when exposed to radiation and switch elements that store and release the electric charges, a scanning circuit that switches each switch element on and off, a readout circuit that reads out the amount of electric charge released from each pixel as a signal value, a control unit that generates a radiographic image from the multiple signal values ​​read out by the readout circuit, and an output unit that outputs data of the generated radiographic image to the outside. The radiation detector 2 is configured to generate a radiological image in accordance with the irradiated radiation in synchronization with the timing at which radiation is irradiated from the radiation generating device 1.

[0023] The radiation detector 2 may be of the so-called indirect type, which incorporates a scintillator or the like and converts the irradiated radiation into light of a different wavelength, such as visible light, and generates an electric charge according to the converted light, or it may be of the so-called direct type, which generates an electric charge directly from the radiation without going through a scintillator or the like. The radiation detector 2 may be a dedicated type integrated with an imaging stand, or may be a portable type (cassette type).

[0024] The image processing device 3 is configured by a PC (Personal Computer), a dedicated device, or the like. The image processing device 3 may also be a console that sets various imaging conditions (tube voltage, tube current, irradiation time (mAs value), frame rate, subject's physique, presence or absence of grid, etc.) in the radiation generator 1, radiation detector 2, etc., based on imaging order information obtained from other systems (HIS, RIS, etc.) and user operations. The image processing device 3 will be described in detail later.

[0025] Server 4 consists of PCs, dedicated devices, virtual servers on the cloud, etc. The server 4 also has a database (DB) 41 . The database 41 is capable of storing radiation images generated by the radiation detector 2 and the processing results of the image processing device 3. In this embodiment, the database 41 is provided on a server 4 independent of the image processing device 3, etc., but the database 41 may be provided within the image processing device 3 or within another device provided in the radiation imaging system 100. Furthermore, when another system such as a PACS is connected to the radiation imaging system 100, the image processing unit 104 may be provided within the other system.

[0026] The radiation imaging system 100 according to this embodiment configured as described above has the radiation source of the radiation generating device 1 and the radiation detector 2 arranged opposite each other with a gap between them, and is capable of performing radiation imaging of a subject by irradiating the subject placed between them with radiation from the radiation source. In this embodiment, dynamic imaging is performed in which irradiation of pulsed radiation from the radiation source and generation of images by the radiation detector 2 are repeated multiple times in a short period of time (for example, 15 times per second) for each imaging operation to generate multiple radiation images that show the dynamics of the subject. A series of radiation images obtained by dynamic imaging is called a dynamic image. Each of the multiple radiation images that make up a dynamic image is called a frame image. Note that dynamic imaging may also be performed by continuously irradiating radiation from the radiation source at a low dose rate for a predetermined period of time (continuous irradiation), during which multiple frame images are generated by the radiation detector 2. Here, dynamic photography includes video photography but does not include taking still images while displaying a video. Dynamic images include video but do not include images obtained by taking still images while displaying a video.

[0027] <Configuration of image processing device 3> Next, a description will be given of a specific configuration of the image processing device 3 provided in the radiation imaging system 100. FIG.

[0028] As shown in FIG. 2, the image processing device 3 according to this embodiment includes a control unit 31, a communication unit 32, a storage unit 33, a display unit , and an operation unit . The units 31 to 35 are electrically connected by a bus or the like. It is also possible to connect a display device (such as a tablet terminal) that includes a display unit and an operation unit to the image processing device 3, without including the display unit 34 and the operation unit 35 in the image processing device 3.

[0029] The control unit 31 includes a CPU (Central Processing Unit), a RAM (Random Access Memory ) etc. The CPU of the control unit 31 reads out various programs stored in the storage unit 33, expands them in the RAM, executes various processes in accordance with the expanded programs, and centrally controls the operations of each unit of the image processing device 3. Furthermore, the control unit 31 executes various processes including measurement processes described below in cooperation with the programs stored in the storage unit 33, and functions as a designation means, a setting means, and a control means.

[0030] The communication unit 32 is composed of a communication module and the like. The communication unit 32 communicates with other devices (such as the radiation detector 2) connected via a communication network N (such as a LAN (Local Area Network), a WAN (Wide Area Network), or the Internet). It transmits and receives various signals and data between the

[0031] The storage unit 33 is configured by a nonvolatile semiconductor memory, a hard disk, or the like. The storage unit 33 also stores various programs executed by the control unit 31, parameters required for executing the programs, and the like. The storage unit 33 may be capable of storing radiographic images.

[0032] The display unit 34 is configured with an LCD (Liquid Crystal Display), a CRT (Cathode Ray Tube), or the like. The display unit 34 displays the radiation image, the measurement results in the radiation image, etc., based on a control signal input from the control unit 31. The display unit 34 functions as a display means.

[0033] The operation unit 35 is configured to be operable by the user using a keyboard equipped with cursor keys, numeric input keys, various function keys, etc., a pointing device such as a mouse, a touch panel laminated on the surface of the display device, etc. The operation unit 35 outputs a control signal to the control unit 31 in response to an operation performed by the user.

[0034] The control unit 31 of the image processing device 3 configured in this way has a function of executing the measurement process shown in FIG. 3 when, for example, a predetermined start operation is performed.

[0035] <Operation> Next, the operation of the radiation imaging system 100 will be described. First, a dynamic image consisting of a plurality of frame images is obtained by performing dynamic imaging of a subject using the radiation generating device 1 and the radiation detector 2. In this embodiment, dynamic imaging is performed on musculoskeletal systems such as the cervical vertebrae, lumbar vertebrae, limb bones, knee joints, hip joints, elbow joints, wrist joints, and ankle joints as the subject, and a dynamic image showing the movement of the musculoskeletal systems is obtained.

[0036] Each frame image of a dynamic image generated by the radiation detector 2 through dynamic imaging is accompanied by information such as an identification ID for identifying the dynamic image, patient information, examination information (imaged region, radiation irradiation conditions, image reading conditions, number indicating imaging order (frame number)), etc. (for example, written in the header area of ​​the image data in DICOM (Digital Image and Communications in Medicine) format), and is sequentially transmitted to the image processing device 3. Note that the frame images of the dynamic image may be transmitted to the image processing device 3 all at once.

[0037] The image processing device 3 performs the measurement process shown in Fig. 3 on the dynamic image transmitted by the radiation detector 2, and measures and outputs information relating to the movement, shape, etc. of the musculoskeletal system. The measurement process is executed by cooperation between the control unit 31 and a program stored in the storage unit 33. The measurement process will be described below with reference to Fig. 3.

[0038] First, the control unit 31 receives the specification of multiple ROIs (regions of interest) or points from one of the multiple frame images of the received dynamic image to identify the start and end points of a line segment to be drawn on a structure (such as a bone) included in the musculoskeletal system (step S1). For example, the control unit 31 displays one frame image (e.g., the first frame image) of the dynamic image on the display unit 34, and accepts, through the user's operation of the operation unit 35, the specification of multiple ROIs or points that will serve as the start and end points of a line segment to be drawn on a structure (such as a bone) included in the musculoskeletal system.

[0039] Next, the control unit 31 accepts the selection of at least one ROI or point from among the multiple designated ROIs or points, and sets the alignment reference (step S2). For example, the control unit 31 accepts the selection of at least one ROI or point from among the multiple ROIs or points specified in step S1 through the user's operation of the operation unit 35, and sets the alignment reference based on the selected ROI or point. For example, when one ROI or point is selected, the control unit 31 sets the selected ROI or point as the alignment reference. When two ROIs or points are selected, the control unit 31 sets the line segment connecting them as the alignment reference.

[0040] Next, the control unit 31 tracks each of the ROIs or points designated in step S1 in the frame images of the dynamic image (step S3). The tracking of ROIs and points can be performed using a known technique such as template matching, and the method is not particularly limited. Note that when a point is specified, for example, template matching can be performed using a small area of ​​a predetermined size centered on the point as a template to track the small area, and the center of the tracked small area can be set as the tracked point. Tracking may be performed on all frame images of the dynamic image, or if only some of the frame images are to be displayed, tracking may be performed on only some of the frame images to be displayed. The frame images to be tracked may be subjected to sharpening, smoothing, dynamic range compression, spatial filtering, etc. in advance, which enables the specified ROI or points to be tracked with high accuracy based on the structural and texture features of the bone.

[0041] Next, the control unit 31 generates a line segment connecting the ROI or point serving as the starting point and the ROI or point serving as the ending point for each frame image in which tracking of the designated ROI or point has been performed (step S4). When the start point and end point are specified in the ROI, a line segment is generated with a predetermined point of the ROI, for example, the center point of the ROI, as the start point and end point.

[0042] Next, the control unit 31 measures the generated line segments for each frame image for which tracking has been performed (step S5). For example, if one line segment is generated, the distance of the line segment is measured. If multiple line segments are generated, at least one of the following is measured: the distance (length) of each line segment, the distance ratio between the multiple line segments, and the angle formed by the multiple (two) line segments. The measurement target (distance, distance ratio, angle, etc.) may be determined in advance, or may be set by the user via the operation unit 35.

[0043] FIG. 4 is a diagram showing the line segments and measurement targets (angles) generated in each frame image when the processing of steps S1 to S5 is performed on frame images (frame t to frame t+3) of a dynamic image capturing bending and extension movements of the knee joint. For example, if ROI41 and ROI42 on the femur are specified as the start point and end point, and ROI43 and ROI44 on the tibia are specified as the start point and end point in step S1 of Fig. 3, a line segment connecting ROI41 and ROI42 on the femur and a line segment connecting ROI43 and ROI44 on the tibia are generated in each frame image, as shown in Fig. 4, and the angle θ between the two line segments is measured, for example. For example, by specifying ROIs at the knee-side end of the femur axis and the pelvis-side end of the femur axis, and specifying ROIs at the knee-side end of the tibia axis and the ankle-side end of the tibia axis, the femur axis and the tibia axis are drawn in each frame image, and the angle between the two bone axes in each frame image can be measured.

[0044] Next, the control unit 31 aligns the line segments generated in each frame image based on the set alignment standard and superimposes them on the representative frame image to generate a superimposed image (step S6).The control unit 31 then causes the display unit 34 to display the superimposed image on which the line segments generated in each frame image are superimposed and the measurement results of the measurement performed in step S5 (step S7), and ends the measurement process.

[0045] Figure 5 is a diagram showing an example of a superimposed image in which the line segments of each frame image shown in Figure 4 are aligned using ROI 41 on the knee side of the femur as an alignment reference and superimposed on a representative frame image. As shown in Figure 5, the line segments generated on the femur and tibia, which are structures around the knee joint, in each frame image are aligned using ROI 41 on the knee side of the femur as a reference and displayed as a list in the representative frame image, making it possible to visualize the movements of the femur and tibia between frame images and enable the user to accurately grasp the movements of the femur and tibia between frame images. In addition, it is possible to accurately measure the lengths (distances) of the bones in each frame image, their ratios (distance ratios), the angles formed by the line segments of the two bones, etc. If a line segment is used as a reference for positioning, it becomes possible to perform positioning based on the representative frame image.

[0046] Here, one of the frame images from which the line segments have been generated may be used as the representative frame image, or multiple frame images may be used as the representative frame images. In the case where multiple frame images are used as the representative frame images, the line segments generated in each of the representative frame images are aligned based on the alignment standard for that representative frame image and then superimposed on each representative frame image, just as in the case where one frame image is used as the representative frame image.

[0047] As a method for displaying the measurement results, for example, the measurement values ​​such as distance, distance ratio, and angle measured in each frame image may be displayed in a table format, or may be displayed in association with line segments on the superimposed image. Alternatively, a graph of the measurement results may be displayed. That is, the measurement values ​​measured in each frame image may be plotted on a coordinate space with the vertical axis representing the measurement value and the horizontal axis representing time (frame number) and displayed as a graph.

[0048] Furthermore, the control unit 31 may analyze the amount of change in the measurement value between frame images based on the graph of the measurement results, and determine whether there is a change point in the movement of the musculoskeletal system (structure) (for example, the timing when the slope of the graph changes) or an abnormal section (for example, a section where the absolute value of the slope of the graph exceeds a predetermined threshold). If it is determined that there is an abnormal section, it may highlight the line segments on the superimposed image that correspond to the frame images of the section determined to be abnormal.

[0049] Fig. 6 is a diagram showing an example of the display of the superimposed image when it is determined that an abnormality exists in the section from t+1 to t+2. As shown in Fig. 6, the line segments corresponding to t+1 and t+2 on the superimposed image are highlighted in a manner different from that of the other line segments (for example, a different color, a different line type, etc.). This allows the user to accurately grasp whether or not there is an abnormality in the movement of the structures included in the musculoskeletal system, and if there is an abnormality, which section (between frame images) the abnormality exists in.

[0050] Furthermore, as shown in FIG. 7, when a line segment on the superimposed image is specified by clicking the operation unit 35 or the like, the control unit 31 may highlight the corresponding point on the graph (the position of the frame image corresponding to the specified line segment). Furthermore, as shown in FIG. 8, when a graph is specified by clicking the operation unit 35 or the like, the control unit 31 may highlight the line segment on the superimposed image corresponding to the specified position. This allows the user to easily and accurately recognize the relationship between the line segment on the superimposed image and the graph. Furthermore, the user can easily check the movement of abnormal sections on the image.

[0051] <Variation 1> Next, a first modification of the above embodiment will be described. In the above embodiment, when an ROI is specified as the start point or end point of a line segment, the center point of the ROI is set as the start point or end point when generating the line segment. However, in variant example 1, when an ROI is specified on a joint including two bones (first bone, second bone), an example is described in which the contact point of the joint within the ROI (the contact point on the first bone side and the second bone side) is set as the start point and alignment reference of the line segment.

[0052] For example, if a ROI on a joint is included among the multiple ROIs specified in step S1 of the measurement processing of the above embodiment, the control unit 31 tracks the ROI on the joint in multiple frame images in step S2 and automatically recognizes the joint contact point (the contact point between the first bone side and the second bone side) from within the tracked ROI in each of the multiple frame images. For example, the control unit 31 recognizes the joint contact point by edge-enhancing the ROI. If the joints on the first bone side and the second bone side are in contact with each other by a surface, the center of the contact surface is recognized as the contact point. The recognized contact point is then set as the alignment reference. When generating line segments in the multiple frame images in step S4, the recognized contact point is used as the starting point of the line segment to generate line segments connecting other ROIs or points. When superimposing the line segments generated in each frame image on the representative frame image in step S6, the line segments are aligned and superimposed using the joint contact point as the alignment reference. In this way, by automatically recognizing the contact points of the joints that serve as fulcrums during movement from each frame image, and then aligning the line segments generated in each frame image based on the recognized contact points and superimposing them on the representative frame image, it becomes possible to more accurately capture and visualize movements during movement.

[0053] Figure 9 shows the line segments and measurement targets (angles) generated in each frame image (frame t to frame t+3) of a dynamic image capturing the flexion and extension movement of the knee joint when ROI 51 is specified on the joint, ROI 52 on the end of the femur on the pelvis side, and ROI 53 on the end of the tibia on the ankle side, and the processing of steps S2 to S5 is performed. 9, in each frame image, a line segment connecting the tangent point P of the joint recognized in ROI 51 to ROI 52, and a line segment connecting the tangent point P to ROI 53 are generated, and the angle θ between the two line segments is measured, for example. The position of the tangent point P of the joint moves within ROI 51 due to bending and extension of the knee joint, and in this first modification, it can be seen that the position of the tangent point P changes within ROI 51 for each frame image, reflecting this.

[0054] 10 is a diagram showing an example of a superimposed image in which the line segments generated in each frame image shown in FIG. 9 are aligned using the contact point P in ROI 51 as the alignment reference and superimposed on the representative frame image. As shown in FIG. 10, the line segments generated on the femur and tibia in each frame image are aligned using the contact point P, which serves as the fulcrum during bending and extension, as the reference and displayed as a list on the representative frame image. This makes it possible to visualize the movement of the femur and tibia between frame images based on the contact point P, which serves as the fulcrum during bending and extension, and allows the user to accurately grasp the movement of the femur and tibia between frame images based on the contact point P, which serves as the fulcrum during bending and extension. It also makes it possible to accurately measure the angle between the femur and tibia in each frame image. In step S2 of the above-mentioned measurement process, the ROI on the joint and another ROI or point can be selected as the alignment reference, and the control unit 31 may set the line segment connecting the contact point recognized from the selected joint and the other ROI or point as the alignment reference.

[0055] <Variation 2> In the first modification, the line segments connecting the joint contact points within the ROI specified on the joint portion in each frame image with other ROIs or points are aligned based on the joint contact points and displayed superimposed on the representative frame image, but the bone axis lines may be calculated from each frame image, aligned based on the above-mentioned joint contact points, and displayed superimposed on the representative frame image. Also, the distance, distance ratio, angle, etc. may be measured from the bone axis lines calculated in each frame image.

[0056] As shown in Figure 11, the bone axis can be generated by first detecting the straight line components L1 and L2 of the bone from each frame image using edge processing, then generating lines L3 and L4 connecting the ends of the detected line segments L1 and L2, and then connecting the midpoints Q1 and Q2 of lines L3 and L4 (L5 in Figure 11).

[0057] Figure 12 shows ROI51 specified on the joint, joint contact point P recognized in ROI51, and bone axis lines (Lt to Lt+3) generated in each frame image in multiple frame images (frame t to frame t+3) of dynamic images capturing the flexion and extension movement of the knee joint.

[0058] 13 is a diagram showing an example of a superimposed image in which the bone axis lines Lt to Lt+3 generated in each frame image shown in FIG. 12 are aligned using the contact point P in ROI 51 as an alignment reference and superimposed on the representative frame image. As shown in FIG. 13, the bone axes of the femur and tibia in each frame image are aligned using the contact point P, which serves as the fulcrum during bending and extension, as a reference and displayed as a list on the representative frame image. This makes it possible to visualize the movement of the bone axes of the femur and tibia between frame images based on the contact point P, which serves as the fulcrum during bending and extension, and allows the user to accurately grasp the movement of the bone axes of the femur and tibia between frame images based on the contact point P, which serves as the fulcrum during bending and extension. In addition, it becomes possible to accurately measure the angles of the bone axes of the femur and tibia in each frame image.

[0059] As described above, the control unit 31 of the image processing device 3 accepts the designation of multiple ROIs or points from one frame image among dynamic images acquired by dynamic imaging of the movement of the musculoskeletal system, and sets a positioning reference based on the designated ROIs or points. The control unit 31 then tracks the designated ROIs or points in the multiple frame images of the dynamic image, aligns the line segments connecting the ROIs or points in the multiple frame images based on the positioning reference, and displays them on the display unit 34 as superimposed on a representative frame image of the dynamic image. Therefore, the line segments connecting the ROIs or points specified on the structure, which are generated in each frame image, are aligned based on the set alignment criteria and displayed in a list in the representative frame image, so that the movement of the structure between frame images can be visualized, allowing the user to accurately grasp the movement of the structure between frame images. Also, because the user can specify the ROI or point that will be the start or end point of the line segment to be drawn on the representative frame image, the movement of the line segment between two points on the structure that the user desires can be visualized.

[0060] Furthermore, the control unit 31 measures at least one of the distance of the generated line segments, the angle between the multiple line segments, or the distance ratio between the multiple line segments from each of the multiple frame images of the dynamic image, and displays the measurement results on the display unit 34. Therefore, it is possible to accurately measure the length (distance) of the line segments on the structure in each frame image, the ratio (distance ratio) of the multiple line segments, the angle of the multiple line segments, etc. Furthermore, since the user can specify the ROI or point that will be the start or end point of the line segment to be drawn on the representative frame image, it is possible to perform measurement on the line segment that the user wants to measure.

[0061] Furthermore, the control unit 31 arranges the measurement results in chronological order and displays them as a graph on the display unit 34, allowing the user to easily grasp the changes in the measurement results over time.

[0062] In addition, the control unit 31 analyzes the measurement results for multiple frame images and determines whether there are any sections in the multiple frame images where there is an abnormality in the movement of the structure, and if it determines that there is an abnormality, it highlights the line segment on the superimposed image corresponding to the frame image of the section where it is determined that there is an abnormality. This allows the user to easily and accurately recognize the relationship between the line segments on the superimposed image and the graph, and also allows the user to easily check abnormal section movements on the image.

[0063] In addition, when an ROI is specified on a joint, the control unit 31 tracks the ROI specified on the joint in multiple frame images, recognizes the contact points of the joint from within the tracked area in each of the multiple frame images, and sets the recognized contact points as the alignment reference. Therefore, the line segments generated in each frame image are aligned based on the contact points of the joints that serve as fulcrums during movement and displayed in a list on a single image, allowing the user to accurately grasp the changes in the movement of the structure between frame images based on the contact points that serve as fulcrums during movement.

[0064] The above-described embodiment and its modified examples are preferred examples of the present invention, and the present invention is not limited to these.

[0065] For example, in the above embodiment, it was explained that the control unit 31 performs the above measurement process using the display unit 34 and operation unit 35 provided in the image processing device 3, accepts the specification of ROIs and points, displays superimposed images and graphs, etc., but it is also possible to perform the above measurement process using the display unit and operation unit of an external terminal device (tablet terminal, etc.) connected to the image processing device 3, accepts the specification of ROIs and points, displays superimposed images and graphs, etc.

[0066] Furthermore, for example, in the above description, examples have been disclosed in which a hard disk or a semiconductor nonvolatile memory is used as a computer-readable medium for the program according to the present invention, but the present invention is not limited to this example. Portable recording media such as CD-ROMs can also be used as other computer-readable media. Furthermore, carrier waves can also be used as a medium for providing data for the program according to the present invention via a communication line.

[0067] In addition, the detailed configuration and detailed operation of each device constituting the radiation imaging system can be modified as appropriate without departing from the spirit of the present invention. [Explanation of symbols]

[0068] 100 Radiography System 1. Radiation generator 2. Radiation detectors 3. Image processing device 31 Control Unit 32 Communications Department 33 Storage section 34 Display section 35 Control section 4 Server 41 databases N Communication Network

Claims

1. a designation means for designating a plurality of areas or points on a structure included in the musculoskeletal system from one frame image of a dynamic image acquired by dynamic imaging of the movement of the musculoskeletal system; a setting means for setting a positioning reference based on the specified area or point; a control means for tracking the designated area or point in a plurality of frame images of the dynamic image, aligning a line segment connecting the area or point in the plurality of frame images based on the alignment standard, and displaying the line segment superimposed on a representative frame image of the dynamic image on a display means; Equipped with The control means analyzes the measurement results for the plurality of frame images to determine whether or not there is a section among the plurality of frame images where there is an abnormality in the movement of the structure, and if it determines that there is a section where there is an abnormality, highlights a line segment corresponding to the frame image of the section where it is determined that there is an abnormality and is superimposed on the representative frame image.

2. 2. The image processing device according to claim 1, wherein the control means measures at least one of the distance of the line segment, the angle formed by the plurality of line segments, or the distance ratio of the plurality of line segments from each of the plurality of frame images, and causes the display means to display the measurement results.

3. 3. The image processing apparatus according to claim 2, wherein the control means causes the display means to display the measurement results in a graph arranged in chronological order.

4. The image processing device according to any one of claims 1 to 3, wherein when an area on a joint is specified by the specification means, the setting means tracks the area specified on the joint in the plurality of frame images, recognizes a contact point of the joint from within the tracked area in each of the plurality of frame images, and sets the recognized contact point as the alignment reference.

5. a designation step of designating a plurality of areas or points on a structure included in the musculoskeletal system from one frame image of a dynamic image acquired by dynamic imaging of the movement of the musculoskeletal system; a setting step of setting a registration reference based on the specified area or point; a control step of tracking the specified area or point in a plurality of frame images of the dynamic image, aligning a line segment connecting the area or point in the plurality of frame images based on the alignment standard, and displaying the line segment superimposed on a representative frame image of the dynamic image on a display means; Including, The control step is a display control method in which the measurement results for the plurality of frame images are analyzed to determine whether or not there is a section among the plurality of frame images where there is an abnormality in the movement of the structure, and if it is determined that there is an abnormality, a line segment corresponding to the frame image of the section where it is determined that there is an abnormality is highlighted and superimposed on the representative frame image.

6. Computer, a designation means for designating a plurality of areas or points on a structure included in the musculoskeletal system from one frame image of a dynamic image acquired by dynamic imaging of the movement of the musculoskeletal system; a setting means for setting a positioning reference based on the specified area or point; a control means for tracking the specified area or point in a plurality of frame images of the dynamic image, aligning a line segment connecting the area or point in the plurality of frame images based on the alignment standard, and displaying the line segment superimposed on a representative frame image of the dynamic image on a display means; It functions as The control means is a program that analyzes the measurement results in the plurality of frame images to determine whether or not there is a section among the plurality of frame images where there is an abnormality in the movement of the structure, and if it determines that there is an abnormality, highlights a line segment corresponding to the frame image of the section where it is determined that there is an abnormality, which is superimposed on the representative frame image.

Images