Image processing apparatus and image processing method

Abstract

To provide an image processing device and an image processing method capable of determining whether or not a motion other than radial flexion and ulnar flexion is included in a dynamic image related to a wrist.SOLUTION: An image processing apparatus of the present disclosure includes an acquisition unit that acquires a radiographic dynamic image obtained by imaging a state of a motion in which a subject causes a wrist to transition between radial flexion and ulnar flexion, and an extraction unit that extracts a frame image including the motion including at least one of palmar flexion or dorsiflexion of a hand joint or rotation of a forearm from a plurality of frame images included in the radiographic dynamic image.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] The present invention relates to an image processing apparatus and an image processing method for processing dynamic images generated by irradiating a subject with radiation. [Background technology]

[0002] Dynamic imaging is performed in which a radiation generator repeatedly emits radiation pulses at a cycle (pulse cycle) of multiple times per unit time (e.g., 15 times per second) for a predetermined time (duration) while an emission command is being issued, and a radiation detection device reads out the amount of charge generated in accordance with the radiation dose received through the subject as a signal value (intensity). Dynamic imaging captures dynamic images consisting of multiple (series of) still images captured at different times, each of which is equal to the pulse cycle. The cycle at which still images are captured is called the frame rate, and is equal to the cycle of the radiation pulses. Patent Document 1 discloses a technology that uses dynamic images to improve the diagnostic accuracy and reproducibility of bones, joints, etc. while reducing radiation exposure dose.

[0003] Dynamic images can be used, for example, to irradiate a subject's wrist with radiation and generate dynamic images to enable doctors to make various diagnoses. In particular, measuring ulnar variance (the difference in height between the ulnar articular surface of the radius and the ulna in a frontal view of the wrist) and observing changes in ulnar variance based on dynamic images are useful for diagnosis. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2021-058569 Summary of the Invention [Problem to be solved by the invention]

[0005] In order for doctors and others to diagnose ulnar displacement using dynamic images, they may have the subject flex and ulnarly flex their wrist while capturing the dynamic images. However, if the subject performs a movement of the wrist other than flexion or ulnar flexion, i.e., palmar flexion or dorsiflexion, or rotation (supination or pronation), it becomes difficult to accurately diagnose ulnar displacement even using the generated dynamic images. For this reason, there is a demand for confirmation that the generated dynamic images do not include movements other than flexion and ulnar flexion.

[0006] An object of the present disclosure is to provide an image processing device and an image processing method that can determine whether a dynamic image of a wrist includes movements other than flexion and ulnar flexion. [Means for solving the problem]

[0007] An image processing device according to one aspect of the present disclosure includes an acquisition unit that acquires radiographic dynamic images capturing the movement of a subject transitioning their wrist between flexion and ulnar flexion, and an extraction unit that extracts frame images from a plurality of frame images contained in the radiographic dynamic images that include the movement including at least one of palmar flexion or dorsiflexion of the wrist, or rotation of the forearm.

[0008] An image processing method according to one aspect of the present disclosure is an image processing method executed by a computer included in an image processing device, which obtains a radiographic dynamic image capturing the movement of a subject transitioning their wrist between flexion and ulnar flexion, and extracts, from a plurality of frame images contained in the radiographic dynamic image, a frame image that includes the movement including at least one of palmar flexion or dorsiflexion of the wrist, or rotation of the forearm. [Effects of the Invention]

[0009] According to the present disclosure, it is possible to determine whether or not a dynamic image of the wrist includes movements other than flexion and ulnar flexion. [Brief explanation of the drawings]

[0010] [Figure 1]Block diagram showing an example of the configuration of a dynamic radiological imaging system [Figure 2] FIG. 1 is a block diagram showing an example of a hardware configuration of an image processing apparatus; [Figure 3] Schematic diagram to explain deflection and ulnar flexion [Figure 4] A functional block diagram showing an example of the functional configuration of an image processing apparatus. [Figure 5] A diagram for explaining a method for extracting frame images containing palmar flexion or dorsiflexion movements. [Figure 6] FIG. 10 is a diagram illustrating a method for extracting a frame image including rotational movement. [Figure 7] Diagram to explain ulnar thrust [Figure 8] Flowchart for explaining image processing in an image processing device DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, each embodiment of the present disclosure will be described in detail with reference to the drawings. However, more detailed explanation than necessary, for example, detailed explanation of already well-known matters or redundant explanation of substantially the same configuration, may be omitted. However, the scope of the present invention is not limited to the following embodiments and those described in the drawings.

[0012] <Configuration of Radiation Dynamic Imaging System 1> An image processing device 10 according to an embodiment of the present disclosure and a dynamic radiation imaging system 1 including the image processing device 10 will be described. FIG.

[0013] The radiological dynamic imaging system 1 includes an image processing device 10, a dynamic image generating device 20, an image server device 30, and a diagnostic terminal device 40. These components are connected to each other so that they can communicate with each other via a communication network N. The communication network N is a network that complies with, for example, the DICOM (Digital Image and Communications in Medicine) standard.

[0014] In addition to the configuration shown in FIG. 1, the dynamic radiation imaging system 1 may be connected to an external system such as a Hospital Information System (HIS) or a Radiology Information System (RIS).

[0015] The dynamic image generating device 20 continuously irradiates a subject (e.g., a patient) with radiation (e.g., X-rays), detects the radiation that has passed through the subject, and generates a dynamic image based on the elapsed time and its intensity. In this specification, a dynamic image is a moving image showing the subject moving their wrist. The dynamic image includes a plurality of frame images captured in chronological order.

[0016] The dynamic image generating device 20 operates based on operations by, for example, a radiographer and preset imaging conditions. The imaging conditions include radiation irradiation conditions, image generation conditions, and subject conditions. The radiation irradiation conditions indicate, for example, the pulse rate, pulse width, pulse interval, the number of frames captured per imaging, and the radiation dose per unit time. The image generation conditions indicate image generation conditions such as the frame rate, frame interval, pixel size, and image size. The subject conditions indicate information about the subject (for example, identification information of the subject), etc.

[0017] In this embodiment, the dynamic image generating device 20 generates radiographic dynamic images of the wrist used for diagnosing the wrist of a subject. More specifically, the dynamic image generating device 20 captures the subject performing radioulnar flexion and generates a radioulnar flexion image. A radioulnar flexion image is a dynamic image showing the subject performing radioulnar flexion and movement. Specifically, the radiographer or doctor first instructs the subject to place their hand face down on a horizontal imaging surface such as an imaging table. Next, the radiographer or doctor instructs the subject to perform radioulnar flexion and movement only from the wrist down without moving the forearm. The dynamic image generating device 20 captures the subject repeating radioulnar flexion and ulnar flexion from above, perpendicular to the imaging surface.

[0018] Radioulnar flexion is a movement that repeatedly performs flexion and ulnar flexion. Flexion is a movement involving the wrist (wrist joint), in which the hand is bent toward the thumb, with the wrist as the fulcrum, in a plane parallel to the palm or the back of the hand. Ulnar flexion is a movement involving the wrist, in which the hand is bent toward the little finger, with the wrist as the fulcrum, in a plane parallel to the palm or the back of the hand. Radioulnar flexion images are useful, for example, when doctors diagnose the function of a subject's wrist. Figure 3 is a schematic diagram for explaining flexion and ulnar flexion. Figures 3A and 3B show the state of a subject's hand as seen from the back of the hand. Figure 3A shows flexion, and Figure 3B shows ulnar flexion.

[0019] The dynamic image generating device 20 may be installed inside an imaging room or may be mobile and mounted on a medical cart or the like.

[0020] The dynamic image generating device 20 transmits the generated dynamic image to the image processing device 10 and the image server device 30. At this time, the dynamic image generating device 20 may transmit additional information including information about the subject appearing in the dynamic image and the date and time of shooting together with the dynamic image or by embedding the information in the dynamic image.

[0021] The image processing device 10 receives dynamic images from the dynamic image generation device 20 and performs various image processing on the dynamic images. The image processing device 10 is configured with a computer including a tablet terminal, a PC (Personal Computer), a workstation, or a dedicated hardware device. The image processing device 10 outputs the processed dynamic images to at least one of the image server device 30 and the diagnostic terminal device 40.

[0022] The image server device 30 stores and manages dynamic images received from the dynamic image generation device 20 or the image processing device 10 in association with accompanying information. In response to a request from the image processing device 10, the image server device 30 transmits the stored dynamic images to the image processing device 10. In response to a request from the diagnostic terminal device 40, the image server device 30 transmits the stored dynamic images to the diagnostic terminal device 40. The image server device 30 is composed of a PC, a workstation, a dedicated hardware device, a virtual server on the cloud, etc.

[0023] The diagnostic terminal device 40 is a device that displays processed dynamic images and associated information to assist doctors and other professionals in making diagnoses. The diagnostic terminal device 40 is configured as a computer including a tablet terminal, a personal computer (PC), a workstation, or a dedicated hardware device. The diagnostic terminal device 40 may generate medical record information including the diagnosis results of doctors and other professionals based on the dynamic images, and transmit the information to an external system such as an HIS or RIS.

[0024] 1 shows an example in which the radiological dynamic imaging system 1 has an independently provided image server device 30. However, the present disclosure is not limited to this, and a database for storing and managing dynamic images may be provided in, for example, the dynamic image generating device 20, the image processing device 10, or the diagnostic terminal device 40. Alternatively, the dynamic images may be transmitted to an external system such as a Picture Archiving and Communication System (PACS), and the dynamic images may be stored and managed in the PACS.

[0025] <Hardware configuration of image processing device 10> FIG. 2 is a block diagram showing an example of the hardware configuration of the image processing device 10. As shown in FIG.

[0026] 2, the image processing device 10 includes, as hardware components, a control unit 101, an operation unit 102, a communication unit 103, a display unit 104, and a storage unit 105. These components are electrically connected via a bus 106. Note that the image processing device 10 may further include hardware components other than those shown in FIG. 2.

[0027] The control unit 101 is configured with a processor such as a CPU (Central Processing Unit), RAM (Random Access Memory), etc. The CPU of the control unit 101 reads out various programs stored in the storage unit 105, loads them into the RAM, and executes various processes in accordance with the loaded programs. In this way, the control unit 101 centrally controls the operations of each unit of the image processing device 10.

[0028] The operation unit 102 is a device that accepts user operations. The operation unit 102 is composed of a keyboard, a pointing device (for example, a mouse or a trackball), a touchpad, etc. The operation unit 102 outputs a control signal to the control unit 101 in response to an operation by the user.

[0029] In this embodiment, the term "user" includes, for example, a doctor who performs diagnosis using the dynamic image generated by the dynamic image generation device 20, or a radiologist who operates the dynamic image generation device 20 to generate the dynamic image.

[0030] The communication unit 103 communicates with other components of the dynamic radiation imaging system 1 via the communication network N shown in FIG.

[0031] Display unit 104 is a display device such as a liquid crystal display (LCD), an organic electroluminescence (EL) display, a cathode ray tube (CRT) display, etc. Display unit 104 displays dynamic images and various displays related to the dynamic images (information about the subject, shooting date and time, etc.) based on a control signal input from control unit 101.

[0032] The storage unit 105 stores various programs executed by the control unit 101, parameters required for executing the programs, etc. The storage unit 105 may also be capable of storing dynamic images. The storage unit 105 is configured, for example, with a non-volatile semiconductor memory, a hard disk drive (HDD), or a solid state drive (SDD).

[0033] <Functional configuration of image processing device 10> 4 is a functional block diagram showing an example of the functional configuration of the image processing device 10. The functional configuration of the image processing device 10 includes an acquisition unit 11, a recognition unit 12, an extraction unit 13, a calculation unit 14, an assignment unit 15, and an output unit 16. Note that the image processing device 10 may further include functional configurations other than those shown in FIG.

[0034] These functional components of the image processing device 10 may be realized by, for example, the control unit 101 shown in FIG.

[0035] The acquisition unit 11 acquires, from the dynamic image generation device 20 or the image server device 30, a radioulnar flexion image, which is a radiological dynamic image of the wrist of the subject.

[0036] The acquisition unit 11 may acquire from the dynamic image generation device 20 a radioulnar flexion image that has just been generated in the dynamic image generation device 20, or may acquire from the image server device 30 a radioulnar flexion image that has been generated in the dynamic image generation device 20 in the past and stored in the image server device 30.

[0037] The recognition unit 12 performs image recognition processing on each of the multiple frame images that make up the radioulnar flexion image, and recognizes each of the structures that appear in each frame image. Candidates for structures that appear in the radioulnar flexion image, which is a radiological dynamic image, include the radius, ulna, and carpal bones (a collective term for the group of bones at the base of the hand). The recognition unit 12 may recognize each of the structures that appear in each frame image using, for example, an image recognition model that has been trained using known image recognition technology.

[0038] The extraction unit 13 extracts frame images that include a movement other than the radioulnar flexion movement from among a plurality of frame images that make up the radioulnar flexion image.

[0039] Movements involving the wrist include radial flexion and ulnar flexion, as well as palmar flexion, dorsiflexion, and rotation. Palmar flexion is a movement involving the wrist joint, in which the wrist is bent in a direction that brings the palm closer to the inside of the wrist. Dorsiflexion is a movement involving the wrist joint, in which the back of the hand is bent in a direction that brings the back of the hand closer to the outside of the wrist. Rotation is a movement involving the forearm, in which the hand, wrist, and forearm rotate around the elbow as a fulcrum by moving so that the radius transitions between a position where it is parallel to the ulna and a position where it intersects with the ulna. Rotation includes pronation and supination. Pronation is a movement in which the forearm rotates inward toward the body. Supination is a movement in which the forearm rotates outward toward the body.

[0040] As described above, wrist movements include multiple types of movements. Among these movements, radioulnar flexion is generally more difficult to perform than palmar flexion, dorsiflexion, and rotation. Therefore, when generating a radioulnar flexion image, even if the subject attempts to repeatedly perform only radial flexion and ulnar flexion, the subject may unintentionally perform movements that include palmar flexion, dorsiflexion, and rotation in addition to radial flexion. As a result, the radioulnar flexion image may include frame images that include at least one of palmar flexion, dorsiflexion, and rotation.

[0041] The extraction unit 13 extracts frame images that include at least one of the movements of palmar flexion, dorsiflexion, or rotation in addition to radioulnar flexion from the plurality of frame images included in the radioulnar flexion image.

[0042] The extraction unit 13 extracts frame images including palmar flexion, dorsiflexion, or rotational movement from the radioulnar flexion images acquired by the acquisition unit 11 using the following method.

[0043] (Method for extracting frame images containing palmar flexion or dorsiflexion movements) The extraction unit 13 extracts frame images including palmar flexion or dorsiflexion movement based on the positional relationship between the palmar end and the dorsal end of the distal end of the radius.

[0044] FIG. 5 is a diagram illustrating a method for extracting frame images including palmar flexion or dorsiflexion movement. FIGS. 5A to 5C are side views of a forearm and hand placed on an imaging surface, viewed from the thumb side. FIGS. 5A to 5C schematically illustrate the appearance of the fingers and wrist when viewed from the side from the thumb side, as well as the perspective view of the radius. FIGS. 5D to 5F each illustrate an example of a frame image obtained when the wrist in the position shown in FIGS. 5A to 5C is imaged from the dorsal side.

[0045] Figure 5A shows the subject in a straight position, i.e., the wrist is not in palmar or dorsiflexion. When the subject's wrist is straight, the imaging plane (horizontal plane) and the longitudinal direction of the radius are approximately parallel.

[0046] As shown in FIG. 5A , the distal end surface S of the radius has an inclined shape in a side view. More specifically, when the subject's wrist is not palmarly flexed or dorsiflexed, the dorsal end Eb of the distal end of the radius protrudes distally (toward the tip of the hand) more than the palmar end Ep. The dorsal end Eb of the distal end of the radius refers to the end of the distal end of the radius on the back side of the hand, and the palmar end Ep of the distal end refers to the end of the distal end of the radius on the palm side. Therefore, in a frame image captured from the dorsal side of the wrist with the subject's wrist straight, the dorsal end Ep of the distal end of the radius is expected to appear closer to the tip of the hand than the palmar end Ep, as shown in FIG. 5D . In FIGS. 5D to 5F , the palmar end Ep is expected to appear in a state where it is visible through the radius in the frame image. In Figures 5D-5F, the dorsal end Eb is shown in solid lines and the palmar end Ep is shown in dashed lines.

[0047] On the other hand, when the subject flexes his / her wrist, the wrist bends so as to approach the radiation source in the dynamic image generating device 20 (see FIG. 5B). FIG. 5B shows the state in which the subject flexes his / her wrist. In this case, the distal end surface S of the radius rotates so that the dorsal end Eb approaches the proximal side and the palmar end Ep approaches the distal side, compared to the state in which the wrist is straight as shown in FIG. 5A. Therefore, in a frame image captured from the dorsal side of the wrist when the subject flexes his / her wrist, as shown in FIG. 5E, it is expected that the distance between the dorsal end Ep and the palmar end Ep at the distal end of the radius will be narrower than the state in which the wrist is straight as shown in FIG. 5D.

[0048] Furthermore, when the subject dorsiflexes the wrist, the wrist joint bends away from the radiation source in the dynamic image generating device 20 (see FIG. 5C ). FIG. 5C shows the state in which the subject dorsiflexes the wrist. In this case, the distal end surface S of the radius rotates so that the dorsal end Eb approaches the distal side and the palmar end Ep approaches the proximal side, compared to the state in which the wrist is straight as shown in FIG. 5A . Therefore, in a frame image captured from the dorsal side of the wrist when the subject dorsiflexes the wrist, as shown in FIG. 5F , it is expected that the distance between the dorsal end Ep and the palmar end Ep at the distal end of the radius will be wider than the state in which the wrist is straight as shown in FIG. 5D .

[0049] For the above reasons, the extraction unit 13 extracts, from each frame image included in the radioulnar flexion image, a frame in which the distance between the palmar end Ep and the dorsal end Eb is smaller than a first threshold as a frame image including palmar flexion movement. Furthermore, from each frame image included in the radioulnar flexion image, the extraction unit 13 extracts, from each frame image included in the radioulnar flexion image, a frame image in which the distance between the palmar end Ep and the dorsal end Eb is larger than the first threshold as a frame image including dorsiflexion movement. The first threshold may be determined, for example, based on a reference value that is the distance between the palmar end Ep and the dorsal end Eb when the wrist is straight. The reference value may be determined, for example, by generating a reference image in which the subject has their hand straight before or after generating the radioulnar flexion image, and measuring the distance between the palmar end Ep at the distal end of the radius and the dorsal end Eb in the reference image. The reference value may also be determined based on, for example, the average value of the distance between the palmar end Ep and the dorsal end Eb at the distal end of the radius in all frames of the radial flexion image.

[0050] In the above-described extraction method, it is assumed that the palmar end Ep of the distal end of the radius is visible through the radius in a frame image captured from the dorsal side of the wrist. However, in a frame image captured from the dorsal side of the wrist, the palmar end Ep may be hidden by the radius itself and may not be clearly visible. In such a case, the extraction unit 13 may extract frame images including palmar flexion movement as follows, for example.

[0051] 5B, when the subject flexes the wrist, the distal end surface S of the radius rotates so that the palmar end Ep approaches the proximal side and the dorsal end Eb approaches the distal side. Therefore, when the subject flexes the wrist greatly, the palmar end Ep may be located more proximal (closer to the tip of the hand) than the dorsal end Eb. Therefore, the extraction unit 13 can extract, as a frame image including palmar flexion movement, a frame image in which the palmar end Ep is located more proximal than the dorsal end Eb at the distal end of the radius.

[0052] Furthermore, the extraction unit 13 extracts frame images including rotational movement based on whether or not the radius and ulna are overlapping in the radioulnar flexion image.

[0053] 6A to 6C are diagrams for explaining a method for extracting frame images containing rotational movement, in which the radius and ulna are shown in perspective.

[0054] Figure 6A shows a hand placed palm-down on the imaging surface, photographed from above (the back of the hand) perpendicular to the imaging surface. In Figure 6A, the subject is not performing any of the following movements: flexion, ulnar flexion, palmar flexion, or dorsiflexion. In this state, the distal ends of the radius and ulna do not overlap each other, but are spaced apart by a small distance. In the following description, this state will be referred to as the reference state for rotation.

[0055] Figure 6B shows the subject's forearm slightly pronated from the reference position shown in Figure 6A. Figure 6C shows the subject's forearm slightly supinated from the reference position shown in Figure 6A. As shown in Figures 6B and 6C, when the subject pronates or supinates the forearm from the reference position, the radius rotates relative to the ulna, causing the distal ends of the radius and ulna to partially overlap. In Figures 6B and 6C, the overlapping portions of the radius and ulna are indicated by dashed lines.

[0056] For the above reasons, the extraction unit 13 extracts, from each frame image included in the radioulnar flexion image, a frame in which the distal end of the radius and the distal end of the ulna overlap as a frame image including rotational movement. However, in a radiological dynamic image, it is difficult to determine which of the overlapping radius and ulna is located closer to the front and which is located further back, and it is possible to accurately determine whether either pronation or supination is occurring.

[0057] The method described above allows the extraction unit 13 to accurately extract frame images that include palmar flexion, dorsiflexion, or rotational movement from among the multiple frame images in the radioulnar flexion image. This also allows the extraction unit 13 to accurately extract frame images that do not include palmar flexion, dorsiflexion, or rotational movement, i.e., frame images that include only radioulnar flexion movement, from among the multiple frame images in the radioulnar flexion image.

[0058] Furthermore, the extraction unit 13 further extracts frame images from the plurality of frame images in which the distal end of the ulna is thrust up distally beyond the reference position. FIG. 7 is a diagram for explaining ulna thrust up. FIG. 7A shows the positional relationship between the ulna and the radius when the ulna is not thrust up. As shown in FIG. 7A, when the ulna is not thrust up, the distal end of the ulna and the distal end of the radius, which is the reference position, are located at approximately the same height. Note that in this specification, in images showing the positional relationship between the radius and ulna, height refers to the distance from the elbow.

[0059] On the other hand, Figure 7B shows the positional relationship between the ulna and radius when the ulna is thrust up. As shown in Figure 7B, if the radius is shortened and deformed for some reason, the distal end of the ulna may be higher than the distal end of the radius, which is the reference position. The state in which the distal end of the ulna thrusts up distally from the reference position, or this difference in height, is called Ulnar Plus Variance.

[0060] When ulnar plus displacement occurs, the distal end of the ulna comes into contact with the carpal bones, which can easily cause pain. The condition in which wrist pain occurs due to ulnar plus displacement is commonly called ulnar thrust syndrome.

[0061] In order to diagnose ulnar thrust syndrome, doctors and others may compare the height of the distal end of the ulna with the height of the distal end of the radius in each frame image of the radioulnar flexion image. For such a diagnosis, the extraction unit 13 extracts frames in which the distal end of the ulna thrusts further distally than the distal end of the radius, which is the reference position, from the multiple frame images included in the radioulnar flexion image.

[0062] Specifically, the extraction unit 13 determines whether the ulna is thrusting distally beyond the reference position in each frame image based on the positional relationship between the radius and ulna in each frame image, thereby enabling the extraction unit 13 to extract frame images in which the ulna is thrusting distally beyond the reference position from all frame images included in the image.

[0063] Returning to the explanation of Fig. 4, the calculation unit 14 calculates the ratio (hereinafter referred to as a first ratio) of frame images showing a movement including at least one of palmar flexion or dorsiflexion of the wrist or rotation of the forearm among the plurality of frame images included in the radioulnar flexion image. The calculation unit 14 also calculates the ratio (hereinafter referred to as a second ratio) of frame images including only radioulnar flexion movement among the plurality of frame images included in the radioulnar flexion image.

[0064] The calculation unit 14 calculates a first ratio by adding up the number of frame images including palmar flexion, dorsiflexion, and rotational movement extracted by the extraction unit 13, and dividing the sum by the number of all frame images including radioulnar flexion images. The calculation unit 14 also calculates a second ratio by subtracting the first ratio from 1.

[0065] The assigning unit 15 assigns attached information relating to diagnostic usefulness based on at least one of the first ratio and the second ratio to the radioulnar flexion image. The attached information may be assigned to the radioulnar flexion image file, for example, like tag information attached to the radioulnar flexion image file.

[0066] The attached information may include overall information that is assigned to the entire radioulnar flexion image, and individual information that is assigned to each frame image.

[0067] Examples of the overall information include the numerical values ​​of the first ratio and the second ratio. By referring to the overall information of a certain radioulnar flexion image, a doctor or the like who makes a diagnosis using radioulnar flexion images can determine in advance whether the radioulnar flexion image is useful for diagnosing a subject's wrist. As described above, radioulnar flexion images are dynamic images, and therefore it takes time to view the entire image. However, by referring to the overall information in advance, it is possible to avoid viewing radioulnar flexion images that are not useful for diagnosis. This can improve the time efficiency of diagnoses using radioulnar flexion images.

[0068] In addition, when the first ratio is lower than a certain threshold or the second ratio is equal to or higher than a certain threshold for a certain radioulnar flexion image, the assigning unit 15 may assign a flag indicating that the radioulnar flexion image is useful for diagnosis as overall information instead of the numerical value of the first ratio or the second ratio.

[0069] An example of the individual information may include a flag indicating that a certain frame image is useful for diagnosis. For example, if a certain frame image does not include any movement other than radioulnar flexion (volar flexion, dorsiflexion, or rotation), the assigning unit 15 may assign a flag indicating that the frame image is a frame image with high diagnostic usefulness. On the other hand, if the frame image includes any movement of palmar flexion, dorsiflexion, or rotation, the assigning unit 15 may assign a flag indicating that the frame image is not a frame image with high diagnostic usefulness.

[0070] Another example of the individual information may include a numerical value indicating the positive ulnar displacement occurring in the frame image. The numerical value indicating the positive ulnar displacement may be measured or estimated, for example, based on the image recognition result of the recognition unit 12. Furthermore, individual information related to a flag indicating that a positive ulnar displacement has occurred may be added to a frame image in which the numerical value of the positive ulnar displacement exceeds a predetermined threshold.

[0071] The above-described example of the attached information is merely an example, and in the present disclosure, various information other than the above-described example may be added as attached information.

[0072] The output unit 16 outputs the radial flexion images to which the attached information is attached for each frame image to at least one of the image server device 30 and the diagnostic terminal device 40.

[0073] <Example of operation> 8 is a flowchart for explaining image processing in the image processing device 10. Note that image processing in the image processing device 10 may be automatically started, for example, when a new radioulnar flexion image is generated in the dynamic image generation device 20. Image processing in the image processing device 10 may also be started when a doctor or the like selects, via the diagnostic terminal device 40, a specific radioulnar flexion image stored in the image server device 30 as a target for image processing in the image processing device 10.

[0074] In step S1, the acquisition unit 11 acquires a radioulnar flexion image to be processed from the dynamic image generation device 20 or the image server device 30.

[0075] In step S2, the extraction unit 13 extracts frame images that include a movement other than radioulnar flexion, that is, at least one of palmar flexion, dorsiflexion, and rotation, from all frame images of the radioulnar flexion image.

[0076] In step S3, the calculation unit 14 calculates a first ratio, which is the ratio of frame images including movements other than radioulnar flexion to all frame images of the radioulnar flexion images. Alternatively, in step S2, the extraction unit 13 may calculate a second ratio, which is the ratio of frame images including no movements other than radioulnar flexion to all frame images of the radioulnar flexion images.

[0077] In step S4, the recognition unit 12 measures the ulna plus displacement in each of all frame images of the radioulnar flexion image.

[0078] In step S5, the assigning unit 15 generates attached information to be assigned to the radioulnar flexion image. Specifically, the assigning unit 15 generates overall information regarding the diagnostic usefulness of the radioulnar flexion image based on the first ratio or the second ratio calculated in step S3. The assigning unit 15 also generates individual information regarding the diagnostic usefulness of each frame image based on whether or not a movement other than radioulnar flexion is included in the frame image. The assigning unit 15 also generates individual information regarding the value of the ulnar positive displacement measured in step S4. The assigning unit 15 also generates individual information indicating whether or not a ulnar positive displacement has occurred in each frame image based on the value of the ulnar positive displacement.

[0079] In step S6, the output unit 16 outputs the radial flexion image with the attached information generated in step S5 to the image server device 30 or the diagnostic terminal device 40. This completes the image processing in the image processing device 10.

[0080] 8, an example has been described in which processing related to ulnar positive displacement is performed in step S4 after processing related to frame images including movements other than radioulnar flexion in steps S2 and S3. The present disclosure is not limited to this processing flow. For example, processing related to frame images including movements other than radioulnar flexion and processing related to ulnar positive displacement may be performed in parallel. Furthermore, processing related to frame images including movements other than radioulnar flexion may be performed after processing related to ulnar positive displacement is completed.

[0081] <Actions and Effects> As described above, the image processing device 10 according to an embodiment of the present disclosure includes an acquisition unit 11 that acquires radiological dynamic images (radial-ulnar flexion images) capturing the movement of a subject's wrist as it transitions between flexion and ulnar flexion, and an extraction unit 13 that extracts frame images from the multiple frame images contained in the radiological dynamic images that include movement including at least one of palmar flexion or dorsiflexion of the wrist, or rotation of the forearm.

[0082] With this configuration, it is possible to accurately and easily determine whether or not each frame image of the radioulnar flexion image contains movements other than flexion and ulnar flexion. This allows a doctor or other person who uses the radioulnar flexion image to diagnose a subject's wrist to appropriately determine whether the radioulnar flexion image is useful for diagnosis before actually viewing the entire moving radioulnar flexion image. This eliminates the need to spend time viewing radioulnar flexion images that are not useful for diagnosis, enabling more efficient diagnosis.

[0083] Furthermore, according to the image processing device 10 relating to the embodiment of the present disclosure, the extraction unit 13 extracts frame images showing movements including palmar flexion or dorsiflexion of the wrist joint based on the positional relationship between the palmar end and the dorsal end of the distal end of the radius.

[0084] With this configuration, it is possible to accurately and easily determine whether or not each frame image of the radioulnar flexion image contains any movement of palmar flexion or dorsiflexion in addition to flexion or ulnar flexion. This allows a doctor or other person making a diagnosis to select only frame images that do not contain any movement other than radioulnar flexion, for example, from the radioulnar flexion image, thereby improving the accuracy of the diagnosis.

[0085] The extraction unit 13 extracts frame images showing a movement including rotation of the forearm based on whether or not the radius and ulna are overlapping in the image.

[0086] With this configuration, it is possible to accurately and easily determine whether or not each frame image of the radioulnar flexion image contains a rotational movement (pronation or supination) in addition to flexion or ulnar flexion. This allows a doctor or other person making a diagnosis to select only frame images that do not contain any movement other than radioulnar flexion from the radioulnar flexion image, thereby improving the accuracy of the diagnosis.

[0087] In addition, the image processing device 10 according to the embodiment of the present disclosure further includes a calculation unit 14 that calculates a first ratio, which is the ratio of frame images among the plurality of frame images that show movements including at least one of palmar flexion or dorsiflexion of the wrist, or rotation of the forearm.

[0088] With this configuration, it is easy to determine whether the entire radioulnar flexion image made up of multiple frame images is useful for diagnosing the wrist, which saves time spent viewing radioulnar flexion images that are not useful for diagnosis, enabling efficient diagnosis.

[0089] Moreover, the image processing device 10 according to the embodiment of the present disclosure further includes an attachment unit 15 that attaches attachment information relating to the diagnostic utility based on the ratio to the radiological dynamic image.

[0090] With this configuration, it is possible to attach information indicating whether the entire radioulnar flexion image composed of a plurality of frame images, or each of the frame images, is useful for making a diagnosis about the wrist, thereby enabling a doctor or other person making a diagnosis to appropriately determine whether or not to use the radioulnar flexion image for diagnosis and which frame image to refer to for making the diagnosis.

[0091] Furthermore, in the image processing device 10 according to the embodiment of the present disclosure, the extraction unit 13 further extracts, from among the multiple frame images, a frame image in which the distal end of the ulna is thrust up distally beyond the reference position, and the attachment unit 15 attaches attached information to the frame image in which the distal end of the ulna is thrust up distally.

[0092] This configuration allows information about ulnar variance, which is useful for diagnosing the wrist, to be attached to each frame image. This eliminates the need for the doctor performing the diagnosis to measure ulnar variance from the radioulnar flexion image, thereby reducing the time and effort required for diagnosis and enabling more efficient diagnosis.

[0093] <Modification> The above-described embodiment is merely one example of application of the present disclosure, and the present disclosure is not limited to the above-described embodiment.

[0094] In the above-described embodiment, an example has been described in which a radioulnar flexion image is generated by photographing a hand placed palm-down on a horizontal imaging surface from above perpendicular to the imaging surface. The radioulnar flexion image of the present disclosure is not limited to this, and may be generated, for example, by photographing a hand placed with the palm in contact with an imaging surface that is perpendicular or inclined to the horizontal plane, from the back of the hand perpendicular to the imaging surface. [Industrial Applicability]

[0095] The present disclosure is useful for an image processing device that performs image processing using radiological dynamic images of a wrist. [Explanation of symbols]

[0096] 1. Radiation Dynamic Imaging System 10 Image processing device 101 Control section 102 Operation section 103 Communications Department 104 Display section 105 Storage section Bus 106 11 Acquisition Department 12 Recognition part 13 Extraction part 14 Calculation section 15 Granting Department 16 Output section 20 Dynamic image generation device 30 Image server device 40 Diagnostic terminal equipment

Claims

1. an acquisition unit that acquires radiological dynamic images capturing the state of a subject's wrist movement between flexion and ulnar flexion; an extracting unit that extracts frame images including at least one of palmar flexion or dorsiflexion of the wrist, or rotation of the forearm, from a plurality of frame images included in the radiological dynamic image; An image processing device comprising:

2. the extraction unit extracts frame images showing the movement including palmar flexion or dorsiflexion of the wrist based on a positional relationship between a palmar end and a dorsal end of the distal end of the radius; The image processing device according to claim 1 .

3. the extraction unit extracts frame images showing the movement including the rotation of the forearm based on whether or not the radius and the ulna are overlapping in the image. The image processing device according to claim 1 .

4. a calculation unit that calculates a ratio of frame images showing at least one of palmar flexion or dorsiflexion of a wrist joint, or rotation of a forearm, among the plurality of frame images; The image processing device according to claim 1 .

5. and an assigning unit that assigns attached information regarding diagnostic usefulness based on the ratio to the radiological dynamic image. The image processing device according to claim 4 .

6. the extraction unit further extracts a frame image in which the distal end of the ulna is pushed up distally from a reference position from among the plurality of frame images; the adding unit adds the attachment information to a frame image in which the distal end of the ulna is pushed up distally. The image processing device according to claim 5 .

7. An image processing method executed by a computer included in an image processing device, A radiological dynamic image is acquired, capturing the state of the subject's wrist movement between flexion and ulnar flexion; extracting a frame image including at least one of palmar flexion or dorsiflexion of the wrist, or rotation of the forearm, from a plurality of frame images included in the radiological dynamic image; Image processing methods.

Images