Medical image processing device, medical image processing method, and program

JP7872146B2Active Publication Date: 2026-06-09FUJIFILM CORP

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
FUJIFILM CORP
Filing Date
2021-01-25
Publication Date
2026-06-09

AI Technical Summary

Benefits of technology

【0024】 本発明によれば、被写体の観察状態に変化が生じた時点で、被写体の観察状態表示がモニタに表示されるので、被写体の観察状態表示を適切なタイミングで表示させることにより、内視鏡画像の観察への影響を抑制しつつ効果的に表示を行うことができる。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007872146000001
    Figure 0007872146000001
  • Figure 0007872146000002
    Figure 0007872146000002
  • Figure 0007872146000003
    Figure 0007872146000003
Patent Text Reader

Abstract

Provided are a medical image processing device, a medical image processing method, and a program which can reduce a deviation between recognition by a recognizer and recognition of a user. This medical image processing device is provided with a processor (210) and a memory (207). The processor (210) acquires a plurality of medical images in a time series, determines an observation state of a unit of a small region of a subject on the basis of the medical images, causes the memory (207) to record a determination result, and causes a monitor (400) to display an observation state display that is of the subject and that is based on the determination result recorded in the memory (207), at a time point when the observation state of the subject has changed.
Need to check novelty before this filing date? Find Prior Art

Claims

1. A medical image processing device comprising a processor and memory, The aforementioned processor, By acquiring multiple medical images in chronological order, Based on the medical image, the observation status of each small region of the subject is determined as follows: if the observation of a small region of the subject is completed, the observation is considered complete; if the observation is not completed, the observation is considered incomplete. The result of the above determination is recorded in the memory. When the observation status of the small area of ​​the subject changes from "observation incomplete" to "observation complete," an observation status display is shown on the monitor to inform the user of the observation status of the small area of ​​the subject based on the determination result recorded in the memory. A medical image processing device that hides the observation status display shown on the monitor after a predetermined time has elapsed.

2. A medical image processing device comprising a processor and memory, The aforementioned processor, By acquiring multiple medical images in chronological order, Based on the medical image, the observation status of each small region of the subject is determined as follows: if the observation of a small region of the subject is completed, the observation is considered complete; if the observation is not completed, the observation is considered incomplete. The result of the above determination is recorded in the memory. When the observation status of the small area of ​​the subject changes from "observation incomplete" to "observation complete," an observation status display is shown on the monitor to inform the user of the observation status of the small area of ​​the subject based on the determination result recorded in the memory. The monitor has a first display area and a second display area smaller than the first display area, and the observation state display is displayed in the first display area and the second display area in different manners. A medical image processing device that displays the medical image in the first display area and displays the observation status display in the second display area.

3. A medical image processing device comprising a processor and memory, The aforementioned processor, By acquiring multiple medical images in chronological order, In the aforementioned medical image, a pre-trained model, which has been trained to recognize each of the multiple sub-regions, is used to recognize a predetermined number of sub-regions within the organ of the subject, each sub-region unit. Based on the recognition results, the observation status is determined as follows: if the observation of each of the multiple sub-regions of the subject is complete, the observation is considered complete; otherwise, the observation is considered incomplete. Based on the result of the determination, an observation status display is shown on the monitor to inform the user whether the observation status of each of the multiple sub-regions of the subject is incomplete or complete. The result of the above determination is recorded in the memory. When the observation status of one of the multiple sub-regions of the subject changes from "observation incomplete" to "observation complete," the observation status display is updated to indicate that the observation status of the one sub-region is complete, based on the result of the determination recorded in the memory. A medical image processing device that hides the observation status display shown on the monitor after a predetermined time has elapsed.

4. A medical image processing device comprising a processor and memory, The aforementioned processor, By acquiring multiple medical images in chronological order, Based on the medical image, if the observation of a small area of ​​the subject is completed, the observation is considered complete; if the observation is not completed, the observation is considered incomplete. The observation status is determined for each small area. The result of the above determination is recorded in the memory. When the observation status of the small area of ​​the subject changes from "observation incomplete" to "observation complete," an observation status display is shown on the monitor to inform the user of the observation status of the small area of ​​the subject based on the determination result recorded in the memory. The medical image is displayed on the monitor, and the observation status display is superimposed on the image. A medical image processing device that hides the observation status display shown on the monitor after a predetermined time has elapsed.

5. A medical image processing device comprising a processor and memory, The aforementioned processor, By acquiring multiple medical images in chronological order, Based on the medical image, the observation status of each small region of the subject is determined as follows: if the observation of a small region of the subject is completed, the observation is considered complete; if the observation is not completed, the observation is considered incomplete. The result of the above determination is recorded in the memory. When the observation status of the small area of ​​the subject changes from "observation incomplete" to "observation complete," an observation status display is shown on the monitor to inform the user of the observation status of the small area of ​​the subject based on the determination result recorded in the memory. The monitor has a first display area and a second display area smaller than the first display area, and the observation state display is displayed in the first display area and the second display area in different manners. The medical image is displayed in the first display area, and the observation status display is displayed in the second display area. A medical image processing device that hides the observation status display shown on the monitor after a predetermined time has elapsed.

6. A medical image processing device comprising a processor and memory, The aforementioned processor, By acquiring multiple medical images in chronological order, In the aforementioned medical image, a pre-trained model, which has been trained to recognize each of the multiple sub-regions, is used to recognize a predetermined number of sub-regions within the organ of the subject, each sub-region unit. Based on the recognition results, the observation status is determined as follows: if the observation of each of the multiple sub-regions of the subject is complete, the observation is considered complete; otherwise, the observation is considered incomplete. Based on the result of the determination, an observation status display is shown on the monitor to inform the user whether the observation status of each of the multiple sub-regions of the subject is incomplete or complete. The result of the above determination is recorded in the memory. When the observation status of one of the multiple sub-regions of the subject changes from "observation incomplete" to "observation complete," the observation status display is updated to indicate that the observation status of the one sub-region is complete, based on the result of the determination recorded in the memory. A medical image processing apparatus comprising a monitor having a first display area and a second display area smaller than the first display area, wherein the observation state display is displayed in the first display area and the second display area in different manners.

7. A medical image processing device comprising a processor and memory, The aforementioned processor, By acquiring multiple medical images in chronological order, Based on the medical image, the observation status of each small region of the subject is determined as follows: if the observation of a small region of the subject is completed, the observation is considered complete; if the observation is not completed, the observation is considered incomplete. The result of the above determination is recorded in the memory. When the observation status of the small area of ​​the subject changes from "observation incomplete" to "observation complete," an observation status display is shown on the monitor to inform the user of the observation status of the small area of ​​the subject based on the determination result recorded in the memory. The observation status display shown on the monitor is hidden after a predetermined time has elapsed. A medical image processing apparatus comprising a monitor having a first display area and a second display area smaller than the first display area, wherein the observation state display is displayed in the first display area and the second display area in different manners.

8. A medical image processing device comprising a processor and memory, The aforementioned processor, By acquiring multiple medical images in chronological order, Based on the medical image, if the observation of a small area of ​​the subject is completed, the observation is considered complete; if the observation is not completed, the observation is considered incomplete. The observation status is determined for each small area. The result of the above determination is recorded in the memory. When the observation status of the small area of ​​the subject changes from "observation incomplete" to "observation complete," an observation status display is shown on the monitor to inform the user of the observation status of the small area of ​​the subject based on the determination result recorded in the memory. The medical image is displayed on the monitor, and the observation status display is superimposed on the image. A medical image processing apparatus comprising a monitor having a first display area and a second display area smaller than the first display area, wherein the observation state display is displayed in the first display area and the second display area in different manners.

9. A medical image processing device comprising a processor and memory, The aforementioned processor, By acquiring multiple medical images in chronological order, Based on the medical image, the observation status of each small region of the subject is determined as follows: if the observation of a small region of the subject is completed, the observation is considered complete; if the observation is not completed, the observation is considered incomplete. The result of the above determination is recorded in the memory. When the observation status of the small area of ​​the subject changes from "observation incomplete" to "observation complete," an observation status display is shown on the monitor to inform the user of the observation status of the small area of ​​the subject based on the determination result recorded in the memory. The monitor has a first display area and a second display area smaller than the first display area, and the observation state display is displayed in the first display area and the second display area in different manners. The medical image is displayed in the first display area, and the observation status display is displayed in the second display area. A medical image processing device that displays the medical image in the first display area and displays the observation status display in the second display area.

10. A medical image processing device comprising a processor and memory, The aforementioned processor, By acquiring multiple medical images in chronological order, Based on the medical image, the observation status of each small region of the subject is determined as follows: if the observation of a small region of the subject is completed, the observation is considered complete; if the observation is not completed, the observation is considered incomplete. The result of the above determination is recorded in the memory. When the observation status of the small area of ​​the subject changes from "observation incomplete" to "observation complete," an observation status display is shown on the monitor to inform the user of the observation status of the small area of ​​the subject based on the determination result recorded in the memory. The monitor has a first display area and a second display area smaller than the first display area, and the observation state display is displayed in the first display area and the second display area in different manners. The medical image is displayed in the first display area, and the observation status display is displayed in the second display area. The observation status display is composed of a subject model that schematically represents the subject, and is a medical image processing device.

11. A medical image processing device comprising a processor and memory, The aforementioned processor, By acquiring multiple medical images in chronological order, Based on the medical image, the observation status of each small region of the subject is determined as follows: if the observation of a small region of the subject is completed, the observation is considered complete; if the observation is not completed, the observation is considered incomplete. The result of the above determination is recorded in the memory. When the observation status of the small area of ​​the subject changes from "observation incomplete" to "observation complete," an observation status display is shown on the monitor to inform the user of the observation status of the small area of ​​the subject based on the determination result recorded in the memory. The monitor has a first display area and a second display area smaller than the first display area, and the observation state display is displayed in the first display area and the second display area in different manners. The medical image is displayed in the first display area, and the observation status display is displayed in the second display area. The aforementioned observation status display is composed of textual information, and is a medical image processing device.

12. The medical image processing apparatus according to any one of claims 1 to 5, wherein the processor displays the observation status on the monitor using character information.

13. The medical image processing apparatus according to claim 12, wherein the processor adds information regarding the completion or incompleteness of the observation of the small region unit of the subject to the character information and displays it as the observation status display.

14. The medical image processing apparatus according to any one of claims 1 to 5, 12, and 13, wherein the processor displays the observation state using a subject model that schematically represents the subject.

15. The medical image processing apparatus according to claim 14, wherein the processor provides the subject model with information regarding the completion or incompleteness of the observation of the subject in small area units, and displays it as the observation status display.

16. The medical image processing apparatus according to any one of claims 1 to 5 and 12 to 15, wherein the processor displays only the completion or incomplete observation of the subject in small area units as the observation status display.

17. The medical image processing apparatus according to any one of claims 1 to 5 and 12 to 16, wherein the processor causes the medical image to be displayed on the monitor and the observation status display to be superimposed on the medical image.

18. The medical image processing apparatus according to any one of claims 3 to 5 and 12 to 17, wherein the processor is a monitor having a first display area and a second display area smaller than the first display area, and the observation state display is displayed in the first display area and the second display area in different manners.

19. The medical image processing apparatus according to claim 18, wherein the processor displays the observation state display in the first display area when a change occurs in the observation state, and displays the observation state display in the second display area at all times.

20. The medical image processing apparatus according to any one of claims 6 to 8, 18, and 19, wherein the processor is a monitor having a third display area different from the first display area and the second display area, and the medical image is displayed in the third display area.

21. A medical image processing apparatus according to any one of claims 6 to 8 and 18 to 20, wherein the medical image is displayed in the first display area and the observation status display is displayed in the second display area.

22. The medical image processing apparatus according to claim 9 or 21, wherein the observation state display is composed of a subject model that schematically represents the subject.

23. The medical image processing apparatus according to claim 9 or 21, wherein the observation status display is composed of character information.

24. The medical image processing apparatus according to claim 11 or 23, wherein the observation status display is comprised of the character information indicating the percentage of the observation that has not yet been completed.

25. A medical image processing method for a medical image processing device comprising a processor and memory, The aforementioned processor, Steps include acquiring multiple medical images in chronological order, The steps include determining the observation status for each small area unit, where the observation of a small area unit of the subject is completed based on the medical image, and the observation is considered complete if the observation is not yet complete; The steps include recording the result of the determination in the memory, When the observation status of the small area of ​​the subject changes from "observation incomplete" to "observation complete", the step of displaying an observation status indicator on the monitor to inform the user of the observation status of the small area of ​​the subject based on the result of the determination recorded in the memory, A medical image processing method comprising the step of hiding the observation status display shown on the monitor after a predetermined time has elapsed.

26. A medical image processing method for a medical image processing device comprising a processor and memory, The aforementioned processor, Steps include acquiring multiple medical images in chronological order, The steps include determining the observation status for each small area unit, where the observation of a small area unit of the subject is completed based on the medical image, and the observation is considered complete if the observation is not yet complete; The steps include recording the result of the determination in the memory, When the observation status of the small area of ​​the subject changes from "observation incomplete" to "observation complete", the step of displaying an observation status indicator on the monitor to inform the user of the observation status of the small area of ​​the subject based on the result of the determination recorded in the memory, The monitor having a first display area and a second display area smaller than the first display area, the steps of displaying the observation state in the first display area and the second display area in different manners, A medical image processing method comprising the steps of displaying the medical image in the first display area and displaying the observation status display in the second display area.

27. A medical image processing method for a medical image processing device comprising a processor and memory, The aforementioned processor, Steps include acquiring multiple medical images in chronological order, The medical image includes the step of recognizing, using a trained model that has been trained to recognize each of the multiple sub-regions, each sub-region unit, that are predetermined to be located at different positions within the organ of the subject, Based on the results of the recognition, the observation status is determined to be complete if the observation of each of the multiple sub-regions of the subject has been completed, and incomplete if the observation has not been completed. Based on the result of the determination, the step of displaying an observation status indicator on the monitor to inform the user whether the observation status of each of the multiple sub-regions of the subject is incomplete or complete. The steps include recording the result of the determination in the memory, The steps include updating the observation status display to indicate that the observation status of one of the multiple sub-regions of the subject has been completed, based on the result of the determination recorded in the memory, when the observation status of one sub-region changes from "observation not completed" to "observation completed", A medical image processing method comprising the step of hiding the observation status display shown on the monitor after a predetermined time has elapsed.

28. Image processing method for a medical image processing apparatus comprising a processor and memory, The aforementioned processor, Steps include acquiring multiple medical images in chronological order, The medical image includes the step of recognizing, using a trained model that has been trained to recognize each of the multiple sub-regions, each sub-region unit, that are predetermined to be located at different positions within the organ of the subject, Based on the results of the recognition, the observation status is determined to be complete if the observation of each of the multiple sub-regions of the subject has been completed, and incomplete if the observation has not been completed. Based on the result of the determination, the step of displaying an observation status indicator on the monitor to inform the user whether the observation status of each of the multiple sub-regions of the subject is incomplete or complete. The steps include recording the result of the determination in the memory, The steps include updating the observation status display to indicate that the observation status of one of the multiple sub-regions of the subject has been completed, based on the result of the determination recorded in the memory, when the observation status of one sub-region changes from "observation not completed" to "observation completed", A medical image processing method comprising the steps of: a monitor having a first display area and a second display area smaller than the first display area, wherein the observation state display is displayed in the first display area and the second display area in different manners.