Medical assistance device, ultrasonic endoscope, medical assistance method, and program

Abstract

This medical assistance device comprises a processor. The processor: displays, on a screen, a first ultrasonic image which is from among a plurality of time-series ultrasonic images, which satisfies a predetermined condition, and in which an observation-target site is shown; and outputs first size information indicating a first size. The first size is the size of the observation-target site which is shown in the first ultrasonic image.

Description

Medical support device, ultrasonic endoscope, medical support method, and program

[0001] The technology of the present disclosure relates to a medical support device, an ultrasonic endoscope, a medical support method, and a program.

[0002] International Publication No. 2020 / 008743 discloses an acoustic wave diagnostic device including a display unit, an operation unit, a measurement position designation receiving unit, a measurement target recognition unit, a measurement algorithm setting unit, and a measurement unit.

[0003] In the acoustic wave diagnostic device described in WO 2020 / 008743, the display unit displays the acquired acoustic wave image. The measurement position designation receiving unit accepts designation of a measurement position on the acoustic wave image displayed on the display unit from a user via an operation unit. The measurement target recognition unit recognizes a measurement target included in the acoustic wave image within a recognition range determined based on the measurement position accepted by the measurement position designation receiving unit. The measurement algorithm setting unit sets a measurement algorithm based on the measurement target recognized by the measurement target recognition unit. The measurement unit measures the measurement target on the acoustic wave image based on the measurement algorithm set by the measurement algorithm setting unit and displays the measurement results on the display unit.

[0004] International Publication No. WO 2020 / 008746 discloses an acoustic diagnostic device that sequentially displays multiple consecutive frames of acoustic images during imaging on a display unit. The acoustic diagnostic device described in International Publication No. WO 2020 / 008746 includes a measurement target recognition unit, a measurement algorithm setting unit, and a measurement unit.

[0005] In the acoustic wave diagnostic device described in WO 2020 / 008746, a measurement target recognition unit automatically recognizes a measurement target included in an acoustic wave image of a current frame displayed on a display unit. A measurement algorithm setting unit sets a measurement algorithm for the measurement target recognized by the measurement target recognition unit. A measurement unit measures the measurement target based on the measurement algorithm set by the measurement algorithm setting unit and displays the measurement result on the display unit, superimposed on the acoustic wave image of the current frame.

[0006] International Publication No. 2017 / 104263 discloses an ultrasound observation device in which the positions of two measurement points determined by instruction input from a touch panel are calculated, and then an inter-measurement distance calculation unit calculates the distance between the two measurement points and displays the calculated distance on a display unit.

[0007] One embodiment of the technology of the present disclosure provides a medical support device, an ultrasonic endoscope, a medical support method, and a program that enable a user observing an ultrasound image that shows the area to be observed and satisfies predetermined conditions to understand the size of the area to be observed.

[0008] A first aspect of the technology of the present disclosure is a medical support device that includes a processor, which displays on a screen a first ultrasound image, among a plurality of ultrasound images in a time series that show a common observation target area, that shows the observation target area in a manner that satisfies predetermined conditions, and outputs first size information that indicates a first size, where the first size is the size of the observation target area shown in the first ultrasound image.

[0009] A second aspect of the technology of the present disclosure is the medical support device according to the first aspect, in which outputting the first size information includes displaying the first size on a screen.

[0010] A third aspect of the technology of the present disclosure is a medical support device according to the first or second aspect, in which the predetermined conditions include a condition that the image is one in which a target area to be observed is detected among a plurality of ultrasound images and the size of the detected target area to be observed is measured.

[0011] A fourth aspect of the technology of the present disclosure is a medical support device according to the first or second aspect, in which the predetermined conditions include a condition that a specific observation target area among a plurality of observation target areas is detected among a plurality of ultrasound images, and the image is one in which the size of the specific observation target area is measured.

[0012] A fifth aspect of the technology of the present disclosure is a medical support device according to any one of the first to fourth aspects, in which a processor outputs a plurality of ultrasound images in which a region to be observed is detected and the size of the region to be observed is measured from among the plurality of ultrasound images.

[0013] A sixth aspect of the technology of the present disclosure is a medical support device according to any one of the first to fifth aspects, in which the predetermined condition includes a condition that the length of the area to be observed is equal to or greater than a reference value.

[0014] A seventh aspect of the technology of the present disclosure is a medical support device according to any one of the first to sixth aspects, in which the predetermined condition includes a condition that the length of the area to be observed is a maximum value or a most frequent value.

[0015] An eighth aspect of the technique of the present disclosure is the medical support device according to the sixth or seventh aspect, in which, when the observation target site is a tube, the length is the length in the radial direction of the tube.

[0016] A ninth aspect of the technology of the present disclosure is a medical support device according to any one of the first to seventh aspects, in which size information indicating the size of the area to be observed is assigned to each ultrasound image, and a processor outputs the size information assigned to the first ultrasound image as first size information.

[0017] A tenth aspect of the technology of the present disclosure is a medical support device according to any one of the first to ninth aspects, in which the first ultrasound image is an ultrasound image that satisfies predetermined conditions among ultrasound images of a time period determined based on a selected ultrasound image selected from a plurality of ultrasound images in accordance with a given first instruction.

[0018] An eleventh aspect of the technology of the present disclosure is a medical support device according to the tenth aspect, in which the selected ultrasound image is a frozen image, and the frozen image is an ultrasound image displayed in a frozen state on the screen in accordance with a first instruction under a situation in which multiple ultrasound images are displayed on the screen as moving images.

[0019] A twelfth aspect of the technology of the present disclosure is a medical support device according to the tenth or eleventh aspect, in which the time period is a time period going back in time relative to the time when the selected ultrasound image was obtained.

[0020] A thirteenth aspect of the technology of the present disclosure is a medical support device according to any one of the tenth to twelfth aspects, in which the length of the time period is determined according to a given second instruction.

[0021] A fourteenth aspect of the technology of the present disclosure is a medical support device according to any one of the first to thirteenth aspects, in which the processor outputs second size information indicating a second size, and the second size is the size of the area to be observed that appears in a second ultrasound image, which is different from the first ultrasound image, among the multiple ultrasound images.

[0022] A fifteenth aspect of the technology of the present disclosure is a medical support device according to the fourteenth aspect, in which size information indicating the size of the area to be observed is assigned to each ultrasound image, and the processor outputs the size information assigned to the second ultrasound image as second size information.

[0023] A sixteenth aspect of the technology of the present disclosure is a medical support device according to the fourteenth or fifteenth aspect, in which outputting the second size information includes displaying the second size on a screen.

[0024] A seventeenth aspect of the technology of the present disclosure is a medical support device according to any one of the fourteenth to sixteenth aspects, in which the processor outputs the first size information and the second size information in a manner that allows them to be distinguished.

[0025] An eighteenth aspect of the technology of the present disclosure is a medical support device according to any one of the first to seventeenth aspects, in which the predetermined conditions include a condition that an observation target area is detected from a plurality of ultrasound images and the size of the observation target area is measured using a measurement method corresponding to the detected observation target area.

[0026] A nineteenth aspect of the technology of the present disclosure is a medical support device according to any one of the first to seventeenth aspects, in which the predetermined conditions include a condition that a specific observation target portion among a plurality of observation target portions is detected in a plurality of ultrasound images, and the size of the observation target portion is measured using a measurement method corresponding to the specific observation target portion.

[0027] A twentieth aspect of the technology of the present disclosure is a medical support device according to any one of the first to nineteenth aspects, in which a processor outputs a plurality of ultrasound images in which an observation target area is detected from the plurality of ultrasound images and the size of the observation target area is measured using a measurement method corresponding to the observation target area.

[0028] A 21st aspect of the technology of the present disclosure is a medical support device according to the 20th aspect, in which the measurement method includes a first measurement method and / or a second measurement method, the first measurement method being a method of measuring the area to be observed in one direction, and the second measurement method being a method of measuring the area to be observed in multiple directions.

[0029] A twenty-second aspect of the technology of the present disclosure is a medical support device according to any one of the first to twenty-first aspects, in which the first size is a size range according to the area to be observed.

[0030] A twenty-third aspect according to the technique of the present disclosure is the medical support device according to the twenty-second aspect, wherein a caliper defining a range is displayed on the screen.

[0031] A 24th aspect of the technology of the present disclosure is a medical support device according to the 23rd aspect, in which the geometric characteristics of the caliper are changed in accordance with a given third instruction, and the range is changed in accordance with the change in the geometric characteristics.

[0032] A 25th aspect of the technology of the present disclosure is a medical support device according to any one of the 22nd to 24th aspects, in which, when a first ultrasound image is displayed on a screen, a processor outputs third size information indicating a third size of a range selected from a plurality of ranges in accordance with a given fourth instruction.

[0033] A 26th aspect of the technology of the present disclosure is a medical support device according to the 25th aspect, in which ranges are assigned priorities, and calipers indicating the ranges are displayed on the screen in a state in which the priorities can be identified.

[0034] A 27th aspect of the technology of the present disclosure is a medical support device according to the 26th aspect, in which the calipers are displayed on the screen in an order corresponding to the priority, and the calipers displayed on the screen are switched in accordance with a given fifth instruction.

[0035] A 28th aspect of the technology of the present disclosure is a medical support device according to any one of the first to 27th aspects, in which the first size information and / or related information related to the first size information is stored in an external device and / or a medical record.

[0036] A twenty-ninth aspect of the technique of the present disclosure is the medical support device according to any one of the first to twenty-eighth aspects, in which the ultrasound image is an ultrasound endoscopic image.

[0037] A thirtieth aspect of the technology of the present disclosure is a medical support device that includes a processor, which detects an area to be observed by performing image recognition processing on an ultrasound image, and measures the detected area to be observed using a measurement method that corresponds to the area to be observed.

[0038] A thirty-first aspect of the technology of the present disclosure is a medical support device according to the thirtieth aspect, in which the measurement method includes a first measurement method and / or a second measurement method, the first measurement method being a method of measuring the area to be observed in one direction, and the second measurement method being a method of measuring the area to be observed in multiple directions.

[0039] A thirty-second aspect of the technology of the present disclosure is an ultrasound endoscope that includes a medical support device according to any one of the first to thirty-first aspects, and an ultrasound probe that, when inserted into the body, emits ultrasound waves within the body and receives reflected ultrasound waves, and generates an ultrasound image based on the reflected waves.

[0040] A thirty-third aspect of the technology of the present disclosure is a medical support method that includes displaying on a screen a first ultrasound image, among a plurality of ultrasound images in a time series, that shows a region to be observed and satisfies predetermined conditions, and outputting first size information indicating a first size, where the first size is the size of the region to be observed shown in the first ultrasound image.

[0041] A 34th aspect of the technology of the present disclosure is a program for causing a computer to execute processing, the processing including displaying on a screen a first ultrasound image, among a plurality of ultrasound images in a time series, that shows a region to be observed and satisfies predetermined conditions, and outputting first size information indicating a first size, wherein the first size is the size of the region to be observed shown in the first ultrasound image.

[0042] 9A is a conceptual diagram showing an example of an aspect in which an endoscopic system is used. FIG. 9B is a conceptual diagram showing an example of the overall configuration of an endoscopic system. FIG. 9C is a block diagram showing an example of the configuration of an ultrasonic endoscope. FIG. 9D is a conceptual diagram showing an example of the processing content of a generation unit. FIG. 9E is a conceptual diagram showing an example of the processing content of a generation unit, a detection unit, and a measurement unit. FIG. 9F is a conceptual diagram showing an example of the processing content of a generation unit and a control unit. FIG. 9G is a conceptual diagram showing an example of the processing content of a generation unit and a measurement unit. FIG. 9H is a flowchart showing an example of the flow of medical support processing. FIG. 9H is a continuation of the flowchart shown in FIG. 9A. FIG. 9H is a conceptual diagram showing an example of an aspect in which a first size and a second size are displayed on a screen in a distinguishable state. FIG. 9I is a conceptual diagram showing an example of an aspect in which a size is re-measured and displayed on a screen as the geometric characteristics of a caliper are changed. FIG. 9I is a conceptual diagram showing modified examples of the processing content of a generation unit, a detection unit, and a measurement unit. FIG. 9I is a conceptual diagram showing an example of an aspect in which a caliper display is switched in accordance with a switching instruction. FIG. 9I is a conceptual diagram showing an example of an aspect in which the size of a range selected in accordance with a selection instruction is displayed on a screen. FIG. 9I is a conceptual diagram showing an example of an aspect in which the length of the major axis and the length of the minor axis of a cross section of an internal organ shown in an ultrasound image are measured and displayed on a screen. FIG. 1 is a conceptual diagram showing an example of an aspect in which the size of a radial range in a transverse cross-sectional view of a tube shown in an ultrasound image is measured. FIG. 1 is a conceptual diagram showing an example of an aspect in which the size of a radial range in a longitudinal cross-sectional view of a tube shown in an ultrasound image is measured. FIG. 2 is a conceptual diagram showing an example of an aspect in which the size of a range from one end to the other end of a line segment that crosses the outline of the cross section of an annular lesion shown in an ultrasound image is measured. FIG. 3 is a conceptual diagram showing an example of an aspect in which the processing results of medical support processing are output to an external device and a printer. FIG. 4 is a conceptual diagram showing an example of an aspect in which a function expansion device is connected to a processing device. FIG. 5 is a conceptual diagram showing an example of an aspect in which the display of a caliper for one observation site is switched in accordance with a switching instruction.

[0043] Hereinafter, exemplary embodiments of a medical support device, an ultrasonic endoscope, a medical support method, and a program according to the techniques of the present disclosure will be described with reference to the accompanying drawings.

[0044] First, the terms used in the following description will be explained.

[0045] CPU is an abbreviation for "Central Processing Unit". GPU is an abbreviation for "Graphics Processing Unit". TPU is an abbreviation for "Tensor Processing Unit". RAM is an abbreviation for "Random Access Memory". NVM is an abbreviation for "Non-volatile memory". EEPROM is an abbreviation for "Electrically Erasable Programmable Read-Only Memory". ASIC is an abbreviation for "Application Specific Integrated Circuit". PLD is an abbreviation for "Programmable Logic Device". FPGA is an abbreviation for "Field-Programmable Gate Array". SoC is an abbreviation for "System-on-a-chip". SSD is an abbreviation for "Solid State Drive". USB is an abbreviation for "Universal Serial Bus". HDD is an abbreviation for "Hard Disk Drive". EL is an abbreviation for "Electro-Luminescence". CMOS is an abbreviation for "Complementary Metal Oxide Semiconductor". CCD is an abbreviation for "Charge Coupled Device". WAN is an abbreviation for "Wide Area Network". AI is an abbreviation for "Artificial Intelligence". BLI is an abbreviation for "Blue Light Imaging". LCI is an abbreviation for "Linked Color Imaging". NN is an abbreviation for "Neural Network".

[0046] As an example, as shown in FIG. 1 , an endoscopic system 10 includes an ultrasonic endoscope 12 and a display device 14. The ultrasonic endoscope 12 is a convex type ultrasonic endoscope and includes an ultrasonic endoscope main body 16 and a processing device 18. In this embodiment, a convex type ultrasonic endoscope is given as an example of the ultrasonic endoscope 12, but this is merely an example, and the technology of the present disclosure also applies to a radial type ultrasonic endoscope. The ultrasonic endoscope 12 is an example of an "ultrasonic endoscope" according to the technology of the present disclosure. The processing device 18 is an example of a "medical support device" according to the technology of the present disclosure.

[0047] The ultrasonic endoscope main body 16 is used by, for example, a doctor 20. The processing device 18 is connected to the ultrasonic endoscope main body 16 and exchanges various signals with the ultrasonic endoscope main body 16. That is, the processing device 18 controls the operation of the ultrasonic endoscope main body 16 by outputting signals to the ultrasonic endoscope main body 16, and performs various signal processing on signals input from the ultrasonic endoscope main body 16.

[0048] The ultrasonic endoscope 12 is a device that allows a doctor 20 to observe an observation target area 27 inside the body of a subject 22, and performs diagnosis and / or treatment of the observation target area 27, and generates and outputs an ultrasonic image 24 that shows an area 28 that includes the observation target area 27.

[0049] 1 , an internal organ 27A is shown as an example of an observation target region 27 shown in the ultrasound image 24. Examples of the internal organ 27A include the gallbladder and the pancreas. Here, the internal organ 27A is shown as an example to facilitate understanding of the technology of the present disclosure, but this is merely an example, and the observation target region 27 may be a mass lesion (e.g., a single cyst, a tumor, or a mass) or a duct (e.g., a blood vessel, a lymphatic vessel, a bile duct, a pancreatic duct, or a medical artificial duct).

[0050] The observation target area 27 is an example of an "observation target area" according to the technology of the present disclosure. The internal organ 27A is an example of an "internal organ" and a "specific observation target area" according to the technology of the present disclosure. The mass lesion as the observation target area 27 is an example of a "mass lesion" according to the technology of the present disclosure. The tube as the observation target area 27 is an example of a "tube" according to the technology of the present disclosure.

[0051] For example, when observing a region 28 inside the body of the subject 22, the doctor 20 inserts the ultrasound endoscope body 16 into the body of the subject 22 through the mouth or nose (the mouth in the example shown in FIG. 1 ) and emits ultrasound waves at a position such as the stomach or duodenum. The ultrasound endoscope body 16 emits ultrasound waves toward the region 28 inside the body of the subject 22 and detects the reflected waves obtained when the emitted ultrasound waves are reflected from the region 28.

[0052] In the example shown in Figure 1, an upper gastrointestinal endoscopy is being performed, but the technology of the present disclosure is not limited to this and can also be applied to lower gastrointestinal endoscopy or bronchial endoscopy, etc.

[0053] The processing device 18 generates an ultrasonic image 24 based on the reflected waves detected by the ultrasonic endoscope body 16 and outputs it to the display device 14 or the like.

[0054] The display device 14 displays various information including images under the control of the processing device 18. Examples of the display device 14 include a liquid crystal display and an EL display. The ultrasound image 24 generated by the processing device 18 is generated as a moving image at a predetermined frame rate (e.g., several tens of frames per second) and displayed on the screen 26 of the display device 14. Examples of the moving image include a live view image and a post-view image. The screen 26 is an example of a "screen" according to the technology of the present disclosure.

[0055] 1 shows an example in which the ultrasound image 24 is displayed on the screen 26 of the display device 14, but this is merely one example, and the ultrasound image 24 may be displayed on the screen of a display device other than the display device 14 (for example, the display of a tablet terminal). Furthermore, the ultrasound image 24 may be stored in a computer-readable non-transitory storage medium (for example, a flash memory, a HDD, and / or a magnetic tape).

[0056] As shown in FIG. 2 as an example, the ultrasound endoscope main body 16 includes a control section 29 and an insertion section 30. The insertion section 30 is tubular. The insertion section 30 has a distal end portion 32, a bending section 34, and a flexible section 36. The distal end portion 32, the bending section 34, and the flexible section 36 are arranged in this order from the distal end to the proximal end of the insertion section 30. The flexible section 36 is formed of a long, flexible material and connects the control section 29 and the bending section 34. The bending section 34 partially bends and rotates around the axis of the insertion section 30 when the control section 29 is operated. As a result, the insertion section 30 is advanced deeper into the hollow organ while bending and rotating around the axis of the insertion section 30 in accordance with the shape of the hollow organ (e.g., the shape of the duodenal duct).

[0057] The distal end portion 32 is provided with an ultrasonic probe 38 and a treatment opening 40. The ultrasonic probe 38 is provided on the distal end side of the distal end portion 32. The ultrasonic probe 38 is a convex ultrasonic probe that emits ultrasonic waves and receives reflected waves obtained when the emitted ultrasonic waves are reflected by the region 28 (see FIGS. 1 and 3).

[0058] The treatment opening 40 is formed closer to the base end of the distal end portion 32 than the ultrasonic probe 38. The treatment opening 40 is an opening for allowing a treatment tool 42 to protrude from the distal end portion 32. A treatment tool insertion port 44 is formed in the operation section 29, and the treatment tool 42 is inserted into the insertion section 30 from the treatment tool insertion port 44. The treatment tool 42 passes through the insertion section 30 and protrudes from the treatment opening 40 to the outside of the ultrasonic endoscope body 16. The treatment opening 40 also functions as a suction port for sucking blood, internal waste, etc.

[0059] 2, a puncture needle is shown as the treatment tool 42. However, this is merely an example, and the treatment tool 42 may also be grasping forceps, a cannula, a wire, and / or a sheath, etc.

[0060] 2, an illumination device 46 and a camera 48 are provided at the distal end portion 32. The illumination device 46 emits light. Examples of the type of light emitted from the illumination device 46 include visible light (e.g., white light), invisible light (e.g., near-infrared light), and / or special light. Examples of the special light include light for BLI and / or light for LCI.

[0061] The camera 48 optically captures images of the inside of a hollow organ. An example of the camera 48 is a CMOS camera. The CMOS camera is merely an example, and other types of cameras such as a CCD camera may also be used. The image captured by the camera 48 may be displayed on the display device 14, on a display device other than the display device 14 (e.g., the display of a tablet terminal), or stored in a storage medium (e.g., a flash memory, a HDD, and / or a magnetic tape).

[0062] The ultrasonic endoscope 12 includes a processing device 18 and a universal cord 50. The universal cord 50 has a base end 50A and a tip end 50B. The base end 50A is connected to the operation unit 29. The tip end 50B is connected to the processing device 18. In other words, the ultrasonic endoscope body 16 and the processing device 18 are connected via the universal cord 50.

[0063] The endoscope system 10 includes a reception device 52. The reception device 52 is connected to the processing device 18. The reception device 52 receives instructions from a user. Examples of the reception device 52 include an operation panel having a plurality of hard keys and / or a touch panel, a keyboard, a mouse, a trackball, a foot switch, a smart device, a microphone, and / or a remote control device.

[0064] The processing device 18 performs various signal processing operations and transmits and receives various signals to and from the ultrasonic endoscope main body 16, etc., in accordance with instructions received by the receiving device 52. For example, the processing device 18 causes the ultrasonic probe 38 to emit ultrasonic waves in accordance with instructions received by the receiving device 52, and generates and outputs an ultrasonic image 24 (see FIG. 1 ) based on the reflected waves received by the ultrasonic probe 38.

[0065] The display device 14 is connected to the processing device 18. The processing device 18 controls the display device 14 in accordance with instructions received by the reception device 52. As a result, for example, an ultrasound image 24 generated by the processing device 18 is displayed on the screen 26 of the display device 14 (see FIG. 1 ).

[0066] 3, the processing device 18 includes a computer 54, an input / output interface 56, a transmitting / receiving circuit 58, and a communication module 60. The computer 54 is an example of a "computer" according to the technology of the present disclosure.

[0067] The computer 54 includes a processor 62, a RAM 64, and an NVM 66. The input / output interface 56, the processor 62, the RAM 64, and the NVM 66 are connected to a bus 68.

[0068] The processor 62 controls the entire processing device 18. For example, the processor 62 has a CPU and a GPU, and the GPU operates under the control of the CPU and is mainly responsible for executing image processing. The processor 62 may be one or more CPUs that integrate a GPU function, or one or more CPUs that do not integrate a GPU function. The processor 62 may also include a multi-core CPU or a TPU. The processor 62 is an example of a "processor" according to the technology of the present disclosure.

[0069] The RAM 64 is a memory that temporarily stores information and is used as a work memory by the processor 62. The NVM 66 is a nonvolatile storage device that stores various programs, various parameters, and the like. Examples of the NVM 66 include flash memory (e.g., EEPROM) and / or an SSD. Note that flash memory and SSD are merely examples, and the NVM 66 may be other nonvolatile storage devices such as an HDD, or may be a combination of two or more types of nonvolatile storage devices.

[0070] The input / output interface 56 is connected to the reception device 52, and the processor 62 acquires instructions received by the reception device 52 via the input / output interface 56 and executes processing according to the acquired instructions.

[0071] A transmission / reception circuit 58 is connected to the input / output interface 56. The transmission / reception circuit 58 generates a pulsed ultrasonic emission signal 70 in accordance with instructions from the processor 62 and outputs the signal to the ultrasonic probe 38. The ultrasonic probe 38 converts the ultrasonic emission signal 70 input from the transmission / reception circuit 58 into ultrasonic waves and emits the ultrasonic waves toward the region 28 of the subject 22. The ultrasonic probe 38 receives reflected waves obtained when the ultrasonic waves emitted from the ultrasonic probe 38 are reflected by the region 28, converts the reflected waves into reflected wave signals 74, which are electrical signals, and outputs the reflected waves to the transmission / reception circuit 58. The transmission / reception circuit 58 digitizes the reflected wave signals 74 input from the ultrasonic probe 38 and outputs the digitized reflected wave signals 74 to the processor 62 via the input / output interface 56. The processor 62 generates an ultrasonic image 24 (see FIG. 1 ) showing the appearance of the region 28 (i.e., the appearance of a cross section of the region 28) based on the reflected wave signals 74 input from the transmission / reception circuit 58 via the input / output interface 56.

[0072] Although not shown in Fig. 3 , the lighting device 46 (see Fig. 2 ) is also connected to the input / output interface 56. The processor 62 controls the lighting device 46 via the input / output interface 56 to change the type of light emitted from the lighting device 46 and adjust the amount of light. Although not shown in Fig. 3 , the camera 48 (see Fig. 2 ) is also connected to the input / output interface 56. The processor 62 controls the camera 48 via the input / output interface 56 and acquires, via the input / output interface 56, images of the inside of the body of the subject 22 captured by the camera 48.

[0073] A communication module 60 is connected to the input / output interface 56. The communication module 60 is an interface including a communication processor, an antenna, etc. The communication module 60 is connected to a network (not shown) such as a LAN or WAN, and controls communication between the processor 62 and an external device. Examples of the external device include a server (e.g., an electronic medical record management server and / or an image management server), a tablet terminal, and / or a personal computer.

[0074] The display device 14 is connected to the input / output interface 56, and the processor 62 controls the display device 14 via the input / output interface 56 to cause the display device 14 to display various information.

[0075] The input / output interface 56 is connected to the reception device 52, and the processor 62 acquires instructions received by the reception device 52 via the input / output interface 56 and executes processing according to the acquired instructions.

[0076] Incidentally, it is important for the doctor 20 observing the ultrasound image 24 displayed on the screen 26 to understand the size of the observation target area 27, for example, in order to perform some kind of medical treatment on the observation target area 27 or to evaluate the progress of the observation target area 27. The size of the observation target area 27 shown in the ultrasound image 24 varies depending on how the observation target area 27 is shown in the ultrasound image 24.

[0077] Therefore, for example, when the size of the observation target area 27 is measured in some way and displayed on the screen 26 while the observation target area 27 is shown in the ultrasound image 24 at its smallest size, it is highly likely that the size displayed on the screen 26 is not the size that the doctor 20 actually wants to know. Furthermore, even if an ultrasound image 24 is selected from a plurality of ultrasound images 24 in time series displayed as moving images on the screen 26 in accordance with instructions from the doctor 20, and the size of the observation target area 27 shown in the selected ultrasound image 24 is measured and displayed on the screen 26, the size of the observation target area 27 that the doctor 20 wants to see is not necessarily displayed on the screen 26.

[0078] For example, even if the doctor 20 intends to select the ultrasound image 24 in which the observation target area 27 is shown largest, because the moving images are displayed at high speed, an ultrasound image 24 that appears earlier or later in time than the ultrasound image 24 in which the observation target area 27 is shown largest may be selected, and as a result, the size of the observation target area 27 that the doctor 20 does not want to be displayed on the screen 26 may end up being the size.

[0079] In view of these circumstances, in this embodiment, as an example, medical support processing is performed by the processor 62 of the processing device 18, as shown in Fig. 3. The medical support processing is processing that, for example, detects an observation target region 27 from an area 28 using an AI method and supports medical care using the ultrasonic endoscope 12 (for example, medical care performed by a doctor 20 (see Fig. 1)) based on the detection results.

[0080] The NVM 66 stores a medical support program 76 and a region detection model 78. The medical support program 76 is an example of a "program" according to the technology of the present disclosure. The region detection model 78 is used by the processor 62 in processing to detect the observation region 27 from the ultrasound image 24.

[0081] The processor 62 performs medical support processing by reading a medical support program 76 from the NVM 66 and executing the read medical support program 76 on the RAM 64. Detection of the observation target region 27 using the AI ​​method is achieved by using a region detection model 78. The medical support processing is achieved by the processor 62 operating as a generation unit 62A, a detection unit 62B, a measurement unit 62C, and a control unit 62D in accordance with the medical support program 76 executed on the RAM 64.

[0082] 4 , the generator 62A acquires a reflected wave signal 74 from the transmission / reception circuit 58 and generates a plurality of time-series ultrasound images 24 based on the acquired reflected wave signal 74. Note that, for convenience of explanation, the present embodiment will be described on the assumption that a common observation target region 27 is captured in the plurality of time-series ultrasound images 24. In addition, in the present embodiment, the plurality of time-series ultrasound images 24 generated by the generator 62A is an example of "a plurality of time-series ultrasound images" according to the technology of the present disclosure. The ultrasound images 24 are also an example of "images generated by an ultrasound system" and "ultrasound endoscopic images" according to the technology of the present disclosure.

[0083] The control unit 62D displays the plurality of time-series ultrasound images 24 generated by the generation unit 62A as a moving image on the screen 26 at a specific frame rate (for example, several tens of frames per second).

[0084] 5 as an example, the detector 62B acquires ultrasound images 24 frame by frame in time series from the plurality of time-series ultrasound images 24 generated by the generator 62A, and executes a part detection process 93 on the acquired ultrasound images 24. The part detection process 93 is a process for detecting a target observation part 27 appearing in the ultrasound image 24 in accordance with the part detection model 78. In the present embodiment, the part detection process 93 is an example of an "image recognition process" according to the technology of the present disclosure.

[0085] The part detection model 78 is a trained model for object detection using an AI system, and is optimized by performing machine learning on the neural network using first training data. The first training data is a plurality of data (i.e., data for a plurality of frames) in which first example data and first answer data are associated with each other.

[0086] The first example data is an image corresponding to the ultrasound image 24. The first correct answer data is correct answer data (i.e., annotation) for the first example data. Here, an annotation capable of identifying a region corresponding to the observation target region 27 in an image corresponding to the ultrasound image 24 (for example, information indicating the name of the observation target region 27 and a plurality of coordinates capable of identifying the position of the region corresponding to the observation target region 27) is used as an example of the first correct answer data.

[0087] Detector 62B inputs ultrasound image 24 acquired from generator 62A to part detection model 78. As a result, part detection model 78 detects observation target part 27 appearing in input ultrasound image 24, and outputs detection result information 94 indicating the detection result. Detector 62B acquires detection result information 94 output from part detection model 78.

[0088] The detection result information 94 includes region identification information 94A and position identification information 94B. The region identification information 94 is information indicating the name of the observation target region 27 shown in the ultrasound image 24. In the example shown in Fig. 5, the name of the observation target region 27 refers to, for example, the name of an internal organ 27A shown in the ultrasound image 24 (e.g., the pancreas). The position identification information 94B is position information (e.g., multiple coordinates) that can identify the location in the ultrasound image 24 where the observation target region 27 is shown.

[0089] In this embodiment, AI processing using the part detection model 78 is exemplified as the part detection processing 93, but the technology disclosed herein is not limited to this, and it is also possible to realize the part detection processing 93 by using AI processing and non-AI processing (for example, processing using template matching, etc.) in combination, or by using non-AI processing instead of AI processing.

[0090] The measurement unit 62C refers to the position identification information 94B and identifies the observation target region 27 from the ultrasound image 24 that is the processing target of the region detection process 93. The measurement unit 62C refers to the region identification information 94A and identifies a range 95 corresponding to the observation target region 27 identified from the ultrasound image 24. The range 95 is determined for each observation target region 27. For example, the range 95 applied to the internal organ 27A is the range in which the length of the cross section of the internal organ 27A shown in the ultrasound image 24 is the longest.

[0091] Note that, here, the range in which the length of the cross section of the internal organ 27A is greatest is given as an example of the range 95 applied to the internal organ 27A, but this is merely an example, and even if the processing target area 27 is a massive lesion, the range in which the length of the cross section of the massive lesion shown in the ultrasound image 24 is greatest is applied as the range 95. Furthermore, as will be described in detail later, if the processing target area 27 is a duct (e.g., a bile duct or a pancreatic duct), the radial range of the duct (e.g., a diameter) is applied as the range 95.

[0092] The measurement unit 62C generates a caliper 96 that defines the range 95. The caliper 96 is an image (for example, a linear mark) that makes it possible to visually recognize the start and end of the range 95. The range 95 is represented from one end 96A of the caliper 96 to the other end 96B.

[0093] The measurement unit 62C generates caliper drawing information 100, which is information capable of drawing the caliper 96 within the ultrasound image 24, and assigns the generated caliper drawing information 100 to the ultrasound image 24 showing the observation target region 27 to which the range 95 is applied. In other words, the measurement unit 62C assigns the caliper drawing information 100 to each of the multiple ultrasound images 24 that are the processing targets of the region detection process 93.

[0094] An example of the caliper drawing information 100 is a plurality of coordinates capable of identifying the position of the caliper 96 within the ultrasound image 24 (for example, coordinates capable of identifying the position of one end 96A within the ultrasound image 24 and coordinates capable of identifying the position of the other end 96B within the ultrasound image 24). The caliper drawing information 100 is assigned to the ultrasound image 24 by, for example, storing the caliper drawing information 100 in memory (for example, the RAM 64 and / or the NVM 66, etc.) in a state in which an identifier capable of identifying the ultrasound image 24 is associated with the caliper drawing information 100.

[0095] The measurement unit 62C measures a size 98 (here, as an example, a length) of the range 95. Then, the measurement unit 62C assigns size information 102 indicating the measured size 98 to the ultrasound image 24 that is the processing target of the part detection process 93 (i.e., the ultrasound image 24 that shows the observation target part 27 to which the range 95 is applied). That is, the measurement unit 62C assigns size information 102 to each of the multiple ultrasound images 24 that are the processing target of the part detection process 93. Assigning the size information 102 to the ultrasound image 24 is realized, for example, by storing the size information 102 in memory in a state in which an identifier that can identify the ultrasound image 24 is associated with the size information 102.

[0096] 6 , the control unit 62D freezes (i.e., temporarily stops) the ultrasound images 24 on the screen 26 in accordance with a freeze instruction 103 given to the endoscopic system 10 while a plurality of ultrasound images 24 in time series are displayed as moving images on the screen 26. The freeze instruction 103 is an instruction to freeze and display the ultrasound images 24. In the example shown in FIG. 6 , when the freeze instruction 103 is received by the reception device 52 while a plurality of ultrasound images 24 in time series are displayed as moving images on the screen 26, the control unit 62D freezes the ultrasound images 24 on the screen 26.

[0097] The control unit 62D sets the time period 104 in accordance with a time period instruction 106 given to the endoscopic system 10 (in the example shown in FIG. 6 , the time period instruction 106 is received by the reception device 52) using the freeze image 24A as a reference. Here, the freeze image 24A refers to the ultrasound image 24 displayed in a frozen state on the screen 26. The time period instruction 106 refers to an instruction regarding the length of the time period 104. In the example shown in FIG. 6 , the control unit 62D sets the time period 104 to a time period going back in time in accordance with the time period instruction 106, using the time point at which the freeze image 24A was obtained as a reference, among the multiple time-series ultrasound images generated by the generation unit 62A. Then, the control unit 62D selects the multiple time-series ultrasound images 24 included in the time period 104 as a group of images within the time period 108.

[0098] In this embodiment, the freeze instruction 103 is an example of a "first instruction" according to the technology of the present disclosure. The time period instruction 106 is an example of a "second instruction" according to the technology of the present disclosure. The freeze image 24A is an example of a "selected ultrasound image" and a "freeze image" according to the technology of the present disclosure. The time period 104 is an example of a "time period" according to the technology of the present disclosure.

[0099] 7 , the measurement unit 62C measures a first size 98A, which is the size 98 of the observation region 27 shown in a first ultrasound image 24B in the in-time period image group 108. That is, the measurement unit 62C acquires a plurality of pieces of size information 102 (e.g., all of the size information 102) assigned to the in-time period image group 108, and selects, from the acquired plurality of pieces of size information 102, first size information 110 indicating the first size 98A.

[0100] An example of the first size 98A is the size 98 of the range 95 corresponding to the observation region 27 included in the first ultrasound image 24B. The first ultrasound image 24B refers to an ultrasound image 24 in the within-time-zone image group 108 that satisfies predetermined conditions. Here, the predetermined conditions include a condition that the observation region 27 (here, as an example, an internal organ 27A) in the within-time-zone image group 108 is detected by the detection unit 62B, and the size 98 of the detected observation region 27 is an image measured by the measurement unit 62C. The predetermined conditions also include, for example, a condition that the size 98 of the range 95 (i.e., the length of the range 95) is a maximum value.

[0101] Here, the condition that the size 98 of the range 95 is the maximum value has been given as an example of the default condition, but this is merely an example, and the default condition may be, for example, a condition that the size 98 of the range 95 is the mode, or a condition that the size 98 of the range 95 is equal to or greater than a reference value (e.g., a statistical value such as the average or median of the size 98 of the range 95). Alternatively, the default condition may be a condition that the size 98 of the range 95 is equal to or greater than a reference value and is the maximum value or the mode. The default condition may also include a condition that the image quality (e.g., brightness and / or contrast) is equal to or greater than a default image quality.

[0102] In this embodiment, the first size 98A is an example of the "first size" according to the technology of the present disclosure. The first size information 110 is an example of the "first size information" according to the technology of the present disclosure. The first ultrasound image 24B is an example of the "first ultrasound image" according to the technology of the present disclosure.

[0103] 8 , the control unit 62D acquires a first ultrasonic image 24B from the generation unit 62A and displays the acquired first ultrasonic image 24B on the screen 26. The control unit 62D also acquires caliper drawing information 100 assigned to the first ultrasonic image 24B. The control unit 62D displays the caliper 96 within the first ultrasonic image 24B by drawing a caliper 96 defining a range 95 within the first ultrasonic image 24B in accordance with the acquired caliper drawing information 100. The control unit 62D also acquires first size information 110 from the measurement unit 62C and outputs the acquired first size information 110 to the screen 26. That is, the control unit 62D displays the first size 98A indicated by the first size information 110 acquired from the measurement unit 62C on the screen 26.

[0104] Next, the operation of the portion of the endoscope system 10 related to the technology of the present disclosure will be described with reference to FIGS. 9A and 9B.

[0105] 9A and 9B are flowcharts illustrating an example of the flow of medical support processing performed by the processor 62. The flow of medical support processing illustrated in Fig. 9A and 9B is an example of a "medical support method" according to the technology of the present disclosure.

[0106] In the medical support method shown in Fig. 9A, first, in step ST10, the generation unit 62A determines whether or not an image display timing has arrived. The image display timing is, for example, a timing separated by a time interval defined by the reciprocal of the frame rate. If the image display timing has not arrived in step ST10, the determination is negative, and the medical support processing proceeds to step ST52 shown in Fig. 9B. If the image display timing has arrived in step ST10, the determination is positive, and the medical support processing proceeds to step ST12.

[0107] In step ST12, the generator 62A generates an ultrasound image 24 based on the reflected wave signal 74 input from the transmission / reception circuit 58 (see FIGS. 4 and 5). After the processing of step ST12 is executed, the medical support processing proceeds to step ST14.

[0108] In step ST14, the detection unit 62B executes part detection processing 93 using the part detection model 78 on the ultrasound image 24 generated in step ST12 (see FIG. 6 ). As a result of the part detection processing 93 being executed by the detection unit 62B, the observation target part 27 shown in the ultrasound image 24 is detected, and detection result information 94 is output from the part detection model 78. After the processing of step ST14 is executed, the medical support processing proceeds to step ST16.

[0109] In step ST16, the detection unit 62B acquires the detection result information 94 output from the body part detection model 78 (see FIG. 5). After the process of step ST16 is executed, the medical support process proceeds to step ST18.

[0110] In step ST18, the measurement unit 62C identifies the observation target region 27 appearing in the ultrasound image 24 that is the processing target of the region detection process 93, based on the detection result information 94 acquired in step ST16. Then, the measurement unit 62C selects a range corresponding to the identified observation target region 27.

[0111] After the process of step ST18 is executed, the medical support process proceeds to step ST20.

[0112] In step ST20, the measurement unit 62C generates a caliper 96 corresponding to the range 95 determined in step ST18 (see FIG. 5). After the process of step ST20 is executed, the medical support process proceeds to step ST22.

[0113] In step ST22, the measurement unit 62C measures the size 98 of the range 95 determined in step ST18 (see FIG. 5). After the process of step ST22 is executed, the medical support process proceeds to step ST24.

[0114] In step ST24, the measurement unit 62C assigns caliper drawing information 100 relating to the caliper 96 generated in step ST20 to the ultrasound image 24 showing the observation region 27 to which the range 95 whose size 98 was measured in step ST22 is applied (see FIG. 5). After the processing of step ST24 is executed, the medical support processing proceeds to step ST26.

[0115] In step ST26, the measurement unit 62C assigns size information 102 indicating the size 98 measured in step ST22 to the ultrasound image 24 showing the observation region 27 to which the range 95 for which the size 98 was measured in step ST22 applies (see FIG. 5). After the processing of step ST26 is executed, the medical support processing proceeds to step ST28.

[0116] In step ST28, the control unit 62D displays the ultrasound image 24 generated in step ST12 on the screen 26 (see FIG. 4). After the processing of step ST28 is executed, the medical support processing proceeds to step ST30.

[0117] In step ST30, the control unit 62D determines whether or not the freeze instruction 103 (see FIG. 6) has been accepted by the acceptance device 52. If the freeze instruction 103 has not been accepted by the acceptance device 52 in step ST30, the determination is negative, and the medical support processing proceeds to step ST10. If the freeze instruction 103 has been accepted by the acceptance device 52 in step ST30, the determination is positive, and the medical support processing proceeds to step ST32.

[0118] In step ST32, the control unit 62D freezes the ultrasound image 24 on the screen 26. As a result, a frozen image 24A is displayed on the screen 26 (see FIG. 6). After the processing of step ST32 is executed, the medical support processing proceeds to step ST34 shown in FIG. 9B.

[0119] In step ST34, the control unit 62D determines whether or not the time period instruction 106 (see FIG. 6) has been accepted by the acceptance device 52. If the time period instruction 106 has not been accepted by the acceptance device 52 in step ST34, the determination is negative, and the determination of step ST34 is made again. If the time period instruction 106 has been accepted by the acceptance device 52 in step ST34, the determination is positive, and the medical support processing proceeds to step ST36.

[0120] In step ST36, the control unit 62D sets a time period going back in time in accordance with the time period instruction 106 based on the time point at which the freeze image 24A was obtained, among the plurality of time-series ultrasound images generated by repeatedly executing the processing of step ST12, as time period 104. Then, the control unit 62D selects the plurality of time-series ultrasound images 24 included in time period 104 as a group of images within time period 108 (see FIG. 6). After the processing of step ST36 is executed, the medical support processing proceeds to step ST38.

[0121] In step ST38, the measurement unit 62C acquires the plurality of size information 102 assigned to the in-time period image group 108 selected in step ST36 (see FIG. 7). After the processing of step ST38 is executed, the medical support processing proceeds to step ST40.

[0122] In step ST40, the measurement unit 62C selects the size information 102 indicating the first size 98A from the plurality of size information 102 acquired in step ST38 as the first size information 110 (see FIG. 7). After the processing of step ST40 is executed, the medical support processing proceeds to step ST42.

[0123] In step ST42, the control unit 62D acquires an ultrasound image 24 that shows the observation target region 27 in a manner that satisfies the predetermined conditions, i.e., a first ultrasound image 24B, from the group of images within the time period selected in step ST36 (see FIG. 8 ). After the processing of step ST42 is executed, the medical support processing proceeds to step ST44.

[0124] In step ST44, the control unit 62D acquires the caliper drawing information 100 assigned to the first ultrasonic image 24B (see FIG. 8). After the processing of step ST44 is executed, the medical support processing proceeds to step ST46.

[0125] In step ST46, the control unit 62D displays the first ultrasound image 24B acquired in step ST42 on the screen 26 (see FIG. 8). After the processing of step ST46 is executed, the medical support processing proceeds to step ST48.

[0126] In step ST48, the control unit 62D displays the calipers 96 within the first ultrasound image 24 on the screen 26 by drawing the calipers 96 defining the range 95 within the first ultrasound image 24 based on the caliper drawing information 100 acquired in step ST44 (see FIG. 8 ). After the processing of step ST48 is executed, the medical support processing proceeds to step ST50.

[0127] In step ST50, control unit 62D displays first size 98A indicated by first size information 110 selected in step ST40 on screen 26 (see FIG. 8). After the processing of step ST50 is executed, the medical support processing proceeds to step ST52.

[0128] In step ST52, the control unit 62D determines whether a condition for terminating the medical support process is satisfied. One example of the condition for terminating the medical support process is that an instruction to terminate the medical support process has been given to the endoscope system 10 (for example, that an instruction to terminate the medical support process has been accepted by the acceptance device 52).

[0129] In step ST52, if the condition for terminating the medical support process is not satisfied, the determination is negative, and the medical support process proceeds to step ST10 shown in Fig. 9A. In step ST52, if the condition for terminating the medical support process is satisfied, the determination is positive, and the medical support process ends.

[0130] As described above, in the endoscopic system 10, of the multiple ultrasound images 24 in time series that show a common observation region 27, a first ultrasound image 24B that shows the observation region 27 in a manner that satisfies the predetermined conditions is displayed on the screen 26. Then, first size information 110 indicating a first size 98A is output. The first size 98A is the size of the observation region 27 shown in the first ultrasound image 24B. Therefore, the doctor 20 observing the ultrasound image 24 that shows the observation region 27 in a manner that satisfies the predetermined conditions (i.e., the first ultrasound image 24B) can be made aware of the size of the observation region 27.

[0131] Furthermore, in the endoscope system 10, the first size 98A is displayed in a state corresponding to the first ultrasound image 24B on the screen 26 on which the first ultrasound image 24B is displayed. Therefore, the doctor 20 observing the first ultrasound image 24B can visually grasp the size of the observation target region 27.

[0132] Furthermore, in the endoscope system 10, the size 98 of the range 95 of the observation region 27 detected by executing the region detection process 93 is measured as a first size 98A, and the first size 98A is displayed on the screen 26. Therefore, the doctor 20 can easily grasp the size 98 of the range 95 of the observation region 27 that the doctor 20 intends to observe as the first size 98A.

[0133] Furthermore, in the endoscope system 10, size information 102 is assigned to each ultrasound image 24 included in the intra-time period image group 108, and the size information 102 assigned to the first ultrasound image 24B (i.e., the size information 102 assigned to the first ultrasound image 24B in the background) is output as first size information 110. Therefore, the doctor 20 observing the first ultrasound image 24B can quickly grasp the first size 98A.

[0134] Furthermore, in the endoscope system 10, of the multiple ultrasound images 24 in time series that show a common observation target region 27, a first ultrasound image 24B that shows the observation target region 27 in a manner that satisfies a predetermined condition is displayed on the screen 26. Here, the predetermined condition is that the length is the maximum value. Therefore, the doctor 20 can be made to understand the size 98 that the doctor 20 wants to know. The predetermined condition may be that the length is equal to or greater than a reference value, or that the length is the most frequent value. In this case, the doctor 20 can be made to understand the size 98 that the doctor 20 wants to know.

[0135] Furthermore, in the endoscope system 10, of the multiple ultrasound images 24 (i.e., the group of images within a time period 108) included in a time period 104 determined based on a frozen image 24A selected from the multiple ultrasound images 24 in accordance with a freeze instruction 103 received by the reception device 52, an ultrasound image 24 that shows the region to be observed 27 in a manner that satisfies predetermined conditions is displayed on the screen 26 as a first ultrasound image 24B. This allows the doctor 20, who is observing the multiple ultrasound images 24 as moving images, to grasp the size 98 of the region to be observed 27 shown in the ultrasound image 24 included in the time period 104 intended by the doctor 20.

[0136] Furthermore, in the endoscope system 10, the length of the time period 104 is determined in accordance with the time period instruction 106 received by the reception device 52. Therefore, the doctor 20 can grasp the size 98 of the observation target region 27 shown in the multiple ultrasound images 24 included in the time period 104 of the length intended by the doctor 20.

[0137] Furthermore, in the endoscope system 10, the size 98 of the range 95 corresponding to the observation region 27 is measured as a first size 98A and displayed on the screen 26. Therefore, the doctor 20 observing the first ultrasound image 24B can understand the size 98 of the range 95 corresponding to the observation region 27 as the first size 98A.

[0138] Furthermore, in the endoscope system 10, the size 98 of the range 95 corresponding to the observation region 27 detected by executing the region detection process 93 is measured as the first size 98A. Therefore, the size 98 of the range 95 corresponding to the observation region 27 intended by the doctor 20 can be measured as the first size 98A.

[0139] Furthermore, in the endoscope system 10, when the observation target area 27 is an internal organ 27A, the cross section of the internal organ 27A is applied as the range 95. Therefore, the physician 20 observing the first ultrasound image 24B in which the internal organ 27A appears can grasp the size of the cross section of the internal organ 27A. Note that when the observation target area 27 is a massive lesion, the cross section of the massive lesion is also applied as the range 95, allowing the physician 20 observing the first ultrasound image 24B in which the massive lesion appears to grasp the size of the cross section of the massive lesion.

[0140] Furthermore, in the endoscope system 10, a caliper 96 is displayed within the first ultrasound image 24B on the screen 26. The caliper 96 defines a range 95. Therefore, when the doctor 20 observing the first ultrasound image 24B is to understand the size 98 of the observation target region 27, the doctor 20 can visually understand which range 95 of the observation target region 27 the size 98 belongs to.

[0141] In the above embodiment, an example has been described in which the control unit 62D outputs the first size information 110 to the display device 14, but the technology of the present disclosure is not limited to this. For example, as shown in Fig. 10 , second size information 115, which is size information 102 different from the first size information 110, may also be output to the display device 14 in a manner that allows it to be distinguished from the first size information 110.

[0142] The second size information 115 is size information 102 assigned to an ultrasound image 24 different from the first ultrasound image 24B. The second size information 115 is information indicating a second size 98B. The second size 98B is the size 98 of the range 95 of the observation region 27 shown in the ultrasound image 24 different from the first ultrasound image 24B. In the example shown in FIG. 10 , under the control of the control unit 62D, a list of multiple ultrasound images 24 (e.g., the image group within a time period 108 (see FIG. 6 )) is displayed on the screen 26, and the first size 98A and the second size 98B are displayed in a distinguishable manner within the corresponding ultrasound image 24.

[0143] 10 , the second size 98B is displayed on the screen 26 in a state corresponding to a range 95 of the ultrasound image 24 that is different from the first ultrasound image 24B, and the first size 98A is displayed in a state corresponding to the range 95 within the first ultrasound image 24B and in a display manner that is more noticeable than the second size 98B. In the example shown in FIG. 10 , the first size 98A is drawn with a thicker line than the second size 98B, but this is merely an example, and the first size 98A may be made more noticeable than the second size 98B by, for example, changing the brightness or adding a border.

[0144] In this way, the size 98 (i.e., the second size 98B) indicated by the size information 102 (i.e., the second size information 115) assigned to the ultrasound image 24 different from the first ultrasound image 24B is displayed on the screen 26, allowing the doctor 20 to grasp the size 98 (i.e., the second size 98B) of the range 95 of the observation region 27 shown in the ultrasound image 24 different from the first ultrasound image 24B. Furthermore, the size information 102 assigned to the ultrasound image 24 (i.e., the size information 102 assigned to the ultrasound image 24 in the background) is used as the second size information 115, allowing the second size 98B to be quickly presented to the doctor 20. Furthermore, since the first size 98A and the second size 98B are displayed on the screen 26 in a distinguishable manner, the doctor 20 can distinguish between the size 98 of the range 95 of the first ultrasound image 24B (i.e., the first size 98A) and the size 98 of the range 95 of the ultrasound image 24 that is different from the first ultrasound image 24B (i.e., the second size 98B).

[0145] 10 , the second size 98B is an example of the "second size" according to the technology of the present disclosure. The second size information 115 is also an example of the "second size information" according to the technology of the present disclosure. The ultrasound image 24 different from the first ultrasound image 24B is an example of the "second ultrasound image" according to the technology of the present disclosure.

[0146] In the above embodiment, the case where the range 95 is constant is illustrated, but the technology of the present disclosure is not limited to this, and the range 95 may be changed according to an instruction given by the doctor 20. In this case, for example, as shown in FIG. 11 , a caliper change instruction 112 is received by the reception device 52 in a state where the first ultrasound image 24B, the caliper 96, and the first size 98A are displayed on the screen 26. The caliper change instruction 112 is an instruction to the control unit 62D to change the geometric characteristics (e.g., position, length, etc.) of the caliper 96. In the example shown in FIG. 11 , the caliper change instruction 112 is an example of a "third instruction" related to the technology of the present disclosure.

[0147] The control unit 62D changes the range 95 by changing the geometric characteristics of the caliper 96 in accordance with the caliper change instruction 112 received by the reception device 52. Accordingly, the control unit 62D outputs remeasurement instruction information 114 to the measurement unit 62C. The remeasurement instruction information 114 is an instruction to the measurement unit 62C to remeasure the changed range 95. The remeasurement instruction information 114 includes information capable of identifying the geometric characteristics of the changed caliper 96 (for example, information capable of identifying the position of one end 96A in the first ultrasound image 24B (e.g., coordinates, etc.) and information capable of identifying the position of the other end 96B in the first ultrasound image 24B (e.g., coordinates, etc.)).

[0148] The measurement unit 62C performs a remeasurement process 116 in accordance with the input remeasurement instruction information 114. The remeasurement process 116 is a process of remeasuring the size 98 of the range 95 identified from the geometric characteristics of the changed caliper 96. The measurement unit 62C outputs size information 102 indicating the remeasured size 98 by performing the remeasurement process 116 to the control unit 62D. The control unit 62D displays the size 98 indicated by the input size information 102 on the screen 26 in a state where it corresponds to the caliper 96.

[0149] This allows the doctor 20 observing the first ultrasound image 24B to understand the size 98 of the range 95 of the observation target area 27, and allows the doctor 20 to understand the size 98 of the range 95 intended by the doctor 20.

[0150] In the above embodiment, an example was given in which the size 98 of one area 95 applied to the first ultrasound image 24B (i.e., the first size 98A) is displayed on the screen 26, but the technology of the present disclosure is not limited to this. For example, as shown in Figures 12 to 14, multiple areas 95 may be identified from the first ultrasound image 24B, and size information 102 indicating the size 98 of the area 95 selected in accordance with an instruction from the doctor 20 may be output to the display device 14.

[0151] In this case, first, as shown in Fig. 12 as an example, the detector 62B acquires a first ultrasound image 24B and executes a part detection process 122 on the first ultrasound image 24B. The part detection process 122 is a process of detecting a plurality of observation target parts 27 appearing in the first ultrasound image 24B in accordance with a part detection model 124. In the example shown in Fig. 12, the part detection process 122 is executed by the detector 62B, thereby detecting internal organs 27A, 27B, and 27C appearing in the first ultrasound image 24B. In the example shown in Fig. 12, the part detection process 122 is an example of "AI-based image recognition processing" according to the technology of the present disclosure.

[0152] The part detection model 124 is a trained model for object detection using an AI system, and is optimized by performing machine learning on the neural network using second training data. The second training data is a plurality of data (i.e., data for a plurality of frames) in which second example data and second answer data are associated with each other.

[0153] The second example data is an image corresponding to the ultrasound image 24. The second correct answer data is correct answer data (i.e., annotation) for the second example data. Here, as an example of the second correct answer data, an annotation capable of identifying a region corresponding to the observation target region 27 in an image corresponding to the ultrasound image 24 (for example, information indicating the name of the observation target region 27, a plurality of coordinates capable of identifying the position of the region corresponding to the observation target region 27, and information indicating the priority of the region) is used.

[0154] Detector 62B inputs first ultrasound image 24B to part detection model 124. As a result, part detection model 124 detects multiple observation target parts 27 appearing in input first ultrasound image 24B, and outputs detection result information 126 indicating the detection results. Detector 62B acquires detection result information 126 output from part detection model 124.

[0155] The detection result information 126 includes site information 128 for each detected observation target site 27. The site information 128 includes site identification information 128A, position identification information 128B, and priority order information 128C. The site identification information 128A is information synonymous with the site identification information 94A described in the above embodiment, and the position identification information 128B is information synonymous with the position identification information 94B described in the above embodiment. The priority order information 128C is information indicating the priority order of the detected observation target sites 27 (for example, the priority order determined in advance for each of the internal organs 27A, 27B, and 27C).

[0156] The measurement unit 62C performs various processes on each of the multiple observation target regions 27 detected from the first ultrasound image 24B, based on the detection result information 126 acquired by the detection unit 62B.

[0157] For example, the measurement unit 62C refers to the position identification information 128B to identify the internal organs 27A to 27C from the first ultrasound image 24B that is the processing target of the part detection process 122. Here, for the sake of convenience of explanation, the internal organs 27A to 27C are illustrated, but this is merely an example, and the technology of the present disclosure can be implemented even if a mass lesion (e.g., a mass or tumor) or a duct (e.g., a bile duct or a pancreatic duct) is applied instead of the internal organs 27A, 27B, and / or 27C.

[0158] Furthermore, the measurement unit 62C refers to the part identification information 128A and identifies a range 95 corresponding to each of the internal organs 27A, 27B, and 27C identified from the first ultrasound image 24B. The range 95 is determined in the same manner as in the above embodiment.

[0159] In addition, the measurement unit 62C measures the size 98 for each range 95 of the internal organs 27A, 27B, and 27C in the same manner as in the above embodiment, and assigns size information 102 to each of the internal organs 27A, 27B, and 27C.

[0160] The measuring unit 62C generates calipers 96 for each of the internal organs 27A, 27B, and 27C in the same manner as in the above embodiment, and assigns caliper drawing information 100 to each of the internal organs 27A, 27B, and 27C.

[0161] Furthermore, the measurement unit 62C refers to the detection result information 126 and assigns priority order information 128C to each of the internal organs 27A, 27B, and 27C.

[0162] 13 as an example, the controller 62D displays a first ultrasound image 24B on the screen 26 in the same manner as in the above embodiment. Within the first ultrasound image 24B, calipers 96 are displayed sequentially for each observation region 27 based on the caliper drawing information 100 assigned to each observation region 27. Furthermore, the calipers 96 for each observation region 27 are displayed sequentially according to the priority indicated by the priority information 128C assigned to the observation region 27 to which the caliper 96 is applied.

[0163] The priority order information 128C is displayed on the screen 26 as information that can identify the priority order of the observation target region 27 to which the displayed caliper 96 is applied (in the example shown in FIG. 13 , text information such as "first candidate," "second candidate," and "third candidate") when the caliper 96 for each observation target region 27 is displayed on the screen 26. Because each observation target region 27 is applied with one range 95, the priority order information 128C can also be said to be information that can identify the priority order of the range 95. In this way, by displaying the priority order information 128C on the screen 26, the doctor 20 can visually recognize the priority order of the range 95 defined by the caliper 96 displayed on the screen 26 (in other words, the priority order of the observation target region 27 to which the caliper 96 is applied).

[0164] With the first ultrasound image 24B displayed on the screen 26, the reception device 52 receives a switching instruction 130 that is an instruction to switch the display of the calipers 96. In response to the switching instruction 130 received by the reception device 52, the control unit 62D switches the calipers 96 displayed on the screen 26 in an order (e.g., ascending order or descending order) corresponding to the priority of the observation target region 27 to which the calipers 96 are applied.

[0165] 13 , the display of the caliper 96 applied to the internal organ 27A, the display of the caliper 96 applied to the internal organ 27B, and the display of the caliper 96 applied to the internal organ 27C are switched in this order each time the switching instruction 130 is received by the reception device 52. The switching of the display of the caliper 96 is cyclical. For example, when the reception device 52 receives the switching instruction 130 while the caliper 96 applied to the internal organ 27C is displayed, the display is switched to the caliper 96 applied to the internal organ 27A. In the example shown in FIG. 13 , the switching instruction 130 is an example of a “fifth instruction” according to the technology of the present disclosure.

[0166] Here, an example is given in which one caliper 96 is applied to the observation target region 27, but this is merely one example. For example, as shown in Fig. 21 , multiple calipers 96 may be applied to the observation target region 27 (internal organs 27A in the example shown in Fig. 21 ). In this case, a priority may be assigned to each caliper 96, and the display of the calipers 96 may be switched in an order determined according to the priority in accordance with the switching instruction 130. Alternatively, the display of the calipers 96 may be switched randomly, regardless of the priority.

[0167] 21, the display of the multiple calipers 96 applied to the internal organ 27A is switched, but this is merely one example, and the display of the multiple calipers 96 may be switched in a similar manner across multiple observation target regions 27 (e.g., internal organs 27A to 27C). In this case, for example, the display of the multiple calipers 96 applied to each observation target region 27 may be switched from the observation target region 27 with the highest priority to the observation target region 27 with the lowest priority among the multiple observation target regions 27.

[0168] As an example, as shown in FIG. 14 , the reception device 52 receives a selection instruction 131. The selection instruction 131 is an instruction to select a range 95 defined by a caliper 96 displayed on the screen 26. When the reception device 52 receives the selection instruction 131 while the caliper 96 is displayed on the screen 26, the control unit 62D selects the range 95 defined by the caliper 96 currently displayed on the screen 26. The control unit 62D then obtains size information 102 corresponding to the selected range 95 and outputs the obtained size information 102 to the display device 14. As a result, a third size 98C is displayed on the screen 26 in a state corresponding to the range 95 defined by the caliper 96 on the screen 26. The third size 98C refers to the size 98 of the range 95 selected in accordance with the selection instruction 131.

[0169] In the example shown in Figure 14, the size information 102 assigned to the internal organ 27B is acquired by the control unit 62D and output to the display device 14, and the size 98 of the range 95 defined by the caliper 96 applied to the internal organ 27B is displayed on the screen 26 as the third size 98C.

[0170] In the example shown in FIG. 14, selection instruction 131 is an example of a "fourth instruction" according to the technology of the present disclosure, size information 102 assigned to internal organ 27B is an example of "third size information" according to the technology of the present disclosure, and third size 98C is an example of "third size" according to the technology of the present disclosure.

[0171] In this way, when the area detection process 122 is executed on the first ultrasound image 24B, multiple ranges 95 are identified, and when the first ultrasound image 24B is displayed on the screen 26, the third size 98C of the range 95 selected in accordance with the given selection instruction 131 is displayed on the screen 26, so that the doctor 20 observing the first ultrasound image 24B can understand the size 98 of the range 95 intended by the doctor 20.

[0172] In addition, in the examples shown in Figures 13 and 14, the calipers 96 are displayed on the screen 26 in accordance with the switching instruction 130 in an order corresponding to the priority indicated by the priority information 128C, and the size 98 of the range 95 selected in accordance with the selection instruction 131 is displayed on the screen 26 as the third size 98C, allowing the doctor 20 observing the first ultrasound image 24B to quickly grasp the size 98 of the range 95 intended by the doctor 20.

[0173] 13 illustrates an example in which the display of the calipers 96 is switched in accordance with the switching instruction 130, but the technology of the present disclosure is not limited to this, and the multiple calipers 96 may be displayed in a list on the screen 26 in a manner that allows identification of the priority order. In this case, one caliper 96 is selected from the multiple calipers 96 displayed in a list in accordance with the selection instruction 131, and the size 98 of the range 95 defined by the selected caliper 96 is displayed on the screen 26 as a third size 98C.

[0174] In the above embodiment, the first size 98A of the internal organ 27A shown in the first ultrasound image 24B is the maximum length of the cross section of the internal organ 27A, but the technology of the present disclosure is not limited to this. For example, as shown in Figures 15 to 18 , an ultrasound image 24 that satisfies the condition that the size 98 of the observation target area 27 (e.g., internal organ 27A) is measured using a measurement method corresponding to the observation target area 27 detected by the detection unit 62B may be set as the first ultrasound image 24B, and the size 98 of the observation target area 27 (e.g., internal organ 27A) shown in the first ultrasound image 24B may be used as the first size 98A.

[0175] In addition, multiple ultrasound images 24 in which the size 98 of the observation area 27 (e.g., internal organ 27A) is measured using a measurement method corresponding to the observation area 27 detected by detection unit 62B may be displayed on screen 26, output to external device 134, output to printer 138, or saved in electronic medical record 136 (see Figure 19).

[0176] Here, the measurement method may be, for example, one or more measurement methods including a first measurement method and / or a second measurement method. An example of the first measurement method is a method of measuring the observation target area 27 (internal organ 27A in the example shown in FIG. 15) in multiple directions (two directions in the example shown in FIG. 15), as shown in FIG. 15. The multiple directions may be three or more directions. An example of the second measurement method is a method of measuring the observation target area 27 in one direction. Examples of the method of measuring in one direction include the method of measuring the maximum length of the cross section, as in the above embodiment, and also the method of measuring in a predetermined one direction as shown in FIGS. 16 to 18.

[0177] 15, the measuring unit 62C may measure lengths 98A1 and 98A2 in two intersecting directions as a first size 98A. The length 98A1 is the length of a major axis 120 of a cross section of the internal organ 27A, and the length 98A2 is the length of a minor axis 121 of the cross section of the internal organ 27A. As in the above embodiment, a caliper 96 is applied to each of the major axis 120 and the minor axis 121. Changing the geometric characteristics of the caliper 96 in the same manner as in the example shown in FIG. 11 also changes the lengths 98A1 and 98A2 measured by the measuring unit 62C.

[0178] The lengths 98A1 and 98A2 measured by the measuring unit 62C are displayed on the screen 26 by the control unit 62D in the same manner as in the above embodiment. This allows the doctor 20 observing the first ultrasound image 24B to grasp the size 98 of the cross section of the viscera 27A by the length 98A1 of the major axis 120 and the length 98A2 of the minor axis 121 of the cross section of the viscera 27A.

[0179] Here, the length 98A1 of the major axis 120 and the length 98A2 of the minor axis 121 are exemplified, but the technology of the present disclosure can be applied to either the length 98A1 of the major axis 120 or the length 98A2 of the minor axis 121. Furthermore, instead of the viscera 27A, the length of the major axis and / or the minor axis of the viscera 27B or the viscera 27C may be measured and displayed on the screen 26, or the length of the major axis and / or the minor axis of a mass lesion may be measured and displayed on the screen 26.

[0180] Furthermore, here, lengths 98A1 and 98A2 in two intersecting directions are exemplified as the first size 98A, but this is merely an example, and three or more intersecting lengths may be measured and displayed on the screen 26 as the first size 98A.

[0181] In the above embodiment, an example in which the size 98 of the internal organ 27A shown in the ultrasound image 24 is measured by the measuring unit 62C has been given, but this is merely one example. For example, as shown in FIG. 16 , the size 98 of a duct 27D may be measured by the measuring unit 62C. Examples of the duct 27D include blood vessels, lymphatic vessels, bile ducts, water ducts, and medical artificial ducts. The duct 27D is an example of a "duct" according to the technology of the present disclosure.

[0182] The measurement unit 62C, in the same manner as in the above embodiment, identifies the pipe 27D as the observation target region 27 from the ultrasound image 24, and sets a range 95 for the pipe 27D according to the identified pipe 27D. The measurement unit 62CD also generates a caliper 96 that defines the range 95 for the pipe 27D, in the same manner as in the above embodiment.

[0183] The measurement unit 62C measures a size 98 of a range 95 corresponding to the tube 27D. In this case, the length of the radial range of the tube 27D is measured as the size 98. If the tube 27D shown in the ultrasound image 24 is circular in a cross-sectional view, the diameter of the tube 27D is measured as the size 98. Furthermore, for example, as shown in FIG. 17 , if the tube 27D shown in the ultrasound image 24 is elliptical in a longitudinal cross-sectional view, the length of the minor axis of the tube 27D is measured as the size 98. In other words, the maximum length of the cross section of the tube 27D shown in the ultrasound image 24 is measured as the size 98. The measured size 98 is displayed on the screen 26 in correspondence with the range 95 of the tube 27D shown in the ultrasound image 24. This allows the doctor 20 observing the ultrasound image 24 (e.g., the first ultrasound image 24B) to understand the maximum length of the cross section of the tube 27D shown in the ultrasound image 24.

[0184] 16 and 17 show an example in which the size 98 of a tube 27D shown in the ultrasound image 24 is measured by the measuring unit 62C, but as shown in Fig. 18, the size 98 of an annular lesion 27E shown in the ultrasound image 24 may also be measured by the measuring unit 62C. Examples of the annular lesion 27E include polycystic lesions (e.g., multilocular cystic masses or polycystic ovaries). The annular lesion 27E is an example of an "annular lesion" according to the technology of the present disclosure.

[0185] In the same manner as in the above embodiment, the measurement unit 62C identifies the annular lesion 27E from the ultrasound image 24 as the observation target region 27, and sets a range 95 corresponding to the identified annular lesion 27E for the annular lesion 27E. In addition, in the same manner as in the above embodiment, the measurement unit 62C also generates a caliper 96 that defines the range 95 for the annular lesion 27E.

[0186] The measurement unit 62C measures a size 98 of the range 95 corresponding to the annular lesion 27E. For example, the measurement unit 62C measures the size 98 of the range 95 corresponding to the annular lesion 27E, which is the size 98 of the range from one end to the other end of the longest line segment that intersects the outline of the cross section of the annular lesion 27E shown in the ultrasound image 24. The measured size 98 is displayed on the screen 26 in correspondence with the range 95 of the annular lesion 27E shown in the ultrasound image 24. This allows the doctor 20 observing the ultrasound image 24 (e.g., the first ultrasound image 24B) to understand the size 98 of the range from one end to the other end of the longest line segment that intersects the outline of the cross section of the annular lesion 27E shown in the ultrasound image 24.

[0187] In the above embodiment, an example was given in which medical support processing is executed by the processor 62 of the processing device 18 to display the ultrasound image 24, caliper 96, and size 98 on the screen 26, but the technology disclosed herein is not limited to this.

[0188] 19 , when the processing device 18 is connected to an external device 134 (e.g., a server or personal computer that manages an electronic medical record 136 and / or images) via a network 132 such as a LAN or WAN, the ultrasound image 24, the caliper drawing information 100, the size information 102 (e.g., first size information 110), and / or related information related to the size information 102 (e.g., first size information 110) may be stored in the external device 134 or may be stored in the electronic medical record 136. Examples of the related information related to the size information 102 include information that can identify the position of the observation region 27 where the size 98 was measured (e.g., the region name or coordinates), or information that can identify the current position of the ultrasound probe 38 that emitted ultrasound to obtain the ultrasound image 24 showing the observation region 27 where the size 98 was measured (e.g., the region name or coordinates).

[0189] 19 , the ultrasound image 24, the caliper drawing information 100, the size information 102, and / or related information related to the size information 102 are stored in the external device 134 or in the electronic medical record 136. This makes it possible to prevent the ultrasound image 24, the caliper drawing information 100, the size information 102, and / or related information related to the size information 102 from being lost.

[0190] The size information 102 and / or related information related to the size information 102 may be output as audio by an audio playback device. The related information related to the size information 102 may be displayed on the screen 26.

[0191] Furthermore, if the processing device 18 is connected to a printer 138 via the network 132, the ultrasound image 24, the caliper drawing information 100, the size information 102, and / or related information related to the size information 102 may be output to the printer 138. In this case, for example, the printer 138 prints the ultrasound image 24, the caliper 96, the size 98, and / or related information related to the size information 102 on a recording medium 140 (e.g., paper).

[0192] In the above embodiment, an example is given in which the time period 104 is set based on the freeze image 24A, but this is merely one example, and the time period 104 may be specified in accordance with an instruction accepted by the acceptance device 52 or various conditions (e.g., the area shown in the ultrasound image 24 or the display mode of the ultrasound image 24) regardless of the freeze image 24A. Furthermore, instead of specifying the time period 104, a plurality of ultrasound images 24 in chronological order may be specified.

[0193] In the above embodiment, an example has been described in which the length of the range 95 is measured as the size 98, but this is merely one example, and the area and / or volume of a range corresponding to the observation target site 27 may be measured as the size 98. In other words, the concept of the size 98 includes area and volume in addition to length.

[0194] In the above embodiment, an example in which the medical support processing is executed by the computer 54 of the processing device 18 has been described, but the technology of the present disclosure is not limited thereto. For example, as shown in FIG. 20 , the medical support processing may be executed by a computer 144 of a function expansion device 142 (e.g., a computer having a hardware configuration similar to that of the computer 54), which is an auxiliary processing device used to expand the functions of the processing device 18. The processing device 18 and the display device 14 are connected to the function expansion device 142. The function expansion device 142 executes the medical support processing under the control of the processing device 18 and outputs the ultrasound image 24, the caliper drawing information 100, the size information 102, and / or related information related to the size information 102 to the display device 14, etc. As a result, the ultrasound image 24, the caliper 96, the size 98, and related information related to the size information 102 are displayed on the screen 26 of the display device 14.

[0195] In the above embodiment, an example was given in which the measurement unit 62C measures the size 98 for each ultrasound image 24 generated by the generation unit 62A, but the technology of the present disclosure is not limited to this. For example, the measurement unit 62C may measure the size 98 for one or more frames of ultrasound images 24 within a time period (e.g., time period 104) specified by the doctor 20, or the measurement unit 62C may measure the size 98 for each number of frames specified by the doctor 20. The same can be said for the site detection processes 93 and / or 122.

[0196] In the above embodiment, an example in which the medical support program 76 is stored in the NVM 66 has been described, but the technology of the present disclosure is not limited to this. For example, the medical support program 76 may be stored in a computer-readable storage medium such as an SSD or a USB memory. The storage medium is a stationary or portable non-transitory storage medium. The medical support program 76 stored in the storage medium is installed in the computer 54. The processor 62 executes medical support processing in accordance with the medical support program 76.

[0197] In the above embodiment, the computer 54 is exemplified, but the technology of the present disclosure is not limited to this, and a device including an ASIC, an FPGA, and / or a PLD may be applied instead of the computer 54. Furthermore, instead of the computer 54, a combination of a hardware configuration and a software configuration may be used.

[0198] The hardware resources for executing the medical support processing described in the above embodiments can be various processors, as listed below. Examples of processors include general-purpose processors that function as hardware resources for executing medical support processing by executing software, i.e., programs. Examples of processors include dedicated electronic circuits, such as FPGAs, PLDs, or ASICs, which are processors with circuit configurations designed specifically for executing specific processing. Each processor has built-in or connected memory, and uses the memory to execute the medical support processing.

[0199] The hardware resource for executing the medical support processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a processor and an FPGA). Also, the hardware resource for executing the medical support processing may be a single processor.

[0200] As an example of a system configured with a single processor, first, one processor is configured by combining one or more processors with software, and this processor functions as a hardware resource that executes medical support processing. Second, there is a system that uses a processor that realizes the functions of the entire system, including multiple hardware resources that execute medical support processing, on a single IC chip, as typified by SoC. In this way, medical support processing is realized using one or more of the various processors described above as hardware resources.

[0201] Furthermore, the hardware structure of these various processors can be, more specifically, electronic circuits that combine circuit elements such as semiconductor devices. The above medical support process is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the process.

[0202] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[0203] In this specification, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed by connecting them with "and / or."

[0204] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

Claims

1. A medical support device comprising a processor, wherein the processor displays a first ultrasonic image in which an observation target site is shown and that satisfies a predetermined condition, and a second ultrasonic image different from the first ultrasonic image, among a plurality of time-series ultrasonic images, in a list on a screen; displays first size information indicating a first size and second size information indicating a second size on the screen so as to be distinguishable from each other in a state where the first ultrasonic image and the second ultrasonic image are displayed in a list on the screen; the first size information is displayed on the screen in a state corresponding to the first ultrasonic image; the second size information is displayed on the screen in a state corresponding to the second ultrasonic image; the first size is the size of the observation target site shown in the first ultrasonic image; the second size is the size of the observation target site shown in the second ultrasonic image. Medical support device.

2. The predetermined condition includes a condition that the observation target site is detected among the plurality of ultrasonic images and an image in which the size of the detected observation target site is measured. The medical support device according to claim 1.

3. The predetermined condition includes a condition that a specific observation target site among a plurality of the observation target sites is detected among the plurality of ultrasonic images and an image in which the size of the specific observation target site is measured. The medical support device according to claim 1.

4. The processor outputs a plurality of ultrasonic images in which the observation target site is detected and the size of the observation target site is measured among the plurality of ultrasonic images. The medical support device according to claim 1.

5. The predetermined condition includes a condition that the length of the observation target site is equal to or greater than a reference value. The medical support device according to claim 1.

6. The predetermined condition includes a condition that the length of the observation target site is a maximum value or a mode value. The medical support device according to claim 1.

7. When the observation target site is a tube, the length is the length in the radial direction of the tube. The medical support device according to claim 6.

8. Size information indicating the size of the observation target site is attached to each of the ultrasonic images, and the processor outputs the size information attached to the first ultrasonic image as the first size information. The medical support device according to claim 1.

9. The first ultrasonic image is an ultrasonic image that satisfies the predetermined condition among the ultrasonic images in a time period defined based on a selected ultrasonic image selected from the plurality of ultrasonic images according to a given first instruction. The medical support device according to claim 1.

10. The selected ultrasonic image is a freeze image, The freeze image is an ultrasonic image that is displayed in a frozen state on the screen according to the first instruction under the condition that the plurality of ultrasonic images are displayed on the screen as a moving image. is The medical support device according to claim 9.

11. The time period is a time period traced back in the past based on the time point when the selected ultrasonic image was obtained. The medical support device according to claim 9.

12. The length of the time period is determined according to a given second instruction. The medical support device according to claim 10.

13. Size information indicating the size of the observation target site is attached to each of the ultrasonic images, The processor outputs the size information attached to the second ultrasonic image as the second size information. The medical support device according to claim 1.

14. The predetermined condition includes a condition that the observation target site is detected among the plurality of ultrasonic images, and the size of the observation target site is measured by a measurement method corresponding to the detected observation target site. The medical support device according to claim 1.

15. The predetermined condition includes a condition that a specific observation target site among the plurality of observation target sites is detected among the plurality of ultrasonic images, and the size of the observation target site is measured by a measurement method corresponding to the specific observation target site. The medical support device according to claim 1.

16. The processor outputs a plurality of ultrasonic images among the plurality of ultrasonic images in which the observation target site is detected and the size of the observation target site is measured by a measurement method corresponding to the observation target site. The medical support device according to claim 1.

17. The measurement method includes a first measurement method and / or a second measurement method, The first measurement method is a method of measuring the observation target site in one direction, The second measurement method is a method of measuring the observation target site in a plurality of directions. The medical support device according to claim 16.

18. The first size is the size of a range corresponding to the observation target site. The medical support device according to claim 1.

19. A caliper that defines the range is displayed on the screen. The medical support device according to claim 18.

20. The geometric characteristics of the caliper are changed according to a given third instruction, The range is changed as the geometric characteristics are changed. The medical support device according to claim 19.

21. When the first ultrasonic image is displayed on the screen, The processor outputs third size information indicating a third size of the range selected from a plurality of the ranges according to a given fourth instruction. The medical support device according to claim 18.

22. A priority is assigned to the range, A caliper indicating the range is displayed on the screen in a state where the priority can be specified. The medical support device according to claim 21.

23. On the screen, the calipers are displayed in an order corresponding to the priorities, The switching of the calipers displayed on the screen is performed according to a given fifth instruction. The medical support device according to claim 22.

24. The first size information and / or related information related to the first size information are stored in an external device and / or a medical record. The medical support device according to claim 1.

25. The ultrasonic image is an endoscopic ultrasonic image. The medical support device according to claim 1.

26. Comprising a processor, The processor, Detects an observation target site by performing image recognition processing on an ultrasonic image, Measures the observation target site by a measurement method corresponding to the detected observation target site. Medical support device.

27. The measurement method includes a first measurement method and / or a second measurement method, The first measurement method is a method of measuring the observation target site in one direction, The second measurement method is a method of measuring the observation target site in a plurality of directions. The medical support device according to claim 26.

28. The medical support device according to any one of claims 1 to 27, and An ultrasonic probe that emits ultrasonic waves in the body and receives reflected waves of the ultrasonic waves while being inserted into the body, and Generates the ultrasonic image based on the reflected wave. Endoscopic ultrasound.

29. Among a plurality of time-series ultrasonic images, displaying a first ultrasonic image in which an observation target site appears and that satisfies a predetermined condition and a second ultrasonic image different from the first ultrasonic image in a list on a screen, and In a state where the first ultrasonic image and the second ultrasonic image are listed and displayed on the screen, displaying on the screen the first size information indicating the first size and the second size information indicating the second size in a distinguishable manner, The first size information is displayed on the screen in a state corresponding to the first ultrasonic image, The second size information is displayed on the screen in a state corresponding to the second ultrasonic image, The first size is the size of the observation target part shown in the first ultrasonic image, The second size is the size of the observation target part shown in the second ultrasonic image Medical support method.

30. A program for causing a computer to execute processing, The processing is, Among a plurality of time-series ultrasonic images, displaying on the screen a first ultrasonic image in which an observation target part is shown and that satisfies a predetermined condition, and a second ultrasonic image different from the first ultrasonic image, and, In a state where the first ultrasonic image and the second ultrasonic image are listed and displayed on the screen, displaying on the screen the first size information indicating the first size and the second size information indicating the second size in a distinguishable manner, The first size information is displayed on the screen in a state corresponding to the first ultrasonic image, The second size information is displayed on the screen in a state corresponding to the second ultrasonic image, The first size is the size of the observation target part shown in the first ultrasonic image, The second size is the size of the observation target part shown in the second ultrasonic image Program.