Contact surface determination device and ultrasonic diagnostic device

Abstract

To automatically determine a state of a contact surface of an ultrasonic probe.SOLUTION: A contact surface determination device according to an embodiment includes an image acquisition unit and a contact surface determination unit. The image acquisition unit acquires an image including a contact surface of an ultrasonic probe. The contact surface determination unit determines a state of the contact surface of the ultrasonic probe on the basis of the acquired image.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The embodiments disclosed in this specification and the drawings relate to a contact surface determination device and an ultrasonic diagnostic device.

Background Art

[0002] An ultrasonic diagnostic device is equipped with a probe element check function for determining the state of the vibrator of an ultrasonic probe. The probe element check function transmits ultrasonic pulses from the ultrasonic diagnostic device main body to each vibrator of the ultrasonic probe, and analyzes the amplitude etc. of the reflected waves received from each vibrator to determine the state of each vibrator.

[0003] The probe element check function assumes that the ultrasonic probe is in a state of being left in the air, that is, the surface of the ultrasonic probe (that is, the contact surface with the subject) is in contact with air. In other words, for example, when an echo jelly adheres to the surface of the ultrasonic probe, the appearance of the reflected wave from the vibrator (for example, the amplitude, phase, etc. of the reflected wave) changes, and the state of the vibrator cannot be accurately determined. Therefore, in order to accurately determine the state of the vibrator, it is necessary for a service engineer to manage the execution conditions of the probe element check function, and it cannot be left to the user who performs the inspection.

[0004] Further, Patent Document 1 discloses prompting a maintenance worker to specify the quality of the appearance state of the ultrasonic probe of the ultrasonic diagnostic device, but there is a problem that the state of the contact surface of the ultrasonic probe cannot be automatically determined.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] One of the problems that the embodiments disclosed herein and in the drawings aim to solve is the automatic determination of the state of the contact surface of an ultrasonic probe. However, the problems that the embodiments disclosed herein and in the drawings aim to solve are not limited to the above problem. Problems corresponding to the effects of each configuration shown in each embodiment described later can also be positioned as other problems. [Means for solving the problem]

[0007] The contact surface determination device according to the embodiment comprises an image acquisition unit and a contact surface determination unit. The image acquisition unit acquires an image including the contact surface of the ultrasonic probe. The contact surface determination unit determines the state of the contact surface of the ultrasonic probe based on the image. [Brief explanation of the drawing]

[0008] [Figure 1] Figure 1 is a schematic diagram of an ultrasound diagnostic apparatus and ultrasound probe according to Embodiment 1. [Figure 2] Figure 2 is a block diagram showing the configuration of an ultrasound diagnostic device according to Embodiment 1. [Figure 3] Figure 3 is a flowchart showing the processing of the ultrasound diagnostic device according to Embodiment 1. [Figure 4] Figure 4 shows an example of an image captured by the camera according to Embodiment 1. [Figure 5] Figure 5 is a schematic diagram of a contact surface determination device, an ultrasonic diagnostic device, and an ultrasonic probe according to Embodiment 2. [Figure 6] Figure 6 is a block diagram showing the configuration of the contact surface determination device according to Embodiment 2. [Figure 7] Figure 7 is a flowchart showing the processing of the contact surface determination device according to Embodiment 2. [Figure 8] Figure 8 is a schematic diagram of the ultrasound diagnostic system according to Embodiment 3. [Figure 9] Figure 9 is a block diagram showing the configuration of the ultrasound diagnostic system according to Embodiment 3. [Figure 10]Figure 10 is a flowchart showing the processing of the ultrasound diagnostic system according to Embodiment 3. [Figure 11] Figure 11 is a perspective view showing the external appearance of an ultrasound diagnostic device according to Embodiment 4. [Modes for carrying out the invention]

[0009] The embodiments of the contact surface determination device and the ultrasonic diagnostic device will be described in detail below with reference to the drawings.

[0010] [Embodiment 1] Embodiment 1 relates to an ultrasound diagnostic device 2 that independently determines the state of the contact surface of an ultrasound probe 20. Figure 1 is a schematic diagram of the ultrasound diagnostic device 2 and ultrasound probe 20 according to Embodiment 1. Figure 2 is a block diagram showing the configuration of the ultrasound diagnostic device 2 equipped with an ultrasound image processing device 10 according to Embodiment 1.

[0011] The ultrasound diagnostic apparatus 2 includes an ultrasound image processing apparatus 10, an ultrasound probe 20, an input interface 30a, a display 40a, and a camera 50a. The ultrasound image processing apparatus 10 may also include at least one of the ultrasound probe 20, the input interface 30a, the display 40a, and the camera 50a. In the following description, we will describe the case where the ultrasound probe 20, the input interface 30a, the display 40a, and the camera 50a are all located outside the ultrasound image processing apparatus 10.

[0012] The input interface 30a includes an input device that can be operated by the user and an input circuit that receives signals from the input device. The input device can be a trackball, a switch, a mouse, a keyboard, a touchpad that allows input by touching the operating surface, a touchscreen that integrates a display screen and a touchpad, a non-contact input device using an optical sensor, or an audio input device. When the user operates the input device, the input circuit generates a signal corresponding to that operation and outputs it to the processing circuit 15a.

[0013] The display 40a is constituted by a general display output device such as a liquid crystal display or an OLED (Organic Light Emitting Diode) display. The display 40a displays various information according to the control of the processing circuit 15a. Note that the display 40a is an example of a display unit.

[0014] The camera 50a uses a semiconductor sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) that converts light into an electrical signal according to the amount of light as an imaging device. The field of view of the camera 50a is directed toward the contact surface of the ultrasonic probe 20, and the contact surface is captured under the control of the image acquisition function 156 to generate an image (i.e., an optical image). Note that the camera 50a is, for example, a USB (Universal Serial Bus) camera or the like, and is an example of a photographing unit.

[0015] The ultrasonic imaging device 10 includes an ultrasonic transmission circuit 11, an ultrasonic reception circuit 12, an image memory 13a, a network interface 14a, a processing circuit 15a, and a main memory 16a. The circuits 11 and 12 are constituted by an application specific integrated circuit (ASIC) or the like. However, it is not limited to that case, and all or part of the functions of the circuits 11 and 12 may be realized by the processing circuit 15a executing a computer program.

[0016] The ultrasonic transmission circuit 11 and the ultrasonic reception circuit 12 control the transmission directivity and the reception directivity in the transmission and reception of ultrasonic waves under the control of the processing circuit 15a. Although the case where both the ultrasonic transmission circuit 11 and the ultrasonic reception circuit 12 are provided in the ultrasonic imaging device 10 will be described, at least one of the ultrasonic transmission circuit 11 and the ultrasonic reception circuit 12 may be provided in the ultrasonic probe 20, or may be provided in both the ultrasonic imaging device 10 and the ultrasonic probe 20.

[0017] Based on the instructions of the processing circuit 15a, the ultrasonic transmission circuit 11 has a function that can instantaneously change the transmission frequency, transmission drive voltage, etc. in order to execute a predetermined scan sequence. In particular, the function of changing the transmission drive voltage is realized, for example, by a linear amplifier type transmission circuit that can instantaneously switch its value, or by a mechanism that electrically switches a plurality of power supply units.

[0018] Here, when 3D scanning, that is, volume scanning is performed, as the ultrasonic probe 20, a 2D array probe equipped with a scanning method such as a linear type, a convex type, and a sector type is used. Alternatively, when volume scanning is performed, as the ultrasonic probe 20, a 1D probe equipped with a scanning method such as a linear type and a convex type and having a mechanism that mechanically swings in the elevation direction is used. The latter probe is also called a mechanical 4D probe.

[0019] The image memory 13a has, for example, a recording medium readable by a processor such as a magnetic or optical recording medium, or a semiconductor memory. The image memory 13a stores a plurality of ultrasonic images under the control of the processing circuit 15a. Note that the image memory 13a is an example of a storage unit.

[0020] The network interface 14a implements various information communication protocols according to the form of the network. Also, the network interface 14a may implement various protocols for non-contact wireless communication. Note that the network interface 14a is an example of a network connection unit.

[0021] The processing circuit 15a means a dedicated or general-purpose CPU (Central Processing Unit), MPU (Micro Processor unit), or GPU (Graphics Processing Unit), as well as an ASIC and a programmable logic device, etc.

[0022] The main memory 16a is composed of semiconductor memory elements such as RAM (Random Access Memory) and flash memory, a hard disk, an optical disc, etc. The main memory 16a may also be composed of portable media such as USB (Universal Serial Bus) memory and DVD (Digital Video Disc). The main memory 16a stores various processing programs used in the processing circuit 15a (including application programs and the OS (Operating System), etc.) and data necessary for program execution. Note that the main memory 16a is an example of a storage unit.

[0023] Next, the functions of the ultrasonic image processing device 10 will be explained using Figure 2. The processing circuit 15a reads and executes a computer program stored in the main memory 16a or the memory within the processing circuit 15a to realize the B-mode processing function 151, the Doppler processing function 152, the image generation function 153, the display control function 155, the image acquisition function 156, the contact surface determination function 157, the transducer determination function 158, and the report creation function 159. The following explanation will use the case where functions 151-153 and 155-159 are realized by a computer program as an example, but all or part of functions 151-153 and 155-159 may be provided as functions of circuits such as ASICs in the ultrasonic image processing device 10.

[0024] The B-mode processing function 151 controls the ultrasonic transmitting circuit 11 and the ultrasonic receiving circuit 12, receives echo data from the ultrasonic receiving circuit 12, and performs logarithmic amplification and envelope detection processing to generate data (2D or 3D data) in which the signal strength is represented by brightness. This data is generally called B-mode data.

[0025] The Doppler processing function 152 is a function that generates data (Doppler information) by performing frequency analysis on the received signal received from the ultrasonic receiving circuit 12, thereby extracting motion information based on the Doppler effect of moving objects within the region of interest (ROI) set in the scan area. The generated Doppler information is stored in the RAW data memory (not shown) as Doppler RAW data (also referred to as Doppler data) on a two-dimensional ultrasonic scan line.

[0026] The image generation function 153 generates an ultrasound image as image data, expressed within a predetermined brightness range, based on the echo signal received by the ultrasound probe 20. For example, the image generation function 153 generates a B-mode image as an ultrasound image, representing the intensity of reflected waves in brightness from the two-dimensional B-mode data generated by the B-mode processing function 151. The image generation function 153 also generates a color Doppler image as an ultrasound image, representing motion information, such as an average velocity image, dispersion image, power image, or a combination of these images, from the two-dimensional Doppler data generated by the Doppler processing function 152.

[0027] The display control function 155 includes a function to display an ultrasound image on the display 40a. The display control function 155 also includes a function to display an image including the contact surface of the ultrasound probe 20 on the display 40a. The image acquisition function 156 includes a function to acquire an image from the camera 50 that includes the contact surface of the ultrasound probe 20. The contact surface determination function 157 includes a function to determine the state of the contact surface of the ultrasonic probe 20 based on the acquired image. For example, the contact surface determination function 157 determines whether or not foreign matter is attached to the contact surface of the ultrasonic probe 20 with the subject. The transducer determination function 158 includes an element check function that determines the state of the transducer of the ultrasonic probe 20 when the condition of the contact surface of the ultrasonic probe 20 is normal. The report generation function 159 includes a function to generate a report showing the results of contact surface determination.

[0028] Figure 3 is a flowchart showing the processing of the ultrasound diagnostic device 2 according to Embodiment 1. This process is an element check process, and it is assumed that a camera 50a is connected to the ultrasound image processing device 10, which is the main body of the ultrasound diagnostic device 2.

[0029] In step S1, the processing circuit 15a of the ultrasound imaging device 10 starts checking the elements of the ultrasound probe 20. This process is triggered when the user performs a predetermined operation on the input interface 30a.

[0030] First, in step S2, the processing circuit 15a activates the camera 50a. At this time, the image acquisition function 156 acquires a superimposed image in which a frame line indicating where the contact surface of the ultrasonic probe 20 should be placed is superimposed on the optical image captured and generated by the activated camera 50a. Then, the display control function 155 displays the acquired superimposed image on the display 40a.

[0031] Next, in step S3, the display control function 155 displays a message on the display 40a instructing the user to place the contact surface of the ultrasound probe 20 within the frame of the superimposed image. In other words, the display 40a displays the frame and a message instructing the user to place the contact surface of the ultrasound probe 20 within the frame. The area within the frame is an example of a predetermined imaging area of ​​the imaging unit. The message is an example of a display that guides the user to place the contact surface of the ultrasound probe 20 within the predetermined imaging area.

[0032] Figure 4 shows an example of an optical image captured by the camera 50a according to Embodiment 1. The display control function 155 may, for example, display a frame line W and the message "Place the contact surface of the probe within the frame line" on the display 40a, as shown in Figure 4(A).

[0033] In response to the display of the message, the user is prompted to adjust the position and orientation of the ultrasonic probe 20 while holding it in their hand, so that the contact surface of the ultrasonic probe 20 is within the frame displayed on the display 40a.

[0034] In step S4, the contact surface determination function 157 determines from the superimposed image of the camera 50a whether the contact surface of the ultrasonic probe 20 is within the frame line. If the contact surface is within the frame line (YES in step S4), the processing circuit 15a proceeds to step S5. If the contact surface is not within the frame line (NO in step S4), the processing circuit 15a returns to step S3.

[0035] In step S5, the contact surface determination function 157 determines whether the contact surface of the ultrasonic probe 20 is in a state where element checking is possible, based on the superimposed image from the camera 50a, if the contact surface of the ultrasonic probe 20 is within the frame line. The contact surface determination function 157 determines whether or not foreign matter such as ultrasound gel is attached to the contact surface, for example, by pattern matching with a normal example or by using AI (deep learning, etc.).

[0036] If the contact surface of the ultrasonic probe 20 is in a state where element checking is possible (YES in step S5), the processing circuit 15a proceeds to the process in step S7. If the contact surface of the ultrasonic probe 20 is not in a state where element checking is possible (NO in step S5), the processing circuit 15a proceeds to the process in step S6.

[0037] In step S6, if the contact surface of the ultrasonic probe 20 is not in a state where element checking is possible (the condition of the contact surface is not normal), the display control function 155 displays on the display 40a that element checking is not possible and the reason why. That is, the display 40a displays that element checking is not possible and the reason why. The display 40a displays the condition of the contact surface of the ultrasonic probe 20, for example, "Element checking cannot be performed because foreign matter is attached to the contact surface," or "Please remove the foreign matter from the contact surface." Then, the processing circuit 15a returns to the determination in step S5.

[0038] In response to the display of the reason why the element check is not possible, the user is expected to take steps to resolve the reason, such as removing foreign matter adhering to the contact surface of the ultrasonic probe 20. This will result in the judgment result of step S5 becoming YES.

[0039] In step S7, when the contact surface of the ultrasonic probe 20 becomes ready for element checking, the processing circuit 15a performs the element check. The report creation function 159 then creates a report showing the results of the element check and stores the report in the main memory 16a.

[0040] Optical images, including photographs of the surface and appearance of the transducer of the ultrasonic probe 20, taken by camera 50a before the element check is performed, are automatically inserted into a designated location in the report. The optical images automatically inserted into the report may be images used to determine whether or not the element check can be performed, or any image taken by camera 50a before the element check is performed that the user wishes to include in the report.

[0041] According to Embodiment 1, the state of the ultrasonic probe 20 can be determined with high accuracy, so probe element checks can be performed without problems even if left to the user. Furthermore, conventionally, service engineers had to add photographs of the transducer surface of the ultrasonic probe 20 afterwards when creating element check reports, but in this embodiment, camera images are added automatically. This also has the secondary effect of saving time in report creation.

[0042] [Embodiment 2] Embodiment 2 relates to a contact surface determination device 1 for determining the state of the contact surface of an ultrasonic probe 20. Figure 5 is a schematic diagram of the contact surface determination device 1, ultrasonic diagnostic device 2, and ultrasonic probe 20 according to Embodiment 2. Figure 6 is a block diagram showing the configuration of the contact surface determination device 1 according to Embodiment 2.

[0043] The contact surface determination device 1 is comprised of, for example, a desktop PC (Personal Computer), a notebook PC (laptop PC), or a tablet PC (including smartphones, tablets, and phablets). The contact surface determination device 1 includes an image memory 13, a network interface 14, a processing circuit 15, a main memory 16, an input interface 30, a display 40, and a camera 50. Note that the image memory 13, network interface 14, processing circuit 15, and main memory 16 are the same as the image memory 13a, network interface 14a, processing circuit 15a, and main memory 16a shown in Figure 2, so a detailed explanation is omitted.

[0044] The processing circuit 15 implements a display control function 154, an image acquisition function 156, a contact surface determination function 157, and a report creation function 159. Note that the processing circuit 15 is an example of a processing unit. The display control function 154 includes a function for displaying images, borders, messages, reports, etc., on the display 40. The image acquisition function 156, the contact surface determination function 157, and the report creation function 159 were explained using Figure 2, so their explanations will be omitted here. Furthermore, the functions of the input interface 30, display 40, and camera 50 are the same as those of the input interface 30a, display 40a, and camera 50a in Figure 2, so their explanation will be omitted.

[0045] Figure 7 is a flowchart showing the process of the contact surface determination device 1 according to Embodiment 2. This process involves the contact surface determination device 1 determining the state of the contact surface of the ultrasonic probe 20 of the ultrasonic diagnostic device 2.

[0046] First, in step S11, the processing circuit 15 of the contact surface determination device 1 activates the camera 50. At this time, the image acquisition function 156 acquires the optical image captured and generated by the activated camera 50. Then, the display control function 154 displays a superimposed image on the display 40 in which information indicating the position where the contact surface of the ultrasonic probe 20 should be placed (for example, the frame line W shown in Figure 4(A)) is superimposed on the acquired optical image. This information is not limited to the frame line W, but may be, for example, a straight line indicating the major axis direction of the contact surface, or an ellipse that is long in the direction of the major axis direction of the contact surface.

[0047] Next, in step S12, the display control function 154 displays a message on the display 40 instructing the user to place the contact surface of the ultrasonic probe 20 within the frame of the superimposed image (for example, frame W shown in Figure 4(A)).

[0048] In response to the display of the message, the user is prompted to adjust the position and orientation of the ultrasonic probe 20 while holding it in their hand, so that the contact surface of the ultrasonic probe 20 is within the frame W displayed on the display 40. Alternatively, the user may adjust the position and orientation of the camera 50 in addition to, or in addition to, the position and orientation of the ultrasonic probe 20.

[0049] In step S13, the contact surface determination function 157 determines from the optical image of the camera 50 whether the contact surface of the ultrasonic probe 20 is within the frame line. If the contact surface is within the frame line (YES in step S13), the processing circuit 15 proceeds to the processing in step S14. If the contact surface is not within the frame line (NO in step S13), the processing circuit 15 returns to the processing in step S12.

[0050] In step S14, the contact surface determination function 157 determines the state of the contact surface if the contact surface of the ultrasonic probe 20 is within the frame. The contact surface determination function 157 determines whether or not foreign matter such as ultrasound gel is attached to the contact surface, for example, by pattern matching with normal examples or by using AI (deep learning, etc.). For example, the contact surface determination function 157 obtains a determination result corresponding to the new contact surface image by inputting the new contact surface image into a trained model that has been trained on a large number of contact surface images and determination results. Note that there are many different types of ultrasonic probes 20, such as linear, convex, and sector types, and their contact surface shapes also vary, so it is preferable to generate a trained model for each shape of the contact surface of the ultrasonic probe 20.

[0051] The condition of the contact surface can be categorized into two states: a normal state where nothing is attached and there are no scratches or other damage, and an abnormal state where foreign matter is attached to the contact surface or there is a problem with the contact surface itself. Among the abnormal states, a state where there is a problem with the contact surface itself is one in which the contact surface has, for example, peeling, looseness, discoloration, swelling, gaps, depressions, scratches, etc.

[0052] In step S15, the report creation function 159 creates a report showing the result of determining the state of the contact surface. Next, the display control function 154 displays the created report, or a message summarizing the report, on the display 40. The display control function 154 may also display a border line W and the message "Please remove foreign matter from the probe's contact surface" on the display 40, for example, as shown in Figure 4(B). Then, the processing circuit 15 stores the created report in the main memory 16.

[0053] In steps S13 and S14, it was explained that the state of the contact surface of the ultrasonic probe 20, which is located within the frame line superimposed on the optical image, is determined. However, it is not necessary to use a frame line. For example, if the contact surface of the ultrasonic probe 20 is included in the optical image of the camera 50, the contact surface determination function 157 may automatically recognize the contact surface from the optical image and then determine the state of the contact surface. In this case, it is necessary to recognize the presence of the contact surface regardless of the presence or absence of foreign matter, so for example, pattern matching based on the contour of the contact surface may be used.

[0054] [Embodiment 3] In the above-described Embodiment 1, the ultrasound diagnostic device 2 equipped with an ultrasound probe 20 performs both contact surface determination and transducer determination, but the configuration is not limited to this. For example, the ultrasound diagnostic device and a different device (a contact surface determination device 1a described later) that is communicatively connected to it may each perform contact surface determination and transducer determination. In other words, the imaging unit for photographing the ultrasound probe may be not only a camera connected to the ultrasound diagnostic device, but also an external device of the ultrasound diagnostic device (a contact surface determination device 1a described later). Embodiment 3 relates to an ultrasound diagnostic system 100 that uses the user's contact surface determination device 1a as the imaging unit.

[0055] Figure 8 is a schematic diagram of the ultrasound diagnostic system 100 according to Embodiment 3. Figure 9 is a block diagram showing the configuration of the ultrasound diagnostic system 100 according to Embodiment 3. The configuration of the ultrasound diagnostic system 100 will be described below, but explanations of parts similar to those in Embodiments 1 and 2 will be omitted.

[0056] The ultrasound diagnostic system 100 comprises a contact surface determination device 1a and an ultrasound diagnostic device 2a.

[0057] The contact surface determination device 1a is communicatively connected to the ultrasound diagnostic device 2a and includes an image memory 13, a network interface 14, a processing circuit 15b, a main memory 16, an input interface 30, a display 40, and a camera 50. The processing circuit 15b includes a display control function 154, an image acquisition function 156, a contact surface determination function 157, and a notification transmission function 161. The notification transmission function 161 includes a function to wirelessly transmit the state of the contact surface of the ultrasound probe 20 to the ultrasound diagnostic device 2a. Note that the image memory 13, network interface 14, main memory 16, input interface 30, display 40, camera 50, and the display control function 154, image acquisition function 156, and contact surface determination function 157 are the same as in Figure 6, so their explanation is omitted.

[0058] In addition to the above, the contact surface determination device 1a also includes a function to activate the camera 50, a function to overlay a frame and messages onto the image captured by the camera 50, and a function to determine whether or not the contact surface of the ultrasonic probe 20 is within the frame of the overlaid image from the camera 50. Each of these functions is provided by an application (application software) installed on the contact surface determination device 1a.

[0059] The ultrasound diagnostic device 2a includes at least an ultrasound probe 20, a notification receiving function 160, a transducer determination function 158, a display control function 155, and a report creation function 159. The notification receiving function 160 includes a function to receive the status of the contact surface of the ultrasound probe 20 from the contact surface determination device 1a. The transducer determination function 158 includes a function to determine the status of the transducer of the ultrasound probe 20 when a notification is received from the contact surface determination device 1a. The display control function 155 includes a function to control the output of the result of determining the status of the transducer of the ultrasound probe 20. The report creation function 159 includes a function to create a report showing the results of the element check.

[0060] Figure 10 is a flowchart showing the processing of the ultrasound diagnostic system 100 according to Embodiment 3. This processing is an element check process performed in cooperation with the contact surface determination device 1a and the ultrasound diagnostic device 2a. The user performs predetermined operations on the ultrasound image processing device 10a and the contact surface determination device 1a to start the element check of the ultrasound probe 20.

[0061] In step S21, the processing circuit 15c of the ultrasound image processing device 10a starts checking the elements of the ultrasound probe 20. This process is triggered when the user performs a predetermined operation on the input interface 30a. Subsequently, the processing circuit 15c performs the determination in step S28. The details of this will be described later.

[0062] Meanwhile, in step S22, the contact surface determination device 1a launches the application. This process is triggered when the user performs a predetermined operation on the contact surface determination device 1a. At this time, the camera 50 of the contact surface determination device 1a is activated, and the image acquisition function 156 acquires the optical image captured and generated by the activated camera 50. Then, the display control function 154 displays the acquired optical image on the display 40.

[0063] In step S23, the display control function 154 of the contact surface determination device 1a displays a frame on the display 40, superimposed on the previously displayed image, and a message instructing the user to place the contact surface of the ultrasonic probe 20 within the frame.

[0064] In response to the display of the message, the user is prompted to move the ultrasonic probe 20 while holding it with their hand, so that the contact surface of the ultrasonic probe 20 is within the frame displayed on the display 40 of the contact surface determination device 1a.

[0065] In step S24, the contact surface determination function 157 of the contact surface determination device 1a determines from the superimposed image of the camera 50 whether or not the contact surface of the ultrasonic probe 20 is within the frame line. If the contact surface is within the frame line (YES in step S24), the processing circuit 15b proceeds to the processing in step S25. If the contact surface is not within the frame line (NO in step S24), the processing circuit 15b returns to the processing in step S23.

[0066] In step S25, the contact surface determination function 157 of the contact surface determination device 1a determines whether the contact surface of the ultrasonic probe 20 is in a state where element checking is possible, if the contact surface of the ultrasonic probe 20 is within the frame line. The contact surface determination function 157 determines whether or not foreign matter such as ultrasound gel is attached to the contact surface, for example, by pattern matching with a normal example or by using AI (deep learning, etc.).

[0067] If the contact surface of the ultrasonic probe 20 is in a state where element checking is possible (YES in step S25), the contact surface determination device 1a proceeds to the process in step S27. If the contact surface of the ultrasonic probe 20 is not in a state where element checking is possible (NO in step S25), the processing circuit 15b proceeds to the process in step S26.

[0068] In step S26, the display control function 154 of the contact surface determination device 1a displays on the display 40 that the element check is not possible and the reason why. Specifically, the display 40 displays that the element check is not possible and the reason why. The display 40 displays the condition of the contact surface of the ultrasonic probe 20, for example, "The element check cannot be performed because there is foreign matter attached to the contact surface," or "Please remove the foreign matter from the contact surface." Then, the contact surface determination device 1a returns to the determination in step S25.

[0069] In response to the display of the reason why the element check is not possible, the user is expected to take steps to resolve the reason, such as removing foreign matter adhering to the contact surface of the ultrasonic probe 20. This will result in the judgment result of step S25 becoming YES.

[0070] In step S27, the notification transmission function 161 of the contact surface determination device 1a wirelessly transmits a notification to the ultrasound diagnostic device 2a indicating that the element check is ready to be performed when the contact surface of the ultrasound probe 20 becomes ready for element checking. This wireless transmission may be performed via a network N such as the Internet as shown in Figure 9, or using short-range communication such as Bluetooth.

[0071] Meanwhile, in step S28, the notification receiving function 160 of the ultrasound diagnostic device 2a determines whether or not it has received a notification that an element check can be performed. If the notification is received (YES in step S28), the processing circuit 15c proceeds to the processing in step S29. If the notification is not received (NO in step S28), the processing circuit 15c repeats the determination in step S28.

[0072] In step S29, the processing circuit 15c of the ultrasound diagnostic device 2a performs an element check. The report creation function 159 then creates a report showing the results of the element check and stores the report in the main memory 16a.

[0073] [Embodiment 4] Embodiment 4 shows an example configuration in which a camera captures images of the contact surface of an ultrasonic probe held in a probe holder.

[0074] Figure 11 is a perspective view showing the external appearance of the ultrasound diagnostic apparatus 2b according to Embodiment 4. As shown in Figure 11, the ultrasound diagnostic apparatus 2b comprises an ultrasound image processing device 10 which is the main body of the apparatus, a lifting device 60, an input interface 30a, and a display 40a.

[0075] The ultrasound image processing device 10 generates ultrasound image data from ultrasound signals collected by the ultrasound probe 20. The ultrasound image processing device 10 also displays the ultrasound image based on the generated ultrasound image data on the display 40a or stores it internally within the ultrasound image processing device 10. The lifting device 60 supports the input interface 30a and the display 40a so that they can be raised and lowered in both manual and electric modes. The manual handle 62 is fixed, for example, to the bottom of the input interface 30a and is operated in manual mode. The probe holder 25 is capable of holding the ultrasound probe 20. The probe holder 25 is an example of a holding part.

[0076] Camera 50a is positioned and oriented to capture images of the contact surface of the ultrasound probe 20 held by the probe holder 25. Specifically, camera 50a is attached to the upper right side of the display 40a and is oriented diagonally downwards toward the contact surface of the ultrasound probe 20. Since camera 50a is dedicated to contact surface detection, its position and orientation are fixed. The probe holder 25 is also positioned so that the contact surface of the ultrasound probe 20 held by the probe holder 25 faces toward camera 50a.

[0077] If the camera 50a is not used exclusively for contact surface determination but also for other purposes, the camera 50a may be moved or rotated so that it faces the contact surface of the ultrasound probe 20 when the user sets the ultrasound probe 20 in the probe holder 25. Alternatively, the probe holder 25 may be rotated so that the contact surface of the set ultrasound probe 20 faces the camera 50a. Furthermore, at least one of the orientations of the camera 50a and the probe holder 25 may be adjusted so that the contact surface of the ultrasound probe 20 falls within the frame in the superimposed image, which is created by superimposing a frame onto the optical image of the camera 50a. Note that the frame is not mandatory; it is sufficient if the contact surface of the ultrasound probe 20 can be captured even without the frame.

[0078] According to this, by setting the ultrasound probe 20 in the probe holder 25, the camera 50a can capture images of the contact surface of the ultrasound probe 20, so the user does not need to adjust the position or orientation of the ultrasound probe 20.

[0079] Furthermore, when the user sets the ultrasonic probe 20 in the probe holder 25, the contact surface determination function 157 may determine the condition of the contact surface of the ultrasonic probe 20. Once the ultrasonic probe 20 is set in the probe holder 25, it will be used again. As described above, by determining the condition of the contact surface before reuse and resolving any abnormal conditions, the element check of the ultrasonic probe 20 can be performed smoothly, and consequently, the ultrasonic probe 20 can be reused smoothly. The camera 50a may also be configured to follow the ultrasonic probe 20 while taking pictures.

[0080] According to at least one embodiment described above, the condition of the contact surface of the ultrasonic probe can be automatically determined.

[0081] Note that the image acquisition function 156 is an example of an image acquisition unit. The contact surface determination function 157 is an example of a contact surface determination unit. The transducer determination function 158 is an example of a transducer determination unit. The notification reception function 160 is an example of a notification reception unit. The notification transmission function 161 is an example of a notification transmission unit.

[0082] While several embodiments have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These embodiments can be implemented in a variety of other forms, and various omissions, substitutions, modifications, and combinations of embodiments are possible without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims and their equivalents. [Explanation of symbols]

[0083] 1, 1a...Contact surface determination device 2, 2a, 2b... Ultrasound diagnostic equipment 20… Ultrasound probe 25…Probe folder 40, 40a… Display 50, 50a... Camera 154, 155... Display control function 156…Image acquisition function 157…Contact surface determination function 158...Oscillator detection function 160... Notification receiving function 161... Notification sending function

Claims

1. An image acquisition unit that acquires an image including the contact surface of the ultrasound probe, A contact surface determination unit that determines the state of the contact surface of the ultrasonic probe based on the aforementioned image, A contact surface determination device equipped with the following features.

2. The contact surface determination unit determines whether or not foreign matter is attached to the contact surface of the ultrasonic probe with the subject. The contact surface determination device according to claim 1.

3. Ultrasound probe and An image acquisition unit that acquires an image including the contact surface of the ultrasonic probe, A contact surface determination unit that determines the state of the contact surface of the ultrasonic probe based on the aforementioned image, A transducer determination unit that determines the state of the transducer of the ultrasonic probe when the condition of the contact surface of the ultrasonic probe is normal, An ultrasound diagnostic device equipped with the following features.

4. The system further includes a display unit that indicates that the state of the transducer of the ultrasonic probe cannot be determined if the contact surface of the ultrasonic probe is not in a normal state. The ultrasound diagnostic apparatus according to claim 3.

5. The display unit further displays the condition of the contact surface of the ultrasonic probe if the condition of the contact surface of the ultrasonic probe is not normal. The ultrasound diagnostic apparatus according to claim 4.

6. The system further comprises an imaging unit that captures the ultrasonic probe and generates the image, The contact surface determination unit determines the state of the contact surface of the ultrasonic probe based on the image when the contact surface of the ultrasonic probe is within a predetermined imaging area of ​​the imaging unit. The ultrasound diagnostic apparatus according to claim 5.

7. The display unit provides guidance to ensure that the contact surface of the ultrasonic probe enters a predetermined imaging area. The ultrasound diagnostic apparatus according to claim 6.

8. The ultrasonic probe is further provided with a holding part capable of holding the ultrasonic probe, The imaging unit is installed so as to be able to image the contact surface of the ultrasonic probe held by the holding unit. The ultrasound diagnostic apparatus according to claim 6.

9. An ultrasound diagnostic system comprising an ultrasound diagnostic device equipped with an ultrasound probe, and a contact surface determination device that is communicatively connected to the ultrasound diagnostic device and equipped with an imaging unit, The contact surface determination device is An image acquisition unit that acquires an image including the contact surface of the ultrasonic probe, A contact surface determination unit that determines the state of the contact surface of the ultrasonic probe based on the aforementioned image, A notification transmission unit that transmits the state of the contact surface of the ultrasonic probe to the ultrasonic diagnostic device, Equipped with, The aforementioned ultrasound diagnostic device is A notification receiving unit that receives the state of the contact surface of the ultrasonic probe from the contact surface determination device, A transducer determination unit that, upon receiving the state of the contact surface of the ultrasonic probe, determines the state of the transducer of the ultrasonic probe, A display control unit that controls the output of the determination result of the state of the transducer of the ultrasonic probe, An ultrasound diagnostic system equipped with [specific features / equipment].

Images