Ultrasonic diagnostic apparatus and program

Abstract

To improve usability.SOLUTION: An ultrasonic diagnostic apparatus includes a determination unit and an acquisition unit. The determination unit determines of which cross section first ultrasonic image data set as a reference image in an examination including ultrasonic image acquisition processing is. The acquisition unit acquires information for a user to acquire the cross section determined by the determination unit, and stores the acquired information in a storage unit in association with the first ultrasonic image data.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The embodiments disclosed in the present specification and drawings relate to an ultrasound diagnostic apparatus and a program. [Background technology]

[0002] In ultrasound diagnostic devices, a so-called protocol assistant is known that has a function for registering in advance an examination procedure corresponding to the examination subject, and a function for displaying the registered examination procedure on a screen and operating the ultrasound diagnostic device in accordance with the examination procedure.

[0003] By using the Protocol Assistant, it is possible to register in advance the standard examination procedure for a specific examination subject. By operating each function of the ultrasound diagnostic device according to the registered procedure and performing the examination, it is possible to reduce examination errors such as incorrect operation of the ultrasound diagnostic device or omission of examination procedures.

[0004] Here, the protocol assistant may have a function of displaying a cross-sectional image to be acquired in the next examination procedure as a reference image. The user compares the reference image with the current scan image and adjusts the position and angle of the ultrasound probe.

[0005] However, the decision on how to adjust the position and angle of the ultrasound probe is left to the user. Depending on the level of knowledge of the user, it may be difficult to make an accurate decision and to obtain a desired cross-sectional image. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2005-270424 A [Patent Document 2] JP 2001-137237 A [Patent Document 3] Patent Publication No. 2022-127808 Summary of the Invention [Problem to be solved by the invention]

[0007] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to improve usability. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described later can also be positioned as other problems. [Means for solving the problem]

[0008] The ultrasound diagnostic device according to the embodiment includes a determination unit and an acquisition unit. The determination unit determines which cross section the first ultrasound image data set as a reference image in an examination including an acquisition process of an ultrasound image is image data for. The acquisition unit acquires information for a user to acquire the cross section determined by the determination unit, and stores the acquired information in a storage device in association with the first ultrasound image data. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an ultrasound diagnostic apparatus according to an embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of a display screen of the protocol assistant in the ultrasound diagnostic apparatus according to the first embodiment. [Diagram 3] FIG. 3 is a flowchart showing a process flow in the ultrasound diagnostic apparatus according to the first embodiment. [Figure 4] FIG. 4 is a diagram showing an outline of the processing in the ultrasonic diagnostic apparatus according to the first embodiment. [Diagram 5] FIG. 5 is a diagram showing an example of a reference camera image displayed by the ultrasound diagnostic apparatus according to the first embodiment. [Figure 6] FIG. 6 is a diagram showing an example of a schematic diagram displayed by the ultrasound diagnostic apparatus according to the first embodiment. [Figure 7]FIG. 7 is a diagram showing an example of a screen displayed by the ultrasound diagnostic apparatus according to the first embodiment. [Figure 8] FIG. 8 is a diagram showing an example of a screen displayed by the ultrasound diagnostic apparatus according to the first embodiment. [Figure 9] FIG. 9 is a diagram showing an example of a screen displayed by the ultrasound diagnostic apparatus according to the first embodiment. [Figure 10] FIG. 10 is a diagram showing an example of a screen displayed by the ultrasound diagnostic apparatus according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] (First embodiment) Hereinafter, an embodiment of an ultrasound diagnostic apparatus and a program will be described in detail with reference to the drawings.

[0011] First, the configuration of an ultrasonic diagnostic apparatus according to the first embodiment will be described. Fig. 1 is a block diagram showing an example of the configuration of an ultrasonic diagnostic apparatus according to the first embodiment. As shown in Fig. 1, the ultrasonic diagnostic apparatus according to the first embodiment includes an ultrasonic probe 5 and an ultrasonic diagnostic apparatus 10. The ultrasonic diagnostic apparatus 10 includes a transmission circuit 9, a reception circuit 11, and a medical image processing apparatus 100.

[0012] The ultrasonic probe 5 has a plurality of piezoelectric transducers, which generate ultrasonic waves based on a drive signal supplied from a transmission circuit 9 of the ultrasonic diagnostic device 10 described later. The plurality of piezoelectric transducers of the ultrasonic probe 5 receive reflected waves from the subject P and convert them into electrical signals (reflected wave signals). The ultrasonic probe 5 also has a matching layer provided on the piezoelectric transducers, a backing material that prevents ultrasonic waves from propagating backward from the piezoelectric transducers, and the like. The ultrasonic probe 5 is detachably connected to the ultrasonic diagnostic device 10.

[0013] When ultrasonic waves are transmitted from the ultrasonic probe 5 to the subject P, the transmitted ultrasonic waves are successively reflected by discontinuous surfaces of acoustic impedance in the internal tissues of the subject P, and are received as reflected waves by a plurality of piezoelectric transducers of the ultrasonic probe 5, and converted into reflected wave signals. The amplitude of the reflected wave signal depends on the difference in acoustic impedance at the discontinuous surfaces where the ultrasonic waves are reflected. When the transmitted ultrasonic pulse is reflected by the surface of a moving blood flow, heart wall, or the like, the reflected wave signal undergoes a frequency shift due to the Doppler effect depending on the velocity component of the moving body in the ultrasonic transmission direction.

[0014] The embodiment is applicable whether the ultrasonic probe 5 is a 1D array probe that scans the subject P two-dimensionally, or a mechanical 4D probe or a 2D array probe that scans the subject P three-dimensionally.

[0015] The ultrasonic diagnostic device 10 is a device that generates ultrasonic image data based on a reflected wave signal received from the ultrasonic probe 5. The ultrasonic diagnostic device 10 shown in Fig. 1 is a device that can generate two-dimensional ultrasonic image data based on a two-dimensional reflected wave signal, and can generate three-dimensional ultrasonic image data based on a three-dimensional reflected wave signal. However, the embodiment is also applicable to cases where the ultrasonic diagnostic device 10 is a device dedicated to two-dimensional data.

[0016] As shown in FIG. 1, the ultrasound diagnostic apparatus 10 includes a transmission circuit 9, a reception circuit 11, and a medical image processing apparatus 100.

[0017] The transmission circuit 9 and the reception circuit 11 control the transmission and reception of ultrasonic waves by the ultrasonic probe 5 based on instructions from a processing circuit 110 having a control function 110f described later. The transmission circuit 9 has a pulse generator, a transmission delay unit, a pulser, etc., and supplies a drive signal to the ultrasonic probe 5. The pulse generator repeatedly generates rate pulses for forming a transmission ultrasonic wave at a predetermined pulse repetition frequency (PRF: Pulse Repetition Frequency).

[0018] The transmission delay unit focuses the ultrasonic waves generated from the ultrasonic probe 5 into a beam shape and provides a delay time for each piezoelectric transducer required to determine the transmission directivity to each rate pulse generated by the pulse generator. The pulser applies a drive signal (drive pulse) to the ultrasonic probe 5 at a timing based on the rate pulse.

[0019] That is, the transmission delay unit arbitrarily adjusts the transmission direction of the ultrasonic waves transmitted from the piezoelectric transducer surface by changing the delay time given to each rate pulse. Also, the transmission delay unit controls the position of the focal point (transmission focus) in the depth direction of the ultrasonic transmission by changing the delay time given to each rate pulse.

[0020] The transmission circuit 9 has a function of instantaneously changing the transmission frequency, transmission drive voltage, etc., in order to execute a predetermined scan sequence based on instructions from the processing circuit 110 described later. In particular, the change in the transmission drive voltage is realized by a linear amplifier type oscillation circuit that can instantaneously switch its value, or a mechanism that electrically switches between multiple power supply units.

[0021] The receiving circuit 11 has an amplifier circuit, an A / D (Analog / Digital) converter, a reception delay circuit, an adder, a quadrature detection circuit, etc., and performs various processes on the reflected wave signal received from the ultrasonic probe 5 to generate a received signal (reflected wave data). The amplifier circuit amplifies the reflected wave signal for each channel and performs a gain correction process. The A / D converter A / D converts the gain-corrected reflected wave signal. The reception delay circuit provides the digital data with a reception delay time required to determine the reception directivity. The adder performs an addition process of the reflected wave signal to which the reception delay time has been provided by the reception delay circuit. The addition process of the adder emphasizes the reflected component from the direction according to the reception directivity of the reflected wave signal. Then, the quadrature detection circuit converts the output signal of the adder into an in-phase signal (I signal, I: In-phase) and a quadrature signal (Q signal, Q: Quadrature-phase) of the baseband. Then, the quadrature detection circuit transmits the I signal and the Q signal (hereinafter referred to as IQ signal) to the processing circuit 110 as a received signal (reflected wave data). The quadrature detection circuit may convert the output signal of the adder into an RF (Radio Frequency) signal and transmit it to the processing circuit 110. The IQ signal and the RF signal become received signals having phase information.

[0022] When scanning a two-dimensional region in the subject P, the transmission circuit 9 causes the ultrasonic probe 5 to transmit an ultrasonic beam for scanning the two-dimensional region. Then, the reception circuit 11 generates a two-dimensional reception signal from the two-dimensional reflected wave signal received from the ultrasonic probe 5. When scanning a three-dimensional region in the subject P, the transmission circuit 9 causes the ultrasonic probe 5 to transmit an ultrasonic beam for scanning the three-dimensional region. Then, the reception circuit 11 generates a three-dimensional reception signal from the three-dimensional reflected wave signal received from the ultrasonic probe 5. The reception circuit 11 generates a reception signal based on the reflected wave signal, and transmits the generated reception signal to the processing circuit 110.

[0023] The transmission circuit 9 causes the ultrasonic probe 5 to transmit an ultrasonic beam from a predetermined transmission position (transmission scanning line). The reception circuit 11 receives a signal due to a reflected wave of the ultrasonic beam transmitted by the transmission circuit 9 from the ultrasonic probe 5 at a predetermined reception position (reception scanning line). When parallel simultaneous reception is not performed, the transmission scanning line and the reception scanning line are the same scanning line. On the other hand, when parallel simultaneous reception is performed, when the transmission circuit 9 causes the ultrasonic probe 5 to transmit one ultrasonic beam on one transmission scanning line, the reception circuit 11 simultaneously receives the signal due to the reflected wave originating from the ultrasonic beam transmitted by the transmission circuit 9 to the ultrasonic probe 5 as multiple reception beams at multiple predetermined reception positions (reception scanning lines) through the ultrasonic probe 5.

[0024] The medical image processing device 100 is connected to a transmission circuit 9 and a reception circuit 11, and processes signals received from the reception circuit 11 and controls the transmission circuit 9. The medical image processing device 100 includes a processing circuit 110, a storage device 132, an input device 134, and a display 135. The processing circuit 110 includes a B-mode processing function 110a, a Doppler processing function 110b, an acquisition function 110c, a display control function 110d, a registration function 110e, a control function 110f, a determination function 110g, and a generation function 110h.

[0025] In the embodiment, each processing function and learned model performed by the B-mode processing function 110a, the Doppler processing function 110b, the acquisition function 110c, the display control function 110d, the registration function 110e, the control function 110f, the judgment function 110g, and the generation function 110h are stored in the storage device 132 in the form of a program executable by a computer. The processing circuit 110 is a processor that realizes the function corresponding to each program by reading and executing the program from the storage device 132. In other words, the processing circuit 110 in a state in which each program has been read has each function shown in the processing circuit 110 in FIG. 1. Note that, in FIG. 1, the function of the processing circuit 110 is described as being realized by a single processing circuit, but the processing circuit 110 may be configured by combining multiple independent processors, and each processor may realize the function by executing a program. In other words, each of the above-mentioned functions may be configured as a program, and one processing circuit may execute each program. In addition, two or more functions of the functions of the processing circuit 110 may be realized by a single processing circuit. As another example, certain functions may be implemented in dedicated, separate program execution circuitry.

[0026] In addition, in Figure 1, the B-mode processing function 110a, the Doppler processing function 110b, the acquisition function 110c, the display control function 110d, the registration function 110e, the control function 110f, the judgment function 110g, and the generation function 110h are examples of the B-mode processing unit, the Doppler processing unit, the acquisition unit, the display control unit, the registration unit, the control unit, and the judgment unit, respectively.

[0027] The term "processor" used in the above description means a circuit such as a CPU (Central Processing Unit), a GPU (Graphical Processing Unit), an Application Specific Integrated Circuit (ASIC), a programmable logic device (e.g., a Simple Programmable Logic Device (SPLD), a Complex Programmable Logic Device (CPLD), and a Field Programmable Gate Array (FPGA)). The processor realizes functions by reading and executing a program stored in the storage device 132.

[0028] Also, instead of storing the program in the storage device 132, the program may be directly built into the circuit of the processor. In this case, the processor realizes the function by reading and executing the program built into the circuit. The transmission circuit 9, reception circuit 11, etc. built into the ultrasound diagnostic device 10 may be configured as hardware such as an integrated circuit, but may also be a modularized program in software.

[0029] The processing circuitry 110 is a processing unit that performs various signal processing on the reception signal received from the reception circuitry 11. The processing circuitry 110 has a B-mode processing function 110a, a Doppler processing function 110b, an acquisition function 110c, a display control function 110d, a registration function 110e, a control function 110f, and a determination function 110g.

[0030] The acquisition function 110c, the registration function 110e, and the determination function 110h will be described in detail later.

[0031] The processing circuit 110 receives data from the receiving circuit 11 using the B-mode processing function 110a, and performs logarithmic amplification processing, envelope detection processing, logarithmic compression processing, etc. to generate data (B-mode data) in which the signal intensity is expressed as brightness (luminance).

[0032] In addition, the processing circuit 110 uses the Doppler processing function 110b to perform frequency analysis of velocity information from the received signal (reflected wave data) received from the receiving circuit 11, and generates data (Doppler data) extracted from multiple points of moving object information such as velocity, dispersion, power, etc. due to the Doppler effect.

[0033] 1, both two-dimensional reflected wave data and three-dimensional reflected wave data can be processed. The processing circuitry 110 controls the display control function 110d to display the ultrasound image data for display stored in the storage device 132 on the display 135.

[0034] The processing circuitry 110 controls the overall processing of the ultrasonic diagnostic apparatus by the control function 110f. Specifically, the processing circuitry 110 controls the processing of the transmission circuitry 9, the reception circuitry 11, and the processing circuitry 110 based on various setting requests input by the operator via the input device 134 and various control programs and various data read from the storage device 132 by the control function 110f.

[0035] The processing circuit 110 generates ultrasound image data from the data generated by the B-mode processing function 110a and the Doppler processing function 110b using the generation function 110h. The processing circuit 110 generates two-dimensional B-mode image data, which expresses the intensity of the reflected wave as brightness, from the two-dimensional B-mode data generated by the B-mode processing function 110a using the generation function 110h. The processing circuit 110 also generates two-dimensional Doppler image data, which expresses moving object information, from the two-dimensional Doppler data generated by the Doppler processing function 110b using the generation function 110h. The two-dimensional Doppler image data is velocity image data, variance image data, power image data, or image data that is a combination of these.

[0036] Moreover, the processing circuit 110 converts (scan converts) the scan line signal sequence of the ultrasonic scan into a scan line signal sequence of a video format represented by a television or the like, using the generation function 110h, and generates ultrasonic image data for display. Furthermore, the processing circuit 110 performs various image processing other than scan conversion, such as image processing (smoothing processing) for regenerating an average brightness image using multiple image frames after scan conversion, and image processing (edge ​​enhancement processing) using a differential filter within an image, using the generation function 110h. Furthermore, the processing circuit 110 performs various rendering processing on the volume data to generate two-dimensional image data for displaying the volume data on the display 135, using the generation function 110h.

[0037] The storage device 132 is composed of a semiconductor memory element such as a RAM (Random Access Memory), a flash memory, a hard disk, an optical disk, etc. The storage device 132 is a memory that stores data such as image data for display generated by the processing circuit 110. The storage device 132 can also store data generated in the B-mode processing function 110a and the Doppler processing function 110b. The B-mode data and Doppler data stored in the storage device 132 can be called up by an operator after diagnosis, for example, and become ultrasonic image data for display via the processing circuit 110. The storage device 132 can also store a reception signal (reflected wave data) output by the receiving circuit 11.

[0038] In addition, the storage device 132 stores, as necessary, control programs for performing ultrasound transmission and reception, image processing, and display processing, as well as various data such as diagnostic information (e.g., patient ID, doctor's findings, etc.), diagnostic protocols, and various body marks.

[0039] The input device 134 receives various instructions and information input from an operator. The input device 134 is, for example, a pointing device such as a mouse or a trackball, a selection device such as a mode changeover switch, or an input device such as a keyboard.

[0040] The display 135 displays a GUI (Graphical User Interface) for receiving input of imaging conditions and images generated by the generation function 110h under the control of the control function 110f, etc. The display 135 is, for example, a display device such as a liquid crystal display. The display 135 is an example of a display unit. The display 135 has a mouse, a keyboard, a button, a panel switch, a touch command screen, a foot switch, a trackball, a joystick, etc.

[0041] Next, the background of the embodiment will be described.

[0042] In ultrasound diagnostic devices, a so-called protocol assistant is known that has a function for registering an examination procedure according to an examination subject in advance, and a function for displaying the registered examination procedure on a screen and operating the ultrasound diagnostic device according to the examination procedure. Figure 2 shows an example of the display screen of the protocol assistant that supports the settings of an ultrasound diagnosis.

[0043] As an example, the display screen displayed by the Protocol Assistant 80 includes a setting user interface 70, an image 50 which is an ultrasound image, and a reference image 51 which is a reference ultrasound image. The image 50 is an ultrasound image of the actual imaging performed based on the settings of the Protocol Assistant 80, and the reference image 51 is a reference ultrasound image set by the Protocol Assistant 80 and used as a reference by the user when performing the actual imaging. The setting user interface 70 is a setting user interface for setting the reference ultrasound image and other settings.

[0044] By using the Protocol Assistant, it is possible to register in advance the examination procedure that will be the standard for the examination depending on the specific examination subject. By operating each function of the ultrasound diagnostic device 10 according to the registered procedure and performing the examination, it is possible to reduce examination errors such as incorrect operation of the ultrasound diagnostic device 10 and omission of examination procedures. The ultrasound diagnostic device 10 is generally an imaging diagnostic device that is prone to differences in the results obtained depending on the user, but when the Protocol Assistant is used, each user performs the examination based on certain examination standards presented by the Protocol Assistant function, making it less likely that differences in the results will occur depending on the user.

[0045] Here, the protocol assistant may have a function of displaying a cross-sectional image to be acquired in the next examination procedure as a reference image, where the user compares the reference image with the current scan image and adjusts the position and angle of the ultrasound probe.

[0046] However, the decision on how to adjust the position and angle of the ultrasound probe is left to the user. Such decisions require anatomical knowledge, and depending on the user's level of knowledge, accurate decisions may not be possible, making it difficult to visualize the desired cross-sectional image.

[0047] The embodiment is based on such a background, and an ultrasound diagnostic device 10 according to the embodiment includes a processing circuit 110. The processing circuit 110 determines, by a determination function 110g, which cross section the first ultrasound image data set as a reference image in an examination including an ultrasound image acquisition process is image data of. The processing circuit 110 obtains, by an acquisition function 110c, information for a user to acquire the determined cross section, and stores the obtained information in the storage device 132 in association with the first ultrasound image data.

[0048] Moreover, in the ultrasound diagnostic device 10 according to the embodiment, the processing circuitry 110 includes a display control function 110d. When the processing circuitry 110 accepts execution of an examination procedure in an examination including acquisition processing of a registered ultrasound image by the display control function 10d, the processing circuitry 110 causes the display 135 as a display unit to display a list of the examination procedures in the order of execution. When the examination procedure is executed by the display control function 10d, the processing circuitry 110 causes the display 135 as a display unit to display information for a user to acquire a cross section of the first ultrasound image data, which is linked to the first ultrasound image data set as a reference image in the examination, from the storage device 132.

[0049] In addition, the program according to the embodiment causes a computer to execute a process of determining which cross section the first ultrasound image data set as a reference image in an examination including an ultrasound image acquisition process corresponds to, acquiring information for a user to acquire the determined cross section, and linking the acquired information to the first ultrasound image data and storing it in a storage device.

[0050] Such a configuration will be described using Fig. 3 while also referring to Fig. 4 to Fig. 9 as appropriate. Fig. 3 is a diagram illustrating the flow of processing executed by the ultrasonic diagnostic device 10 according to the first embodiment. Fig. 4 is a diagram outlining the processing executed by the ultrasonic diagnostic device according to the first embodiment.

[0051] In FIG. 3, steps S200 to S230 describe the processing in the setting stage of the examination procedure for an ultrasonic examination of a subject, steps S100 to S120 describe the processing for acquiring a reference image to be used in the setting stage, and steps S300 to S310 describe the execution stage of the ultrasonic examination of a subject.

[0052] First, the process for acquiring a reference image will be described. In step S100, the ultrasound diagnostic device 10 executes a first ultrasound scan using the transmission circuitry 9 and the reception circuitry 11 to cause the ultrasound probe 5 to scan a cross section of a subject with ultrasound, and acquires an echo signal. The processing circuitry 110 acquires the acquired echo signal using the acquisition function 110c. The processing circuitry 110 generates an ultrasound tomographic image based on the acquired echo signal using the generation function 110h.

[0053] Next, in step S110, the processing circuit 110 transmits first ultrasonic image data relating to the ultrasonic tomographic image generated in step S100 to the storage device 132. The storage device 132 stores the received first ultrasonic image data. This first ultrasonic image data is ultrasonic tomographic data that is the basis for generating a reference image, which will be described later.

[0054] Next, in step S120, the processing circuitry 110 causes the registration function 110e to register the information of the stored first ultrasound image data in association with information of the performed scan.

[0055] Next, the process of the setting stage of the examination procedure of the ultrasonic examination of the subject will be described. As an example, the ultrasonic diagnostic device 10 sets the examination procedure of the ultrasonic examination of the subject by the protocol assistant 80 that supports the setting of the ultrasonic diagnosis. The protocol assistant 80 is realized by using various functions of the processing circuit 110, such as the acquisition function 110c, the display control function 110d, the registration function 110e, the judgment function 110g, the generation function 110h, and the like. Typically, the display screen displayed by the protocol assistant 80 is, as described above, composed of, for example, a setting user interface 70, an image 50 which is an ultrasonic image, and a reference image 51 which is an ultrasonic image for reference. Here, the image 50 is an ultrasonic image of the actual imaging performed based on the setting of the protocol assistant 80, and the reference image 51 is an ultrasonic image for reference set by the protocol assistant 80 for the user to refer to when the user performs the actual imaging. The setting user interface 70 is a setting user interface for setting the reference ultrasonic image and other settings.

[0056] In step S200, prior to the second ultrasound scan, which is an ultrasound examination of the subject, the user registers an examination procedure according to the examination target in advance using the setting user interface 70. For example, as shown in Fig. 4, the user registers first ultrasound image data associated with the examination procedure using the setting user interface 70 as the protocol editor 20. Here, the first ultrasound image data is ultrasound image data set as a reference image in an examination including an acquisition process of an ultrasound image.

[0057] Specifically, the processing circuit 110 receives an examination procedure corresponding to the examination object from the user through the setting user interface 70 by the display control function 110d and the registration function 110e. As an example, the processing circuit 110 receives an input of the part of the examination object from the user by the display control function 110d. The processing circuit 110, which receives the input of the examination object, displays candidates of imaging protocols related to the examination object on multiple display screens by the display control function 110d, and receives a selection of the imaging protocol from the user. The processing circuit 110 determines an examination procedure based on the selected imaging protocol by the registration function 110e, and registers the determined examination procedure as an examination procedure corresponding to the examination object. The processing circuit 110 also acquires the first ultrasound image data, which is associated with the examination procedure and set as a reference image, based on the association between the first ultrasound scan and the ultrasound image data registered in step S120 by the registration function 110e.

[0058] In step S210, the processing circuitry 110 causes the display control function 110d to display the examination procedure registered in step S200 on the display 135, and also operates the ultrasound diagnostic apparatus 10 based on the examination procedure that has been determined.

[0059] Next, in step S220, the processing circuit 110 uses the determination function 110g to determine which cross-section the first ultrasonic tomographic data registered in step S200 and set as a reference image is, as shown in block 220 of FIG. 4. As an example of a method for automatically determining a cross-section, the processing circuit 110 uses the determination function 110g to determine the cross-section based on a trained model that has been trained with a label by machine learning. As an example, the processing circuit 110 uses the determination function 110g to compare the feature amount of the trained labeled cross-section data with the input image, and assigns a label of cross-section data having similar features to the input image.

[0060] Next, in step S230, the processing circuit 110 acquires, by the acquisition function 110c, information for the user to acquire the slice determined by the determination function 110g in step S220, and stores the acquired information in the storage device 132 in association with the first ultrasound image data. As an example, as shown in box 230 in Fig. 4, the processing circuit 110 acquires, by the acquisition function 110c, information for the user to acquire the slice determined by the determination function 110g in step S220, as information that helps the user to perform the examination procedure. Here, the information for the user to acquire the slice includes, for example, at least one of a scan position for acquiring the slice, a scanning direction of the ultrasound probe, or an anatomical schematic diagram.

[0061] Here, the information including the scan position for acquiring the cross section is, for example, information indicating that the probe is scanned at a predetermined position of the apex of the heart. As another example, the scan position for acquiring the cross section is, for example, information indicating that the probe is moved to the apex of the heart and the ultrasonic beam is significantly tilted toward the base of the heart to perform the scan. The processing circuit 110 acquires this information by the acquisition function 110c, for example, based on the position of the cross section acquired in step S220.

[0062] An example of the information including the scanning strategy of the ultrasound probe is an image 40 that visually represents a desired scanning position and angle, as shown in Fig. 5. The processing circuit 110 generates the image 40 by the acquisition function 110c based on the position of the cross section obtained in step S220.

[0063] An example of a method for generating the image 40 will be described. Returning to step S100, the processing circuit 110 acquires, by the acquisition function 110c, first relative position information between the ultrasonic probe 5 and the subject when the first ultrasonic image data is acquired. As an example, the processing circuit 110 acquires, by the acquisition function 110c, a first camera image capturing the position of the ultrasonic probe 5 and the subject when the first ultrasonic image data is acquired. In step S230, the processing circuit 110 generates the first camera image as the image 40 by the acquisition function 110c. As a result, in step S230, the processing circuit 110 acquires, by the acquisition function 110c, information for the user to acquire the cross section using the first camera image capturing the position of the ultrasonic probe 5 and the subject when the first ultrasonic image data is acquired. As a result, the processing circuit 110 can acquire, by the acquisition function 110c, a first camera image, which is the first relative position information between the ultrasound probe 5 and the subject when the first ultrasound image data is acquired, as information for the user to acquire the cross-section.

[0064] Moreover, an example of an anatomical diagram 41 is shown in Fig. 6. In Fig. 6, the anatomical diagram 41 is a diagram in which the position 43 of the ultrasound probe 5 and the scanning range 44 are superimposed on a schematic diagram of a heart 45. The processing circuit 110 generates the anatomical diagram 41 by the acquisition function 110c based on the position of the cross section obtained in step S220.

[0065] An example of a method for generating the anatomical schematic diagram 41 will be described. Returning to step S100, the processing circuitry 110 acquires, by the acquisition function 110c, first relative position information between the ultrasound probe 5 and the subject when the first ultrasound image data is acquired. As an example, the processing circuitry 110 acquires information on the position and angle of the ultrasound probe 5 from a position sensor, a pressure sensor, a camera image, etc., when the first ultrasound scan for acquiring the first ultrasound image data is performed by the acquisition function 110c.

[0066] In step S120, the processing circuitry 110 uses the registration function 110e to register information on the position and angle of the ultrasound probe 5 during the acquired first ultrasound scan in association with the first ultrasound image data, which is data of the reference image.

[0067] In step S230, the processing circuit 110 generates, by the acquisition function 110c, an anatomical diagram 41, which is information for the user to acquire the cross-section determined in step S220, using information obtained from a position sensor or pressure sensor or a camera image when the first ultrasound scan for acquiring the first ultrasound data performed in step S100.

[0068] Next, the processing of steps S300 and S310, which are processing of the execution stage of the ultrasound examination, will be described. In step S300, the ultrasound diagnostic device 10 starts ultrasound scanning of the subject as the main imaging, which is the second ultrasound scan. Specifically, the ultrasound diagnostic device 10 uses the transmission circuitry 9 and the reception circuitry 11 to make the ultrasound probe 5 scan the cross section of the subject with ultrasound and acquires echo signals of the main imaging. The processing circuitry 110 acquires the acquired echo signals by the acquisition function 110c. The processing circuitry 110 generates second ultrasound image data based on the acquired echo signals by the generation function 110h. In addition, when the processing circuitry 110 accepts the execution of an examination procedure in an examination including the acquisition process of a registered ultrasound image by the display control function 110d, it causes the display 135 as a display unit to display a list of the examination procedures in the order of execution.

[0069] In step S310, the processing circuit 110 causes the display control function 110d to display on the examination screen the image registered by the registration function 110e in step S200 and the information acquired by the acquisition function 110c in step S230. That is, as shown in box 310 in Fig. 4, the processing circuit 110 causes the display control function 110d to display the second ultrasound image data obtained by the second ultrasound scan and information for the user to acquire the cross section determined in step S220 (i.e., information acquired in step S230 that helps the user perform the examination procedure) on the display 135 as a display unit.

[0070] Examples of such processing are shown in Figures 7 to 9. Figure 7 shows an example of a display screen that the processing circuitry 110 causes the display control function 110d to display on the display 135 in step S310 in the case where the information acquired in step S230 for the user to acquire the cross section determined in step S220 is an image 40 visually representing the scanning position and angle of the ultrasonic probe 5 desired for performing the target examination.

[0071] When the execution of the examination registered in step S300 is accepted, in step S310, the processing circuitry 110 causes the display control function 110d to display a list of a plurality of examination procedures in the order of execution on the display 135 as a display unit. The processing circuitry 110 causes the display control function 110d to display second ultrasound image data obtained by the second scan, which is the main imaging, as the image 50 on the display 135. That is, the processing circuitry 110 causes the display control function 110d to display the second ultrasound image data acquired during the execution of the examination procedure on the display 135 as a display unit.

[0072] Moreover, the processing circuitry 110 causes the display control function 110d to display the reference image registered in step S200 on the display 135 as the reference image 51. Moreover, the processing circuitry 110 causes the display control function 110d to display, in the display area 52, information for the user to obtain the cross section determined in step S220, i.e., information obtained in step S230 and useful for the user to perform the examination procedure.

[0073] That is, when the examination procedure is executed, the processing circuit 110, by the display control function 110d, obtains information for the user to obtain the cross section determined in step S220, which is linked to the first ultrasound image data, from the storage device 132, and displays it on the display 135 as a display unit. Specifically, the processing circuit 110, by the display control function 110d, displays an image 40 visually representing the scan position and angle of the ultrasound probe 5 desirable for performing the target examination, in the display area 52. In addition, the processing circuit 110, by the display control function 110d, displays information to the effect that "move the probe to the apex and greatly tilt the ultrasound beam toward the base of the heart", which is information giving instructions to the user regarding how the user should move the ultrasound probe 5 to achieve the desirable scan position and angle of the ultrasound probe 5, in the display area 52.

[0074] The display area 52 can be displayed with any coordinates and size.

[0075] FIG. 8 shows an example of a display screen that processing circuit 110 causes display control function 110d to display on display 135 in step S310 when the information for the user to obtain the cross section determined in step S220, which is obtained in step S230, is anatomical schematic diagram 41 shown in FIG. 6.

[0076] When the execution of the examination registered in step S300 is accepted, in step S310, the processing circuitry 110 causes the display control function 110d to display a list of a plurality of examination procedures in the order of execution on the display 135 as a display unit. The processing circuitry 110 causes the display control function 110d to display second ultrasound image data obtained by the second scan, which is the main imaging, as the image 50 on the display 135. That is, the processing circuitry 110 causes the display control function 110d to display the second ultrasound image data acquired during the execution of the examination procedure on the display 135 as a display unit.

[0077] Moreover, the processing circuitry 110 causes the display control function 110d to display the reference image registered in step S200 on the display 135 as the reference image 51. Moreover, the processing circuitry 110 causes the display control function 110d to display, in the display area 52, information for the user to obtain the cross section determined in step S220, i.e., information obtained in step S230 and useful for the user to perform the examination procedure.

[0078] That is, when the examination procedure is executed, the processing circuit 110, by the display control function 110d, obtains information for the user to obtain the cross section determined in step S220, which is linked to the first ultrasound image data, from the storage device 132, and displays it on the display 135 as a display unit. Specifically, the processing circuit 110, by the display control function 110d, displays in the display area 52 an anatomical schematic diagram 41 in which an icon of an ultrasound probe indicating an appropriate position of the ultrasound probe 5 is superimposed on a schematic diagram of the part to be examined. In addition, the processing circuit 110, by the display control function 110d, displays in the display area 52 information to the effect that "move the probe to the apex and tilt the ultrasound beam greatly toward the base of the heart", which is information that gives an instruction to the user regarding how the user should move the ultrasound probe 5 to set the desired scan position and angle of the ultrasound probe 5.

[0079] Moreover, another example of the user interface is shown in Fig. 9. Fig. 9 shows a user interface similar to that of Fig. 7, but shows a case in which the display of the reference image is omitted.

[0080] When the execution of the examination registered in step S300 is accepted, in step S310, the processing circuitry 110 causes the display control function 110d to display a list of a plurality of examination procedures in the order of execution on the display 135 as a display unit. The processing circuitry 110 causes the display control function 110d to display second ultrasound image data obtained by the second scan, which is the main imaging, as an image 50 on the display 135.

[0081] Here, the processing circuit 110 does not display the reference image registered in step S200 as the reference image 51 on the display 135 by the display control function 110d.

[0082] Furthermore, the processing circuit 110, by using the display control function 110d, acquires information for the user to acquire the cross section determined in step S220, which is linked to the first ultrasound image data, from the storage device 132 when the examination procedure is executed, and causes the display 135 as a display unit to display the information. Specifically, the processing circuit 110, by using the display control function 110d, displays, in the display area 52, an image 40 visually representing the scan position and angle of the ultrasound probe 5 that are desirable for performing the target examination. Furthermore, the processing circuit 110, by using the display control function 110d, displays, in the display area 52, information to the effect that "move the probe to the apex and greatly tilt the ultrasound beam toward the base of the heart", which is information that gives instructions to the user regarding how the user should move the ultrasound probe 5 to achieve the desirable scan position and angle of the ultrasound probe 5.

[0083] As described above, in the first embodiment, the ultrasound diagnostic device 10 determines which cross section the registered ultrasound image data is, and obtains information for the user to obtain the determined cross section. This makes it easier for even a user with a low level of knowledge to depict a desired cross section. In addition, by providing a function to automatically determine the cross section of a reference image and automatically assign information, the labor of the user, that is, the imaging protocol creator, is reduced, and usability is improved.

[0084] Second Embodiment The embodiment is not limited to the above-mentioned example. In the second embodiment, a case will be described in which, in step S300, the processing circuit 110 acquires position information of the ultrasonic probe 5 and the like during execution of the second ultrasonic scan by the acquisition function 110c, and performs processing based on the acquired information.

[0085] Specifically, in step S300, the processing circuit 110 acquires second relative position information between the ultrasonic probe 5 and the subject during collection of the second ultrasonic image data by the acquisition function 110c. Specifically, the processing circuit 110 acquires position information or angle information of the ultrasonic probe 5 by, for example, a position sensor, a pressure sensor, a camera image, etc. during execution of the second ultrasonic scan by the acquisition function 110c. Next, in step S310, the processing circuit 110 generates guide information on how to adjust the position and angle of the ultrasonic probe 5 by the generation function 110h based on the difference between the position information, etc. of the ultrasonic probe 5 acquired during collection of the second ultrasonic image data in step S300 and the position information, etc. of the ultrasonic probe 5 in the reference image registered in step S120. As an example, the processing circuit 110 generates, by the generation function 110h, guide information indicating that it is desirable to move the ultrasonic probe 5 in a predetermined direction based on the position information, etc., of the ultrasonic probe 5 during collection of the second ultrasonic image data and the position information, etc., of the ultrasonic probe 5 during collection of the first ultrasonic image data. Then, the processing circuit 110 causes the display 135 to display the generated guide information by the display control function 110d.

[0086] An example of such processing is shown in Fig. 10. In step S310, the processing circuitry 110 causes the display control function 110d to display the second ultrasound image data as an image 50 on the display 135 based on the second position information. The processing circuitry 110 also causes the display control function 110d to display the image 40, which visually represents the desired scan position and angle obtained in step S230, on the display 135. In addition, the processing circuitry 110 causes the display control function 110d to display in the display area 62 guide information obtained by comparing the position information, etc. of the ultrasound probe 5 during the acquisition of the second ultrasound image data with the position information, etc. of the ultrasound probe 5 during the acquisition of the first ultrasound image data.

[0087] The processing circuit 110 may superimpose an icon representing the current position and posture of the ultrasound probe 5 on the first camera image based on the second position information by the display control function 110d. For example, as shown in FIG. 10, the processing circuit 110 may superimpose an icon 63 representing the current position and posture of the ultrasound probe 5 on the image 40 obtained from the first camera image based on the second position information by the display control function 110d. In this way, the processing circuit 110 displays the icon 63 of the ultrasound probe 5 on the image 40, which is the camera image at the time of acquiring the reference image, based on the current position and angle information of the ultrasound probe 5, and can guide the user to acquire the cross section by matching the position of the icon 63 with the position of the probe in the image 40 at the time of acquiring the reference image.

[0088] As described above, in the second embodiment, the position, angle information, etc. of the ultrasonic probe 5 are collected during the execution of the second ultrasonic scan, and guide information is automatically generated based on the collected information. This improves usability.

[0089] (Third embodiment) The embodiment is not limited to the above-mentioned examples. In the third embodiment, a case will be described in which, in step S300, the processing circuit 110 acquires a second camera image by the acquisition function 110c during the execution of the second ultrasonic scan, and performs processing based on the second camera image.

[0090] In step S300, the processing circuit 110 acquires a second camera image by the acquisition function 110c while the second ultrasonic scan is being performed. That is, the processing circuit 110 acquires a second camera image of the ultrasonic probe and the subject during the collection of the second ultrasonic image data by the acquisition function 110c. Next, in step S310, the processing circuit 110 generates guide information by using, for example, AI based on the difference between the second camera image acquired during the collection of the second ultrasonic image data in step S300 and the first camera image in the reference image registered in step S120 by the generation function 110h. As an example, the processing circuit 110 calculates the moving distance of the ultrasonic probe 5 from the second camera image during the collection of the second ultrasonic image data and the first camera image during the collection of the first ultrasonic image data by the generation function 110h, and generates guide information indicating that it is desirable to move the ultrasonic probe 5 in a predetermined direction. Next, the processing circuit 110 causes the display control function 110d to display the generated guide information on the display 135.

[0091] As an example, the processing circuitry 110 may superimpose the first camera image and the second camera image using the display control function 110d, and may guide the user to acquire the cross section by matching the position of the ultrasound probe 5 in the second camera image with the position of the ultrasound probe 5 in the second camera image. As an example, the processing circuitry 110 may superimpose an icon representing the position and posture of the ultrasound probe when the first ultrasound image data was acquired on the second camera image using the display control function 110d, based on the first relative position information of the ultrasound probe 5 and the subject when the first ultrasound image data was acquired.

[0092] As described above, in the third embodiment, the camera image is collected during the execution of the second ultrasonic scan, and the guide information is automatically generated based on the camera image, thereby improving the usability.

[0093] (Other embodiments) The embodiment is not limited to this. For example, in step S230, the processing circuit 110 may use the acquisition function 110c to obtain video data before and after the first ultrasonic scan as information for the user to obtain the cross section determined by the determination unit. That is, the ultrasonic diagnostic device 10 according to the fourth embodiment can show the user the scanning procedure of the ultrasonic probe 5 by the video data. The video data may not be unedited video data, but may be edited data in which unnecessary data is deleted for guiding the ultrasonic probe 5, for example.

[0094] As another embodiment, in the first embodiment, the storage device 132 is included in the medical image processing device 100, but the embodiment is not limited to this. The storage device 132 may be a cloud database, and the ultrasound diagnostic device 10 may refer to the information stored in the cloud database as appropriate. An advantage of using the storage device 132 as a cloud database is that it is easy to update and reflect information. By using the storage device 132 as a cloud, the information obtained in step S230 and used by the user to obtain the cross section determined by the determination function 110g in step S220 can be information stored on the cloud that can be updated based on updates to the diagnostic guideline.

[0095] In another embodiment, when the reference image registered in step S120 is acquired without holding information on the probe position and angle, in step S220, the processing circuitry 110 may automatically determine which cross section the reference image is an image of, using the determination function 110g, and when information on the probe position and angle of the same cross section as the determined cross section is already held in the database stored in the storage device 132, the information may be added to the protocol. That is, the processing circuitry 110 may add the information to the already registered examination procedure information as information on the examination procedure, using the determination function 110g.

[0096] In another embodiment, since the appropriate probe position and angle differ depending on the patient's body shape, the processing circuit 110 may use the registration function 110e to retain information on the position and angle of the ultrasound probe 5 at the time of acquiring the reference image using a position sensor, a pressure sensor, a camera image, etc., and add this information to the protocol, which is then added to the information on the examination procedure that has already been registered in step S120.

[0097] According to at least one of the embodiments described above, usability can be improved.

[0098] Although some embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, and combinations of embodiments can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents as described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]

[0099] 110 Processing circuit 110c acquisition function 110d Display control function 110e Registration Function 110f Control Function 110g judgment function 110h generation function 132 Storage device 134 Input Devices 135 Display

Claims

1. a determination unit that determines which cross section the first ultrasonic image data, which is set as a reference image in an examination including an ultrasonic image acquisition process, corresponds to; an acquisition unit that acquires information for a user to acquire the cross section determined by the determination unit, and stores the acquired information in a storage device in association with the first ultrasonic image data; An ultrasound diagnostic device comprising:

2. The ultrasound diagnostic apparatus according to claim 1 , wherein the information includes at least one of a scan position for acquiring the cross section, a scanning direction of an ultrasound probe, or an anatomical schematic diagram.

3. The ultrasound diagnostic device according to claim 1 , wherein the determination unit determines the cross section based on a trained model that has been trained with a label.

4. the storage device is a cloud; The ultrasound diagnostic apparatus according to claim 1 , wherein the information is stored on the cloud and is updatable based on updates to diagnostic guidelines.

5. 2. The ultrasound diagnostic device according to claim 1, wherein the acquisition unit acquires the information using information obtained from a position sensor or a pressure sensor or a camera image when a first ultrasound scan is performed to acquire the first ultrasound image data.

6. a display control unit that, when accepting the execution of the registered examination, displays a list of a plurality of examination procedures in the order of execution on a display unit; The ultrasound diagnostic apparatus according to claim 1 , wherein the display control unit acquires the information associated with the first ultrasound image data from the storage device and displays the information on the display unit when an examination procedure is performed.

7. The ultrasound diagnostic apparatus according to claim 6 , wherein the display control unit causes the display unit to further display second ultrasound image data acquired during execution of the examination procedure.

8. The ultrasound diagnostic apparatus according to claim 1 , wherein the acquisition unit acquires, as the information, a first camera image capturing a position of an ultrasound probe and a subject when the first ultrasound image data is acquired.

9. The acquisition unit acquires second position information relative to an ultrasound probe and a subject during acquisition of second ultrasound image data, The ultrasound diagnostic apparatus according to claim 8 , further comprising a display control unit that causes an icon representing a current position and orientation of the ultrasound probe to be superimposed on the first camera image based on the second position information.

10. The ultrasound diagnostic apparatus according to claim 1 , wherein the acquisition unit acquires, as the information, first position information relative to a subject and an ultrasound probe when the first ultrasound image data is acquired.

11. The acquisition unit acquires a second camera image capturing an ultrasound probe and a subject during collection of second ultrasound image data, 11. The ultrasound diagnostic apparatus of claim 10, further comprising a display control unit that superimposes, on the second camera image, an icon representing a position and orientation of an ultrasound probe when the first ultrasound image data was acquired, based on the first position information.

12. The ultrasound diagnostic apparatus according to claim 5 , wherein the acquisition unit acquires, as the information, video data before and after the first ultrasound scan.

13. The ultrasonic diagnostic apparatus according to claim 12 , wherein the video data is edited data in which unnecessary data for guiding an ultrasonic probe has been deleted.

14. a display control unit that, when accepting execution of an examination procedure in an examination including a process for acquiring a registered ultrasound image, displays a list of the examination procedures on a display unit in the order of execution; The display control unit of the ultrasound diagnostic device is configured to, when the examination procedure is executed, obtain from a storage device information for a user to obtain a cross-section of the first ultrasound image data, the information being linked to first ultrasound image data set as a reference image in the examination, and display the information on the display unit.

15. Determining which cross section the first ultrasonic image data set as a reference image in an examination including an ultrasonic image acquisition process corresponds to; A program that causes a computer to execute a process of acquiring information for a user to acquire the determined cross-section, and linking the acquired information to the first ultrasound image data and storing it in a storage device.

Images