Ultrasonic diagnostic device, information processing device, ultrasonic diagnostic system, and ultrasonic diagnostic method

The ultrasound diagnostic system addresses the challenge of reproducing scanning positions by using feature point and probe position acquisition units to determine relative positions, facilitating accurate and efficient ultrasound examinations.

JP2024162387APending Publication Date: 2024-11-21CANON MEDICAL SYST CORP
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2023077836
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-10
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

Existing ultrasound diagnostic systems face challenges in intuitively determining the positional relationship between the ultrasound probe and the captured image, making it difficult to efficiently reproduce scanning positions in subsequent examinations.

Method used

The system includes a feature point position acquisition unit, probe position acquisition unit, specifying unit, and display control unit to determine the relative positions of the ultrasound probe and feature points on the subject, enabling accurate reproduction of scanning positions by displaying support information on a wearable terminal.

Benefits of technology

Enables precise reproduction of scanning positions in past examinations, guiding operators with support information on the probe's position and scanning locus, enhancing examination efficiency and accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024162387000001_ABST
    Figure 2024162387000001_ABST
Patent Text Reader

Abstract

To reproduce a scan position in past ultrasonic examinations, and provide a present probe position corresponding to a subject to an examiner.SOLUTION: An ultrasonic diagnostic device includes a feature point position acquisition unit, a probe position acquisition unit, a specification unit, and a display control unit. The feature point position acquisition unit acquires feature point position information indicating the position of a feature part of the subject. The probe position acquisition unit acquires ultrasonic probe position information including the position of an ultrasonic probe. The specification unit specifies support information on the scan of the ultrasonic probe on the basis of the present feature point position information and first relative position information indicating a relative position between past ultrasonic probe position information and past feature point position information. The display control unit executes control to display the support information.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] An embodiment of the present invention relates to an ultrasound diagnostic apparatus, an information processing apparatus, an ultrasound diagnostic system, and an ultrasound diagnostic method. [Background technology]

[0002] In ultrasound examinations using ultrasound diagnostic equipment, it is difficult to intuitively grasp the positional relationship between the probe position of the ultrasound probe and the positional relationship between the ultrasound image captured by the ultrasound diagnostic equipment, and efficient and effective examinations may depend on the skill of the examiner.

[0003] Conventionally, a mark is placed on the body surface of a subject who is the subject of an ultrasound diagnosis in order to detect the position of the subject, and a mark is placed on the ultrasound probe in order to detect the position of the ultrasound probe. A technology has been proposed for determining the position on the subject's body surface that corresponds to the region of interest on an ultrasound image.

[0004] Here, if the positions at which marks are made to detect the position of the subject shift (differ) between different examinations, it may become difficult to reproduce the operation positions from previous ultrasound examinations. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2013-255658 A Summary of the Invention [Problem to be solved by the invention]

[0006] An object of the present invention is to provide an examiner with a probe position corresponding to a current subject by reproducing a scanning position in a past ultrasonic examination. [Means for solving the problem]

[0007] An ultrasound diagnostic apparatus according to an embodiment includes a feature point position acquisition unit, a probe position acquisition unit, an identification unit, and a display control unit. The feature point position acquisition unit acquires feature point position information indicating the position of a feature of a subject. The probe position acquisition unit acquires ultrasound probe position information indicating the position of an ultrasound probe. The identification unit identifies support information related to scanning of the ultrasound probe based on the current feature point position information and first relative position information indicating a relative position between past ultrasound probe position information and the past feature point position information. The display control unit performs control to display the support information. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of an ultrasound diagnostic system according to the first embodiment. [Diagram 2] FIG. 2 is a schematic diagram showing an example for explaining relative position information calculated by the ultrasound diagnostic apparatus according to the first embodiment. [Diagram 3] FIG. 3 is a schematic diagram showing an example for explaining support information identified by the ultrasound diagnostic apparatus according to the first embodiment. [Figure 4] FIG. 4 is a schematic diagram showing an example of support information output by the ultrasound diagnostic apparatus according to the first embodiment. [Diagram 5] FIG. 5 is a sequence showing an example for explaining a procedure of processing by the ultrasound diagnostic system according to the first embodiment. [Figure 6] FIG. 6 is a sequence showing an example for explaining a procedure of processing by the ultrasound diagnostic system according to the first embodiment. [Figure 7] FIG. 7 is a schematic diagram showing an example for explaining relative position information calculated by the ultrasound diagnostic apparatus according to the first modification. [Figure 8] FIG. 8 is a schematic diagram showing an example for explaining relative position information calculated by the ultrasound diagnostic apparatus according to the second modification. [Figure 9] FIG. 9 is a block diagram showing an example of the configuration of an ultrasound diagnostic system according to the second embodiment. [Figure 10]FIG. 10 is a schematic diagram showing an example in which the imaging device according to the second embodiment images an object. [Figure 11] FIG. 11 is a schematic diagram showing an example of support information output by an ultrasound diagnostic device according to the sixth modification. [Figure 12] FIG. 12 is a schematic diagram showing an example of support information output by an ultrasound diagnostic device according to the seventh modification. [Figure 13] FIG. 13 is a schematic diagram showing an example of support information output by an ultrasound diagnostic device according to the eighth modification. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, with reference to the accompanying drawings, embodiments of an ultrasonic diagnostic device, an information processing device, an ultrasonic diagnostic system, and an ultrasonic diagnostic method according to the present application will be described in detail. Note that the ultrasonic diagnostic device, the information processing device, the ultrasonic diagnostic system, and the ultrasonic diagnostic method according to the present application are not limited to the embodiments shown below. In addition, in the following description, similar components are given common reference numerals, and duplicated descriptions are omitted.

[0010] (First embodiment) First, an ultrasound diagnostic system according to the first embodiment will be described. Fig. 1 is a block diagram showing an example of the configuration of an ultrasound diagnostic system 1 according to the first embodiment. As shown in Fig. 1, the ultrasound diagnostic system 1 according to the first embodiment includes an ultrasound probe 2, a display 3, an input interface 4, an ultrasound diagnostic device 5, a transmitter 7, and a wearable terminal 8. The ultrasound diagnostic device 5 is communicatively connected to the ultrasound probe 2, the display 3, the input interface 4, the transmitter 7, and the wearable terminal 8.

[0011] The ultrasonic probe 2 is connected to a transmission / reception circuit 51 included in the ultrasonic diagnostic device 5. The ultrasonic probe 2 has, for example, a plurality of piezoelectric transducers in a probe body, and these plurality of piezoelectric transducers generate ultrasonic waves based on a drive signal supplied from the transmission / reception circuit 51. The ultrasonic probe 2 also receives a reflected wave from the subject S and converts it into an electric signal. The ultrasonic probe 2 also has, in the probe body, a matching layer provided on the piezoelectric transducer, a backing material that prevents ultrasonic waves from propagating backward from the piezoelectric transducer, and the like. The ultrasonic probe 2 is detachably connected to the ultrasonic diagnostic device 5.

[0012] When ultrasonic waves are transmitted from the ultrasonic probe 2 to the subject S, the transmitted ultrasonic waves are successively reflected by discontinuous surfaces of acoustic impedance in the tissues of the subject S, and are received as reflected wave signals by the multiple piezoelectric transducers of the ultrasonic probe 2. The amplitude of the received reflected wave signal depends on the difference in acoustic impedance at the discontinuous surfaces where the ultrasonic waves are reflected. When the transmitted ultrasonic pulse is reflected by the surface of a moving blood flow, heart wall, etc., the reflected wave signal undergoes a frequency shift due to the Doppler effect depending on the velocity component of the moving object in the ultrasonic transmission direction.

[0013] The ultrasonic probe 2 outputs an echo signal or ultrasonic data obtained by performing ultrasonic scanning on the subject and position information of the ultrasonic scanning. Note that the ultrasonic probe 2 is an ultrasonic probe that mechanically vibrates a plurality of piezoelectric transducers of a one-dimensional ultrasonic probe in which a plurality of piezoelectric transducers are arranged in a line, or an ultrasonic probe that is a two-dimensional ultrasonic probe in which a plurality of piezoelectric transducers are arranged two-dimensionally in a lattice pattern, and is capable of scanning the subject S in three dimensions.

[0014] The display 3 displays a GUI (Graphical User Interface) for the operator of the ultrasound diagnostic system 1 to input various setting requests using the input interface 4, and displays ultrasound images and display information generated by the ultrasound diagnostic device 5. The display 3 also displays various messages and display information to notify the operator of the processing status and processing results of the ultrasound diagnostic device 5. The display 3 also has a speaker and can output sound.

[0015] The input interface 4 accepts operations for setting a predetermined position (e.g., a region of interest, etc.), setting the display direction of an image, inputting numerical values, switching modes, etc. For example, the input interface 4 can be realized by a trackball, a switch, a button, a mouse, a keyboard, a touchpad that performs input operations by touching the operation surface, a touch monitor in which a display screen and a touchpad are integrated, a non-contact input circuit using an optical sensor, a voice input circuit, etc.

[0016] The input interface 4 is connected to a processing circuit 55 described later, converts an input operation received from an operator into an electrical signal, and outputs the electrical signal to the processing circuit 55. In this specification, the input interface 4 is not limited to an interface having physical operation parts such as a mouse and a keyboard. For example, an electrical signal processing circuit that receives an electrical signal corresponding to an input operation from an external input device provided separately from the device and outputs the electrical signal to the processing circuit 55 is also included as an example of the input interface.

[0017] The first position sensor 6 is a device for acquiring position information indicating the position of the ultrasonic probe 2. The transmitter 7 is a device for acquiring ultrasonic probe position information indicating the position of the ultrasonic probe 2 and terminal position information indicating the position of the wearable terminal 8. The transmitter 7 is a device for forming a magnetic field from its own device as a center toward the outside. The transmitter 7 is placed at an arbitrary position near the main body of the ultrasonic diagnostic device 5.

[0018] The first position sensor 6 is, for example, a magnetic sensor. The first position sensor 6 is attached to the ultrasonic probe 2. The first position sensor 6 detects the intensity and inclination of a three-dimensional magnetic field formed by the transmitter 7. The first position sensor 6 calculates its own position (coordinates and angle) in a space with the transmitter 7 as the origin based on information of the detected magnetic field, and transmits the calculated position to the ultrasonic diagnostic device 5. As a result, the first position sensor 6 transmits ultrasonic probe position information indicating the position of the ultrasonic probe 2 to the ultrasonic diagnostic device 5.

[0019] The wearable terminal 8 is realized by, for example, a head mounted display (HMD) or goggles for VR, MR or AR. The wearable terminal 8 is an example of an information processing device. The wearable terminal 8 displays ultrasound images and display information generated by the ultrasound diagnostic device 5. The wearable terminal 8 may also display various messages and display information to notify the operator of the processing status and processing results of the ultrasound diagnostic device 5.

[0020] Furthermore, the wearable terminal 8 includes a second position sensor 9. The second position sensor 9 is, for example, a magnetic sensor. The second position sensor 9 detects the strength and inclination of the three-dimensional magnetic field formed by the transmitter 7. Based on information about the detected magnetic field, the second position sensor 9 calculates the position (coordinates and angle) of the own device in a space with the transmitter 7 as the origin, and transmits the calculated position to the ultrasound diagnostic device 5. As a result, the second position sensor 9 transmits terminal position information indicating the position of the wearable terminal 8 to the ultrasound diagnostic device 5.

[0021] The wearable terminal 8 has a feature point position detection function, a marker position detection function, and a display function. The feature point position detection function is an example of a feature point position detection unit. The marker position detection function is an example of a marker position detection unit. The display function is an example of a display unit. The feature point position detection function detects feature point position information indicating the positions of feature points of the subject. The marker position detection function detects marker position information indicating the positions of markers attached to the subject. The display function displays support information regarding scanning by the ultrasonic probe 2. Details will be described later.

[0022] The ultrasound diagnostic device 5 has a transmission / reception circuit 51, a B-mode processing circuit 52, a Doppler processing circuit 53, a memory 54, and a processing circuit 55. In the ultrasound diagnostic system 1 shown in FIG. 1, each processing function is stored in the memory 54 in the form of a program executable by a computer. The transmission / reception circuit 51, the B-mode processing circuit 52, the Doppler processing circuit 53, and the processing circuit 55 are processors that realize a function corresponding to each program by reading and executing the program from the memory 54. In other words, each circuit in a state in which each program has been read has a function corresponding to the read program.

[0023] The transmission / reception circuit 51 has a pulse generator, a transmission delay circuit, a pulser, etc., and supplies a drive signal to the ultrasonic probe 2. The pulse generator repeatedly generates rate pulses for forming a transmission ultrasonic wave at a predetermined rate frequency. The transmission delay circuit focuses the ultrasonic waves generated from the ultrasonic probe 2 into a beam shape, and provides each rate pulse generated by the pulse generator with a delay time for each piezoelectric transducer required to determine the transmission directivity. The pulser applies a drive signal (drive pulse) to the ultrasonic probe 2 at a timing based on the rate pulse. That is, the transmission delay circuit changes the delay time provided to each rate pulse to arbitrarily adjust the transmission direction of the ultrasonic waves transmitted from the piezoelectric transducer surface.

[0024] The transmission / reception circuit 51 has a function of instantaneously changing the transmission frequency, transmission drive voltage, etc., in order to execute a predetermined scan sequence based on instructions from the processing circuit 55 described later. In particular, the change in the transmission drive voltage is realized by a linear amplifier type oscillation circuit that can instantly switch its value, or a mechanism that electrically switches between multiple power supply units.

[0025] The transmission / reception circuit 51 also has a preamplifier, an A / D (Analog / Digital) converter, a reception delay circuit, an adder, etc., and performs various processes on the reflected wave signal received by the ultrasonic probe 2 to generate reflected wave data. The preamplifier amplifies the reflected wave signal for each channel. The A / D converter A / D converts the amplified reflected wave signal. The reception delay circuit provides a delay time required to determine the reception directivity. The adder performs addition processing on the reflected wave signal processed by the reception delay circuit to generate reflected wave data. The addition processing by the adder emphasizes the reflected component from a direction according to the reception directivity of the reflected wave signal, and an overall beam for ultrasonic transmission and reception is formed by the reception directivity and transmission directivity.

[0026] The B-mode processing circuit 52 receives the reflected wave data from the transmission / reception circuit 51, and performs logarithmic amplification, envelope detection processing, etc. to generate data (B-mode data) in which the signal intensity is expressed as luminance brightness.

[0027] The Doppler processing circuit 53 performs frequency analysis on the velocity information from the reflected wave data received from the transmission / reception circuit 51, extracts blood flow, tissue, and contrast agent echo components due to the Doppler effect, and generates data (Doppler data) in which moving body information such as velocity, dispersion, and power is extracted for multiple points. The moving body in the first embodiment is a fluid such as blood flowing in blood vessels or lymph fluid flowing in lymphatic vessels.

[0028] The B-mode processing circuit 52 and the Doppler processing circuit 53 are capable of processing both two-dimensional reflected wave data and three-dimensional reflected wave data. That is, the B-mode processing circuit 52 generates two-dimensional B-mode data from the two-dimensional reflected wave data, and generates three-dimensional B-mode data from the three-dimensional reflected wave data. The Doppler processing circuit 53 generates two-dimensional Doppler data from the two-dimensional reflected wave data, and generates three-dimensional Doppler data from the three-dimensional reflected wave data.

[0029] Three-dimensional B-mode data is data in which a brightness value corresponding to the reflection intensity of the reflection source located at each of multiple points (sample points) set on each scan line of the three-dimensional scanning range is assigned, while three-dimensional Doppler data is data in which a brightness value corresponding to the value of blood flow information (velocity, dispersion, power) is assigned to each of multiple points (sample points) set on each scan line of the three-dimensional scanning range.

[0030] The memory 54 stores ultrasonic images for display generated by the processing circuitry 55. The memory 54 also stores data generated by the B-mode processing circuitry 52 and the Doppler processing circuitry 53. The memory 54 also stores control programs for performing ultrasonic transmission / reception, image processing, and display processing, diagnostic information (e.g., patient ID, doctor's findings, etc.), diagnostic protocols, various body marks, and other various data.

[0031] The processing circuit 55 controls the overall processing of the ultrasound diagnostic device 5. Specifically, the processing circuit 55 performs various processes by reading out from the memory 54 and executing programs corresponding to the control function 551, the image generation function 552, the display control function 553, the probe position acquisition function 554, the feature point position acquisition function 555, the marker position acquisition function 556, the calculation function 557, and the identification function 558 shown in FIG. 1. Here, the control function 551 is an example of a control unit. Also, the image generation function 552 is an example of an image generation unit. Furthermore, the probe position acquisition function 554 is an example of a probe position acquisition unit. The feature point position acquisition function 555 is an example of a feature point position acquisition unit. Also, the marker position acquisition function 556 is an example of a marker position acquisition unit. Furthermore, the calculation function 557 is an example of a calculation unit. The identification function 558 is an example of an identification unit.

[0032] The control function 551 controls the processing of the transmission / reception circuit 51, the B-mode processing circuit 52, and the Doppler processing circuit 53 based on various setting requests input by the operator via the input interface 4 and various control programs and various data read from the memory 54.

[0033] The image generating function 552 generates an ultrasonic image from the data generated by the B-mode processing circuit 52 and the Doppler processing circuit 53. That is, the image generating function 552 generates B-mode image data in which the intensity of the reflected wave is expressed by brightness from the two-dimensional B-mode data generated by the B-mode processing circuit 52. The B-mode image data is data that depicts the tissue shape within the ultrasonically scanned area. The image generating function 552 also generates Doppler image data that represents moving object information from the two-dimensional Doppler data generated by the Doppler processing circuit 53. The Doppler image data is velocity image data, variance image data, power image data, or image data that is a combination of these. The Doppler image data is data that indicates fluid information regarding the fluid flowing within the ultrasonically scanned area.

[0034] Here, the image generating function 552 generally converts (scan converts) a scan line signal sequence of ultrasonic scanning into a scan line signal sequence of a video format represented by a television or the like, and generates an ultrasonic image for display. Specifically, the image generating function 552 generates an ultrasonic image for display by performing coordinate conversion according to the ultrasonic scanning form of the ultrasonic probe 2.

[0035] In addition to scan conversion, the image generation function 552 performs various image processing, such as image processing (smoothing processing) for regenerating an average brightness image using multiple image frames after scan conversion, image processing (edge ​​emphasis processing) using a differential filter within the image, etc. The image generation function 552 also synthesizes text information of various parameters, scales, body marks, etc., with the ultrasound image.

[0036] That is, the B-mode data and the Doppler data are ultrasonic image data before the scan conversion process, and the data generated by the image generation function 552 is an ultrasonic image for display after the scan conversion process. The B-mode data and the Doppler data are also called raw data.

[0037] Furthermore, the image generation function 552 generates three-dimensional B-mode image data by performing coordinate conversion on the three-dimensional B-mode data generated by the B-mode processing circuit 52. Also, the image generation function 552 generates three-dimensional Doppler image data by performing coordinate conversion on the three-dimensional Doppler data generated by the Doppler processing circuit 53. The three-dimensional B-mode data and the three-dimensional Doppler data become volume data before the scan conversion process. That is, the image generation function 552 generates "three-dimensional B-mode image data or three-dimensional Doppler image data" as "volume data that is three-dimensional ultrasound image data."

[0038] Furthermore, the image generating function 552 can perform rendering processing on the volume data in order to generate various types of two-dimensional image data (ultrasound images) for displaying the volume data on the display 3.

[0039] The display control function 553 controls so that the ultrasonic image for display stored in the memory 54 is displayed on the display 3. In addition, the display control function 553 controls so that the processing results by each function are displayed on the display 3. For example, the display control function 553 controls so that display information is displayed on the display 3.

[0040] The probe position acquisition function 554 acquires ultrasonic probe position information transmitted by the ultrasonic probe 2. For example, when the operator places the ultrasonic probe on a feature point of the subject S, the probe position acquisition function 554 acquires ultrasonic probe position information transmitted by the ultrasonic probe 2. Also, for example, when the operator places the ultrasonic probe on the body surface of the subject S to scan, the probe position acquisition function 554 acquires ultrasonic probe position information transmitted by the ultrasonic probe 2. In this case, since scanning is being performed by the operator, the probe position acquisition function 554 acquires the ultrasonic probe position information as scanning position information.

[0041] The feature point position acquisition function 555 acquires ultrasonic probe position information transmitted by the ultrasonic probe 2. For example, when the operator places the ultrasonic probe 2 on a feature point of the subject S, the feature point position acquisition function 555 acquires the ultrasonic probe position information transmitted by the ultrasonic probe 2 as feature point position information indicating the feature point position of the subject S.

[0042] The marker position acquisition function 556 acquires marker position information indicating the position of a marker detected by the wearable terminal 8. For example, when the wearable terminal 8 detects a marker attached to the subject S, the marker position acquisition function 556 acquires marker position information indicating the position of the marker detected by the wearable terminal 8.

[0043] The calculation function 557 calculates first relative position information indicating the relative position between the position of the ultrasonic probe 2 and the position of the feature point. For example, the calculation function 557 calculates the first relative position information indicating the relative position between the position of the ultrasonic probe and the position of the feature point based on the ultrasonic probe position information acquired by the probe position acquisition function 554 and the feature point position information acquired by the feature point position acquisition function 555. In addition, the calculation function 557 calculates second relative position information indicating the relative position between the position of the feature point and the position of the marker. For example, the calculation function 557 calculates the second relative position information indicating the relative position between the position of the feature point and the position of the marker based on the feature point position information acquired by the feature point position acquisition function 555 and the marker position information acquired by the marker position acquisition function 556.

[0044] Furthermore, the calculation function 557 calculates third relative position information indicating the relative position between the position of the marker and the position of the ultrasonic probe 2. For example, the calculation function 557 calculates the third relative position information indicating the relative position between the position of the marker and the position of the ultrasonic probe based on the marker position information acquired by the marker position acquisition function 556 and the ultrasonic probe position information acquired by the probe position acquisition function 554. Note that the first relative position information, the second relative position information, and the third relative position information are collectively referred to as relative position information hereinafter.

[0045] Here, the relative position information calculated by the calculation function 557 will be described with reference to Fig. 2. Fig. 2 is a schematic diagram showing an example for explaining the relative position information calculated by the ultrasound diagnostic device 5 according to the first embodiment. Fig. 2 shows an operator D who wears a wearable terminal 8 and operates the ultrasound probe 2, and a subject S who has a marker on the body surface. The marker is a mark that serves as a reference point for display on the wearable terminal 8.

[0046] The position of the marker may be changed for each examination, and the position of the marker may be, for example, set so as to avoid locations that may hinder scanning. Furthermore, a feature point is set on the subject S for alignment with the ultrasound probe 2. The feature point is preferably set at a location that is easy for the operator D to recognize and whose position does not change, for example, at the navel or nipple of the subject S. Furthermore, the feature point is also called a feature part, since it is set at a location that is easy for the operator D to recognize and whose position does not change. In FIG. 2, the feature point will be described as the navel of the subject S.

[0047] H, F1, M1, P1, and T shown in FIG. 2 correspond to the position information of the wearable device 8, the position information of the feature points, the position information of the markers, the position information of the ultrasonic probe, and the position information of the transmitter 7, respectively.

[0048] The calculation function 557 calculates first relative position information indicating the relative position between the position of the ultrasound probe 2 and the feature point position, based on the ultrasound probe position information P1 acquired by the probe position acquisition function 554 and the feature point position information F1 acquired by the feature point position acquisition function 555. Here, when the first relative position information is represented by, for example, a vector F1P1, it can be expressed by the following formula (1).

[0049]

number

[0050] The vectors F1M1 and M1P1 will be described in detail later.

[0051] Furthermore, the calculation function 557 calculates second relative position information indicating the relative position between the feature point position and the marker position, based on the feature point position information acquired by the feature point position acquisition function 555 and the marker position information acquired by the marker position acquisition function 556. Here, when the second relative position information is represented by a vector F1M1, for example, it can be expressed by the following formula (2).

[0052]

number

[0053] Here, P0 is ultrasonic probe position information transmitted from the first position sensor 6 when the operator places the ultrasonic probe on a feature point of the subject S. Furthermore, vector P0T is position information of the ultrasonic probe 2. Furthermore, vector TH is position information of the wearable device 8 with respect to the transmitter 7. Vector HM1 is position information of the marker with respect to the wearable device 8.

[0054] Furthermore, the calculation function 557 calculates third relative position information indicating the relative position between the marker position and the ultrasonic probe position, based on the marker position information acquired by the marker position acquisition function 556 and the ultrasonic probe position information acquired by the probe position acquisition function 554. Here, when the third relative position information is represented by, for example, a vector M1P1, it can be expressed by the following formula (3).

[0055]

number

[0056] Here, vector M1H is position information of the wearable device 8 based on the marker position. Vector HT is the position of the transmitter 7 based on the position of the wearable device 8. Vector TP1 is the position of the ultrasound probe 2 based on the position of the transmitter 7.

[0057] Returning to FIG. 1, the identification function 558 identifies support information related to scanning of the ultrasonic probe 2 based on the current feature point position information and first relative position information indicating a relative position between past ultrasonic probe position information and the past feature point position information. Specifically, the identification function 558 identifies support information based on the current feature point position information acquired by the feature point position acquisition function 555 and first relative position information indicating a relative position between past ultrasonic probe position information and the past feature point position information calculated by the calculation function 557. The support information is information including, for example, past ultrasonic probe position information and an ultrasonic image signal obtained by imaging the subject S.

[0058] Here, the support information identified by the identification function 558 will be described with reference to FIG. 3. FIG. 3 is a schematic diagram showing an example for explaining the support information identified by the ultrasound diagnostic device 5 according to the first embodiment. In FIG. 3, the same contents as in FIG. 2 will not be described. In addition to FIG. 2, FIG. 3 shows a current marker position M2, current ultrasound probe position information P2, and current feature point position information F2. In FIG. 3, the marker position information M1 and ultrasound probe position information P1 are position information at the time of a past examination (scan). In addition, the feature point of the subject S is the navel, and there is no significant change in position, so it is assumed that there is no change in the feature point positions between the past and the present.

[0059] 3, the identification function 558 identifies support information related to scanning with the ultrasonic probe based on the current feature point position information F2 and first relative position information indicating the relative position between the past ultrasonic probe position information P1 and the past feature point position information F1 acquired by the probe position acquisition function 554. In this case, the support information can be expressed by the following formula (4).

[0060]

number

[0061] The identification function 558 can identify the support information by combining the current feature point position information F2, the past ultrasound probe position information P1, and the past feature point position information F1.

[0062] The identification function 558 may identify the first relative position information based on second relative position information indicating the relative position between the past marker position information M1 and the past feature point position information F1, and third relative position information indicating the relative position between the past marker position information M1 and the past ultrasound probe position information P1. In this case, the support information can be expressed by the following formula (5) by substituting formula (1) for formula (4).

[0063]

number

[0064] Returning to Fig. 1, the display control function 553 controls the wearable device 8 equipped with a position sensor to display the support information identified by the identification function 558. Here, a form in which the display control function 553 controls the wearable device 8 equipped with a second position sensor 9 to display the support information identified by the identification function 558 will be described with reference to Fig. 4. Fig. 4 is a schematic diagram showing an example of support information output by the ultrasound diagnostic device 5 according to the first embodiment.

[0065] 4 shows a state in which an operator D places the ultrasound probe 2 against the body surface of a subject S and operates the ultrasound probe 2. For example, the display control function 553 controls to display support information including the scanning trajectory of a past examination and the posture of the ultrasound probe 2 on the body surface. The support information may also include the area where an ultrasound image is captured. Furthermore, the support information displayed by the display control function 553 may include various guide information for the current examination, superimposed on the past examination.

[0066] Next, a processing procedure by the ultrasound diagnostic system 1 according to the first embodiment will be described with reference to Fig. 5 and Fig. 6. Fig. 5 and Fig. 6 are sequences showing an example for explaining the processing procedure by the ultrasound diagnostic system 1 according to the first embodiment.

[0067] The operator D places the ultrasonic probe 2 on a feature point F of the subject S (step S101). Then, the ultrasonic probe 2 transmits ultrasonic probe position information to the ultrasonic diagnostic device 5 (step S102). Then, the probe position acquisition function 554 of the processing circuit 55 acquires the ultrasonic probe position information transmitted by the ultrasonic probe 2 (step S103). Then, the feature point position acquisition function 555 of the processing circuit 55 acquires the ultrasonic probe position information transmitted by the ultrasonic probe 2 (step S104).

[0068] Next, the wearable terminal 8 detects the position of the marker attached to the subject S (step S105). Next, the wearable terminal 8 transmits the detected marker position information to the ultrasound diagnostic device 5 (step S106). Next, the marker position acquisition function 556 of the processing circuit 55 acquires marker position information indicating the position of the marker detected by the wearable terminal 8 (step S107).

[0069] Next, the wearable terminal 8 transmits terminal position information of the wearable terminal 8 to the ultrasound diagnostic device 5 (step S108). Next, the ultrasound probe 2 transmits ultrasound probe position information to the ultrasound diagnostic device 5 (step S109). Next, the probe position acquisition function 554 of the processing circuit 55 acquires the ultrasound probe position information (scanning position information) transmitted by the ultrasound probe 2 (step S110).

[0070] Next, the calculation function 557 of the processing circuit 55 calculates first relative position information indicating the relative position between the position of the ultrasound probe and the position of the feature point based on the ultrasound probe position information (scanning position information) acquired by the probe position acquisition function 554 in step S110 and the feature point position information acquired by the feature point position acquisition function 555 in step S104 (step S111).

[0071] Next, the calculation function 557 of the processing circuit 55 calculates second relative position information indicating the relative position between the feature point position and the marker position based on the feature point position information acquired by the feature point position acquisition function 555 in step S104 and the marker position information acquired by the marker position acquisition function 556 in step S107 (step S112).

[0072] Next, the calculation function 557 of the processing circuit 55 calculates third relative position information indicating the relative position between the marker position and the ultrasonic probe position based on the marker position information acquired by the marker position acquisition function 556 in step S107 and the ultrasonic probe position information acquired by the probe position acquisition function 554 in step S110 (step S113). When this process ends, the examination of the ultrasonic probe 2 by the operator D ends.

[0073] Fig. 6 will be described assuming that the subject S examined in Fig. 5 is examined again. That is, the processing of the ultrasound diagnostic system 1 in Fig. 6 is based on the assumption that there is information regarding the past scanning of the ultrasonic probe.

[0074] The operator D places the ultrasonic probe 2 on the feature point F of the subject S (step S121). Then, the ultrasonic probe 2 transmits ultrasonic probe position information to the ultrasonic diagnostic device 5 (step S122). Then, the probe position acquisition function 554 of the processing circuit 55 acquires the ultrasonic probe position information transmitted by the ultrasonic probe 2 (step S123). Then, the feature point position acquisition function 555 of the processing circuit 55 acquires the ultrasonic probe position information transmitted by the ultrasonic probe 2 (step S124).

[0075] Next, the identification function 558 of the processing circuit 55 identifies support information based on the current feature point position information acquired by the feature point position acquisition function 555 in step S124 and the first relative position information calculated by the calculation function 557 in step S111 and indicating the relative position between the past ultrasound probe position information and the past feature point position information (step S125). Next, the display control function 553 of the processing circuit 55 controls the wearable terminal 8 to display the support information identified by the identification function 558 (step S126). When the process of step S126 ends, the operator D starts the examination using the ultrasound probe 2 while checking the support information.

[0076] As described above, the ultrasound diagnostic apparatus 5 according to the first embodiment identifies support information related to scanning by the ultrasound probe 2 based on the current feature point position information and the first relative position information indicating the relative positions between the past ultrasound probe position information and the past feature point position information, and performs control to display the support information.

[0077] According to at least one of the embodiments described above, for example, when an operator D uses an ultrasound probe 2 to perform an examination again on a subject S who has previously been examined using the ultrasound probe 2, the ultrasound diagnostic device 5 performs control so that support information related to the previous scan using the ultrasound probe 2 is displayed on the wearable terminal 8 worn by the operator D.

[0078] This allows the ultrasonic diagnostic device 5 to reproduce the scanning position in a past examination using the ultrasonic probe 2, and to guide the operator D as to the position of the ultrasonic probe 2.

[0079] (Variation 1) In the above-described first embodiment, the marker attached to the subject S is described as being located by the wearable device 8, but the present invention is not limited to this. For example, the marker attached to the subject S may be provided with a position sensor. FIG. 7 is a schematic diagram showing an example of a form in which the marker shown in FIG. 2 is provided with a position sensor. Note that M3 shown in FIG. 7 corresponds to the position information of the marker provided with a position sensor.

[0080] In the case of the first modification, the marker position acquisition function 556 acquires marker position information transmitted by a marker equipped with a position sensor. In addition, when the second relative position information calculated by the calculation function 557 is represented by, for example, a vector F1M3, it can be expressed by the following formula (6).

[0081]

number

[0082] Here, vector TM3 is the position information of the marker with respect to the transmitter 7.

[0083] Furthermore, in the case of the first modification, when the third relative position information calculated by the calculation function 557 is represented by, for example, a vector M3P1, it can be expressed by the following formula (7).

[0084]

number

[0085] Here, the vector M3T is the position of the transmitter 7 based on the marker position. This allows the ultrasonic diagnostic device 5 to calculate the second relative position information and the third relative position information even in the case of a marker equipped with a position sensor.

[0086] (Variation 2) The above-mentioned ultrasonic probe 2 may further include, for example, a marker. Fig. 8 is a schematic diagram showing an example of a configuration in which a marker is provided for the ultrasonic probe 2 shown in Fig. 2. Note that M4 shown in Fig. 8 corresponds to the position information of the ultrasonic probe 2 that includes a position sensor. In this case, P1 and M4 indicating the position information of the ultrasonic probe 22 are approximately the same position.

[0087] In the case of the second modification, when the first relative position information calculated by the calculation function 557 is represented by, for example, a vector F1P1, it can be expressed by the following formula (8).

[0088]

number

[0089] Here, the vector M1M4 is position information of the ultrasonic probe 2 equipped with a marker, based on the marker attached to the subject S, and is the third relative position information.

[0090] In the case of the second modification, for example, the vector M1M4, which is the third relative position information calculated by the calculation function 557, can be expressed by the following formula (9).

[0091]

number

[0092] Furthermore, when the support information identified by the identification function 558 is represented by, for example, a vector HM4, the support information can be expressed by the following formula (10).

[0093]

number

[0094] As a result, even if the ultrasound probe 2 is equipped with a position sensor, the ultrasound diagnostic device 5 can calculate the first relative position information and identify the support information.

[0095] Second embodiment The ultrasound diagnostic system according to the second embodiment will be described with respect to a form including an imaging device in addition to the components of the first embodiment described above. Fig. 9 is a block diagram showing an example of the configuration of an ultrasound diagnostic system 11 according to the second embodiment.

[0096] As shown in Fig. 9, an ultrasound diagnostic system 11 according to the second embodiment includes an ultrasound probe 2, a display 3, an input interface 4, an ultrasound diagnostic device 5, a transmitter 7, a wearable terminal 8, and an imaging device 10. The ultrasound diagnostic device 5 is communicatively connected to the ultrasound probe 2, the display 3, the input interface 4, the transmitter 7, the wearable terminal 8, and the imaging device 10. Note that, in Fig. 9, a description of the same configuration as that shown in Fig. 1 will be omitted.

[0097] 10 is a schematic diagram showing an example in which the imaging device 10 images the subject S. Specifically, the imaging device 10 images the subject S. The imaging device 10 may be, for example, a camera fixed in an examination room, or a camera equipped with a moving mechanism that allows it to move within the examination room. The imaging device 10 detects feature points F (feature point position information) of the subject S from the captured image using image processing.

[0098] The image processing is performed using an algorithm for detecting and tracking the same object, such as Scale Invariant Feature Transform (SIFT), Speeded-Up Robust Features (SURF), Simple Online and Realtime Tracking (SORT), etc.

[0099] Then, the imaging device 10 transmits the detected feature point position information to the processing circuit 55. For example, in Fig. 10, a position sensor (not shown) of the imaging device 10 calculates the position (coordinates and angle) of the imaging device 10 in a space with the transmitter 7 as the origin based on the detected magnetic field information, and transmits the calculated position to the ultrasound diagnostic device 5. Note that the position of the imaging device 10 may be determined by measuring a predetermined position and using the measured measurement position (fixed value). This allows the ultrasound diagnostic system 11 to acquire the feature point F of the subject S from the imaging device 10.

[0100] (Variation 3) In the above-described second embodiment, the feature points F of the subject S are detected based on the captured image captured by the imaging device 10, but the present invention is not limited to this. For example, the wearable terminal 8 may detect the feature points F of the subject S from the captured image using image processing. This allows the ultrasound diagnostic system 11 to acquire the feature points F of the subject S from the wearable terminal 8.

[0101] (Variation 4) For example, when there is a large difference between the same position identified by different methods, the ultrasound diagnostic device 5 may warn the user or request the operator D to take action to correct the position. In the above-mentioned first embodiment, since only one marker is used on the body surface of the subject S, it is assumed that the distance between the feature point F and the marker M is constant (the subject is a rigid body). However, in reality, it is assumed that the body surface of the subject S may be deformed when the subject S bends his / her body during the examination.

[0102] Therefore, for example, the ultrasonic diagnostic device 5 can detect deformation of the body surface by combining the position of the ultrasonic probe 2 with a distance image to obtain a relative distance.

[0103] Specifically, the ultrasound diagnostic device 5 compares the position of the body surface estimated from the position of the ultrasound probe 2 with the position of the body surface estimated from the distance image, and if the difference exceeds an acceptable level, it determines that the distance between the feature point F and the marker M has changed and requests the operator D to realign the position (align (place) the ultrasound probe 2 on the feature point F), thereby obtaining the realigned relative distance.

[0104] That is, when the distance between the feature point F and the marker M changes, the display control function 553 of the processing circuit 55 performs control so as to display request information requesting the operator D to again align the ultrasonic probe 2 with the feature point F. In addition, when the distance between the feature point F and the marker M changes and the operator D aligns the ultrasonic probe 2 with the feature point of the subject S, the feature point position acquisition function 555 of the processing circuit 55 acquires current ultrasonic probe position information as current feature point position information. In addition, the calculation function 557 of the processing circuit 55 acquires the relative distance when the ultrasonic probe 2 is aligned with the feature point F, and calculates second relative position information indicating the relative position between the current feature point position and the current marker position.

[0105] (Variation 5) For example, the identification function 558 of the processing circuit 55 identifies any one of the first relative position information, the second relative position information, and the third relative position information by integrating a plurality of sensors mounted on the wearable terminal 8. The plurality of sensors includes any one of sensors related to position, acceleration, angular velocity, distance image, and image.

[0106] Furthermore, for example, when using a sensor fusion technique using a Kalman filter or the like, the ultrasound diagnostic device 5 requests the user to bring a specific marker into view in order to correct an estimation error from acceleration and angular velocity. In this case, the ultrasound diagnostic device 5 may display a warning to the operator D that the position estimation accuracy is deteriorating.

[0107] (Variation 6) For example, the ultrasound diagnostic device 5 may display support information including ultrasound images and external camera images on the wearable device 8 in correspondence with the body surface position of the subject S. Fig. 11 is a schematic diagram showing an example of support information output by the ultrasound diagnostic device 5 according to Modification 6. Support information 62 shown in Fig. 11 is in a form in which an operator D places an ultrasound probe 2 operated by the operator D on the body surface of the subject S, and an ultrasound image corresponding to the position on the body surface is output to the wearable device 8.

[0108] (Variation 7) For example, the ultrasound diagnostic device 5 may display support information including the scanning trajectory of the ultrasound probe 2 in a past examination, the image capturing location, and the posture of the ultrasound probe 2 on the wearable device 8 in association with the positions of organs inside the human body. Fig. 12 is a schematic diagram showing an example of support information output by the ultrasound diagnostic device 5 according to the seventh modification. The support information 63 shown in Fig. 12 is in a form in which the operator D places the ultrasound probe 2 operated by the operator D against the body surface of the subject S, and the part where the probe is placed is output to the wearable device 8.

[0109] (Variation 8) 13 is a schematic diagram showing an example of support information output by the ultrasound diagnostic device 5 according to Modification 8. Support information 64 shown in Fig. 13 shows a schematic diagram C of a human body, a position P of the ultrasound probe 2, and a heart 111. The support information 64 is in a form in which a state in which the ultrasound probe 2 is being operated on the heart 111 is output with respect to the schematic diagram C.

[0110] 1 and 9, an example in which each of the above-mentioned processing functions is realized by a single processing circuit 55 has been described, but the embodiment is not limited to this. For example, the processing circuit 55 may be configured by combining multiple independent processors, and each processor may execute each program to realize each processing function. Furthermore, each processing function of the processing circuit 55 may be appropriately distributed or integrated and realized in a single or multiple processing circuits.

[0111] The term "processor" used in the above description refers to circuits such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or an Application Specific Integrated Circuit (ASIC), a programmable logic device (e.g., a Simple Programmable Logic Device (SPLD), a Complex Programmable Logic Device (CPLD), and a Field Programmable Gate Array (FPGA)). A processor realizes functions by reading and executing a program stored in a memory.

[0112] Instead of storing the program in the memory, the program may be directly embedded in the circuit of the processor. In this case, the processor realizes the function by reading and executing the program embedded in the circuit. Each processor in this embodiment is not limited to being configured as a single circuit, but may be configured as a single processor by combining multiple independent circuits to realize the function.

[0113] Note that the components of each device illustrated in the above description of the embodiment are conceptual and functional, and are not necessarily physically configured as illustrated. In other words, the specific form of distribution and integration of each device is not limited to the illustrated form, and all or a part of the devices can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc. Furthermore, all or any part of the processing functions performed by each device can be realized by a CPU and a program analyzed and executed by the CPU, or can be realized as hardware using wired logic.

[0114] The scan control method described in the above embodiment can be realized by executing a prepared scan control program on a computer such as a personal computer or a workstation. This scan control program can be distributed via a network such as the Internet. This scan control program can also be recorded on a non-transitory computer-readable recording medium such as a hard disk, a flexible disk (FD), a CD-ROM, an MO, a DVD, a USB memory, or a flash memory such as an SD card memory, and can be executed by being read from the non-transitory recording medium by a computer.

[0115] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]

[0116] 1. Ultrasound diagnostic system 2 Ultrasound probe 3. Display 4 Input Interface 5. Ultrasound diagnostic equipment 6 First position sensor 7 Transmitter 8. Wearable devices 9 Second position sensor 10. Imaging device 55 Processing circuit 551 Control Functions 552 Image generation function 553 Display control function 554 Probe position acquisition function 555 Feature point position acquisition function 556 Marker position acquisition function 557 Calculation Function 558 Specific Functions

Claims

1. a feature point position acquiring unit for acquiring feature point position information indicating the position of a feature part of a subject; a probe position acquisition unit that acquires ultrasonic probe position information indicating a position of the ultrasonic probe; an identification unit that identifies support information related to scanning of the ultrasonic probe based on current feature point position information, and first relative position information indicating a relative position between past ultrasonic probe position information and the past feature point position information; A display control unit that controls to display the support information; An ultrasound diagnostic device comprising:

2. the feature point position acquisition unit acquires current ultrasound probe position information as the current feature point position information when the ultrasound probe is placed on a feature point of the subject by an operator; The ultrasonic diagnostic apparatus according to claim 1 .

3. a marker position acquiring unit that acquires marker position information indicating a position of a marker attached to the subject, the identification unit identifies the first relative position information based on second relative position information indicating a relative position between past marker position information and the past feature point position information, and third relative position information indicating a relative position between the past marker position information and the past ultrasound probe position information.

3. The ultrasonic diagnostic apparatus according to claim 1.

4. The marker position acquisition unit acquires the past marker position information from at least one of a wearable device or the marker, the wearable device including a position sensor. The ultrasonic diagnostic apparatus according to claim 3 .

5. The display control unit controls a wearable device including a position sensor to display the support information. The ultrasonic diagnostic apparatus according to claim 1 .

6. The feature point position acquisition unit acquires the feature point position information detected by the wearable device through image processing. The ultrasonic diagnostic apparatus according to claim 1 .

7. the display control unit performs control so as to display, when a relative distance between a position of the characteristic portion and a position of the marker has changed, request information for requesting an operator to again align the ultrasonic probe with the characteristic portion; the feature point position acquisition unit acquires current ultrasound probe position information as current feature point position information when the operator places the ultrasound probe on the feature point; The ultrasonic diagnostic apparatus according to claim 1 .

8. the determination unit determines any one of the first relative position information, the second relative position information, and the third relative position information by integrating a plurality of sensors mounted on the wearable terminal; The ultrasonic diagnostic apparatus according to claim 3 .

9. The plurality of sensors include any one of sensors related to position, acceleration, angular velocity, distance image, and image, The ultrasonic diagnostic apparatus according to claim 8.

10. The support information includes past ultrasound probe position information and an ultrasound image signal obtained by imaging the subject. The ultrasonic diagnostic apparatus according to claim 5.

11. a feature point position detection unit that detects feature point position information indicating the position of a feature of the subject; a display unit that displays support information regarding scanning of the ultrasonic probe based on current feature point position information, and first relative position information indicating a relative position between past ultrasonic probe position information and past feature point position information; An information processing device comprising:

12. an ultrasonic probe that outputs an echo signal or ultrasonic data obtained by performing an ultrasonic scan on a subject and position information of the ultrasonic scan; a feature point position detection unit that detects feature point position information indicating the position of a feature of the subject; a probe position acquisition unit that acquires ultrasonic probe position information indicating a position of the ultrasonic probe; an identification unit that identifies support information related to scanning of the ultrasonic probe based on current feature point position information, and first relative position information indicating a relative position between past ultrasonic probe position information and the past feature point position information; A display control unit that controls to display the support information; An ultrasound diagnostic system comprising:

13. An ultrasound diagnostic method using an ultrasound diagnostic device, comprising: a feature point position acquiring step of acquiring feature point position information indicating the position of a feature part of the subject; a probe position acquisition step of acquiring ultrasonic probe position information indicating a position of the ultrasonic probe; a step of identifying support information related to scanning of the ultrasonic probe based on current feature point position information, and first relative position information indicating a relative position between past ultrasonic probe position information and the past feature point position information; a display control step of performing control so as to display the support information; 2. An ultrasound diagnostic method comprising:

Citation Information

Patent Citations

  • Ultrasonic diagnostic device

    JP2005124712A

  • Ultrasonograph

    JP2014036754A

  • Ultrasonic diagnostic apparatus

    JP2020058474A

  • System and method for tracking completeness of co-registered medical image data

    US20150182191A1

  • Ultrasound guidance system and method

    US20220039873A1