Ultrasound diagnostic system
By installing a puncture adapter on the ultrasound probe and generating graphic images, the problem of difficulty in determining the installation status of the puncture adapter in existing technologies is solved, improving the convenience and accuracy of selecting the puncture angle in laparoscopic surgery.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- FUJIFILM CORP
- Filing Date
- 2025-11-26
- Publication Date
- 2026-06-05
AI Technical Summary
In laparoscopic surgery, current technology makes it difficult to accurately determine the installation status of the puncture adapter while observing ultrasound images, resulting in inconvenience in selecting the puncture angle.
By installing a puncture adapter on the ultrasonic probe and using a processor to generate a graphic image superimposed on the ultrasonic image, the installation status of the puncture adapter is displayed, including the specified angle range and fixed angle, helping users select the appropriate puncture angle.
This allows for accurate determination of the installation status of the puncture adapter while observing ultrasound images, improving the convenience and accuracy of puncture operations.
Smart Images

Figure CN122140287A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to an ultrasound diagnostic system, and more particularly to the display of ultrasound images. Background Technology
[0002] Ultrasound diagnostic devices acquire biological information about a subject by sending ultrasound waves into the body through an ultrasound probe and receiving the reflected waves. The acquired biological information is displayed as an ultrasound image representing the state of the subject. For example, in the case of using an ultrasound diagnostic device for laparoscopic surgery, the ultrasound probe is inserted into the abdominal cavity through a trocar positioned in the body wall of the subject.
[0003] During laparoscopic surgery, punctures are sometimes performed. The surgeon inserts a puncture needle into the abdominal cavity and observes the laparoscopic images to confirm the needle's position. After the tip of the puncture needle reaches the target site, the surgeon may collect tissue samples or inject medication into the target site.
[0004] The puncture needle is guided either through a through-hole provided in the ultrasonic probe or using a separately prepared needle guide. Previously, a puncture adapter that can be attached to and detached from the ultrasonic probe and guides the puncture needle at a desired angle has been proposed (e.g., Patent Document 1).
[0005] Patent Document 1: Japanese Patent Application Publication No. 2013-233261
[0006] For example, if a puncture adapter capable of puncturing at a fixed angle can be installed on an ultrasonic probe that can puncture at any angle within a specified angle range, then by using this single ultrasonic probe, both arbitrary-angle puncture and fixed-angle puncture can be performed.
[0007] However, sometimes punctures are performed while observing the ultrasound image of the body cavity generated and displayed based on the received signal obtained through the aforementioned ultrasound probe. In this case, it is more convenient to observe the ultrasound image and confirm the possible puncture angle, which varies depending on whether a puncture adapter is installed. Summary of the Invention
[0008] The purpose of this invention is to display the angle at which puncture can be performed based on the installation status of the puncture adapter to the ultrasonic probe.
[0009] The present invention relates to an ultrasound diagnostic system, characterized in that it comprises: an ultrasound probe having a front end portion inserted into a body cavity; a puncture adapter detachably mounted on the front end portion; and a processor that forms an ultrasound image based on a received signal from the ultrasound probe and generates and displays a graphic image superimposed on the ultrasound image. The front end portion has a main guide hole that guides a puncture needle at any angle within a predetermined angle range. The puncture adapter has: an insertion portion that is inserted into the main guide hole when mounted on the ultrasound probe; and a secondary guide hole that guides the puncture needle at a fixed angle. The processor performs the following processing: determining whether the puncture adapter is installed in the body cavity toward the front end portion; and generating, as the graphic image, a first graphic image representing the predetermined angle range when the puncture adapter is not installed at the front end portion, and a second graphic image representing the fixed angle when the puncture adapter is installed at the front end portion.
[0010] Furthermore, the first graphic image may have a first line and a second line representing the upper and lower limits of the specified angle range, respectively.
[0011] Furthermore, the processor can determine the position and tilt angle of the first line and the second line based on pre-registered specification information.
[0012] Furthermore, the second graphic image may have a third line representing the fixed angle.
[0013] Furthermore, the processor can determine the position and tilt angle of the third line based on pre-registered specification information.
[0014] Furthermore, the specification information may include the position information of the origin in the graphic image and the angle of the reference line that serves as the reference line passing through the origin and is used to determine the tilt angle of the lines in the graphic image, based on the positional relationship with the specified position in the front end.
[0015] Furthermore, the processor can determine whether the puncture adapter is installed on the front end based on input from the user.
[0016] Furthermore, it may include a laparoscope, and the processor determines whether the puncture adapter is installed on the front end based on photographic images from the laparoscope.
[0017] -Invention Effects-
[0018] According to the present invention, the angle at which puncture can be performed can be displayed based on the installation state of the puncture adapter toward the ultrasonic probe. Attached Figure Description
[0019] Figure 1 This is a block diagram showing the general structure of the ultrasound diagnostic device in this embodiment.
[0020] Figure 2 This is a perspective view showing an example of the head of the probe in this embodiment, magnified.
[0021] Figure 3 This is a three-dimensional view of the probe head in this embodiment.
[0022] Figure 4 This is a perspective view of the puncture adapter in this embodiment.
[0023] Figure 5 This is a side sectional view of the head of the probe in this embodiment, with the puncture adapter installed.
[0024] Figure 6 This is a schematic diagram showing the area displayed in this embodiment.
[0025] Figure 7 This is a schematic diagram illustrating the line display in this embodiment.
[0026] Figure 8 This is a schematic diagram illustrating a modified example of line display in this embodiment.
[0027] Figure 9 This is a schematic diagram illustrating a modified example of the area display in this embodiment.
[0028] Figure 10 This is a diagram showing an example of the operation panel in this embodiment.
[0029] Figure 11 This is an enlarged view showing a portion of the head in this embodiment without the puncture adapter installed.
[0030] Figure 12 This is an enlarged view showing a portion of the head in this embodiment with the puncture adapter installed.
[0031] Figure 13 This is a schematic diagram illustrating a modified example of the area display in this embodiment.
[0032] Figure 14 This is a schematic diagram illustrating another variation of the area display in this embodiment.
[0033] Symbol Explanation
[0034] 10-Ultrasound diagnostic device, 12-Cable, 20-Abdominal wall, 22, 32-Cannula, 24-Abdominal cavity, 26-Puncture needle, 28-Organ, 30-Tumor, etc., 100-Control console, 106-First display unit, 108-Second display unit, 110-Operation panel, 110a-Switch, 110b-Trajectory ball, 112-Transmit / receive control unit, 114-Beamforming (BF) unit, 116-Signal processing unit, 118-Image processing unit, 120- Display processing unit, 122-control unit, 200-probe, 202-handle unit, 204-insertion unit, 206-operation unit, 208-bending unit, 210-head, 212-oscillator array, 214, 214'-through holes, 216-notch for guiding puncture needle, 220-marker, 300-laparoscopy, 400, 400'-puncture adapter, 402-body unit, 404-insertion unit, 406, 406'-needle guide hole, 408-clamp. Detailed Implementation
[0035] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.
[0036] (Structure of an ultrasound diagnostic device)
[0037] Figure 1 This is a block diagram showing the schematic structure of the ultrasound diagnostic apparatus 10 in this embodiment. The ultrasound diagnostic apparatus 10 in this embodiment includes a main body 100, a probe 200, and a laparoscope 300. The ultrasound diagnostic apparatus 10 can also be referred to as an ultrasound diagnostic system. The ultrasound diagnostic apparatus 10 has the function of performing ultrasound diagnosis using the probe 200 and the laparoscope 300.
[0038] The main body 100 of the device, also referred to as a "control console," has interfaces (IFs) 102 and 104 for connecting the probe 200 and the laparoscope 300, a first display unit 106, a second display unit 108, and an operation panel 110 as user interfaces. Each display unit 106 and 108 is a device for displaying images, and may be constructed, for example, a liquid crystal panel or an organic EL panel. The first display unit 106 displays an ultrasound image generated based on the ultrasound signal received by the probe 200. The second display unit 108 displays a photographic image based on the laparoscope 300. The operation panel 110 is a device operated by the surgeon or other operator (hereinafter also referred to as "user") for controlling the input and display of parameters, etc., during ultrasound diagnosis.
[0039] The control console 100 performs ultrasound diagnostic processing functions and includes a transceiver control unit 112, a beamforming (BF) unit 114, a signal processing unit 116, an image processing unit 118, a display processing unit 120, and a control unit 122.
[0040] The transceiver control unit 112 controls the ultrasonic transceiver based on each vibrating element within the probe 200. This control includes, for example, supplying electrical transmission signals to each vibrating element and amplifying electrical reception signals from each vibrating element. In supplying transmission signals, the transceiver control unit 112 forms an ultrasonic transmission beam by controlling the timing of supplying transmission signals to each vibrating element.
[0041] The beamforming unit 114 performs phase-integration and summation processing on the received signals from each vibrating element within the probe 200. This phase-integration and summation processing forms a receiving beam. The beamforming unit 114 outputs echo data obtained along the receiving beam as the result of the phase-integration and summation processing. Furthermore, when performing transmit beamforming, the beamforming unit 114 generates multiple transmit signals for transmit beamforming.
[0042] The signal processing unit 116 performs various signal processing operations on the echo data output by the beamforming unit 114, such as gain correction, logarithmic amplification, envelope detection, and filtering.
[0043] The image processing unit 118 has coordinate transformation and interpolation functions, and forms a display frame, i.e., an ultrasound image, based on multiple beam data output from the signal processing unit 116. The beam data from the signal processing unit 116 is data in a beam scanning coordinate system, consisting of multiple data points along the direction of the beam corresponding to the beam data. The image processing unit 118 transforms, for example, the signal values of each data point of the beam data into the display coordinate system, i.e., the coordinate system of the ultrasound image (typically an orthogonal coordinate system represented by a set of x and y coordinates). Furthermore, the image processing unit 118 interpolates the values of pixels without values based on the values of surrounding pixels. The image processing unit 118 forms ultrasound images, such as B-mode tomography images, through this coordinate transformation and interpolation.
[0044] The display processing unit 120 synthesizes images or characters representing various information from the ultrasonic image formed by the image processing unit 118 to form display screen data. The information synthesized from the ultrasonic image includes, for example, ROIs representing the display range of various display modes such as color Doppler modes, and lines representing the sample volume of a pulse Doppler mode or the beam in which that sample volume is located. Furthermore, the display processing unit 120 displays the display screen data formed as described above on the first display unit 106.
[0045] Furthermore, the control unit 122 controls the execution of ultrasound diagnostic processing by controlling the operation of each component included in the console 100.
[0046] The components 102 to 122 in the console 100 are realized through the coordinated action of the computer mounted on the console 100 and the program running in the CPU of the computer.
[0047] The probe 200 is connected to the ultrasound diagnostic device 10 via cable 12. In this embodiment, the probe 200 is an intra-abdominal insertion type ultrasound probe. "Abdominal cavity" refers to the internal space of a person, the portion surrounded by the abdominal wall lower than the diaphragm; more specifically, it is the space surrounded by the abdominal wall and containing digestive organs such as the stomach and intestines. "Body cavity" refers to the space between the body wall and the digestive tract, primarily the thoracic cavity, pericardial cavity, and abdominal cavity. In this embodiment, "abdominal cavity" and "body cavity" are used with the same meaning.
[0048] The probe 200 mainly includes a handle 202 for the operator to hold and an insertion part 204 extending from the handle 202 and inserted into the abdominal cavity. The probe 200 can include the aforementioned cable 12 as a component. An operating part 206 for operator manipulation is provided in the handle 202. A cannula (guide tube) 22 passing through the abdominal wall 20 is installed on the abdominal wall 20 for use by the probe 200, but the insertion part 204 of the probe 200 is inserted into the abdominal cavity 24 through the internal channel of the cannula 22. If the inner diameter of the cannula 22 is set to about 12 mm, then the outer diameter of the insertion part 204 of the probe 200 needs to be smaller than this inner diameter, for example, about 10 mm.
[0049] The insertion portion 204 includes: a bending portion 208, which bends upwards, downwards, or left and right according to the operation of the operation portion 206; and a front end portion (hereinafter referred to as the "head") 210, located at the front end side extending from the bending portion 208. In the head 210, a transducer array 212 is arranged in the longitudinal direction. The transducer array 212 corresponds to the aforementioned "vibrating elements". The ultrasound diagnostic device 10 performs ultrasound diagnosis on the body cavity by oscillating ultrasound waves from the transducer array 212. The operator bends the bending portion 208 by operating the operation portion 206, thereby ensuring a diagnostic field of view. A through hole for guiding the puncture needle is provided on the bending portion 208 side of the head 210. Alternatively, a puncture needle guide notch may be provided on the front end side of the head 210.
[0050] Furthermore, a puncture needle guide adapter (hereinafter referred to as "puncture adapter") 400 is installed at the location where the through hole is provided. The puncture needle 26 is inserted into the abdominal wall 20. The tip portion of the puncture needle 26 passes through the needle guide hole provided in the puncture adapter 400 to reach the target site, such as a tumor 30 in organ 28.
[0051] Furthermore, a cannula 32 for inserting the laparoscope 300 into the abdominal cavity 24 is mounted on the abdominal wall 20. A light source (not shown) is provided at the front end of the laparoscope 300, and the laparoscope 300 is operated by the user to photograph the illumination range of the light source, such as the range including the head 210 of the probe 200.
[0052] The above uses Figure 1 The structure of the ultrasound diagnostic device 10 and the relationship between the human body, the object of ultrasound diagnosis, and the ultrasound diagnostic device 10 are described. The ultrasound diagnostic device 10 in this embodiment can be configured with a hardware structure that is basically the same as that of the conventional ones.
[0053] (Structure of probe 200 and puncture adapter 400)
[0054] Figure 2 It is an enlarged representation Figure 1 A perspective view of an example of the head 210 of the probe 200 shown. Figure 2 As shown, a puncture adapter 400 can be installed on the head 210. A perspective view of the head 210 without the puncture adapter 400 installed is shown below. Figure 3 . Figure 2 This is a perspective view of the right side of the head 210 as seen from the direction of the bend 208. In contrast, Figure 3 This is a three-dimensional view of the left side of head 210 as viewed from the front end of head 210. Figure 4 This is a perspective view of the puncture adapter 400 in this embodiment. Figure 4 The puncture adapter 400 shown is a perspective view taken from the direction of arrow B, i.e., from the side of the bend 208 when it is installed on the probe 200. Figure 5 This is a side sectional view of the puncture adapter 400 installed on the head 210. Additionally, the head 210 may contain internal components such as circuitry for transmitting and receiving ultrasonic signals, but... Figure 5 Illustrations are omitted. The following uses... Figures 1-5 The engagement relationship between probe 200 and puncture adapter 400 is explained.
[0055] The probe 200, or head 210, has a transducer array 212 and a through hole 214 for guiding the puncture needle at its front end. In this embodiment, the probe 200 has the through hole 214 on the bent side of the transducer array 212. The through hole 214 may also be located further forward than the transducer array 212. In this embodiment, the head 210 has a puncture needle guiding notch 216 formed at its front end. By increasing the notch size from the upper surface to the lower surface of the head 210, the puncture needle guiding notch 216 can guide the tip of the puncture needle 26 into the space below the transducer array 212.
[0056] The cross-sectional shape of the needle inlet portion of the through-hole 214 is an inverted triangle. That is, it narrows from the needle inlet portion toward the needle outlet portion of the through-hole 214. This allows the needle to be guided so that its tip, inserted into the through-hole 214, enters below the oscillator array 212. Even without the puncture adapter 400 installed on the probe 200, this shape of the through-hole 214 allows punctures to be performed within a specified angle range. In the following description, punctures guided at any angle within the specified angle range are referred to as "regional punctures."
[0057] On at least one side of the head 210, a triangular mark 220 is attached at a position corresponding to the through hole 214. The mark 220 is a marker to guide the installation of the puncture adapter 400. The mark 220 is printed in the shape of an inverted triangle according to the shape of the through hole 214. Thus, even if the needle entry portion of the through hole 214 cannot be visually identified in the second display unit 108, the user can know the position and size of the needle entry portion of the through hole 214 simply by seeing the mark 220.
[0058] The puncture adapter 400 is generally divided into an adapter body and a clamping mechanism. The adapter body has a main body portion 402 and an insertion portion 404, and further has a needle guide hole 406 communicating with the main body portion 402 and the insertion portion 404.
[0059] The main body 402 is formed in the shape of a thin plate and is arranged to cover the needle inlet portion of the through hole 214 of the probe 200 when it is installed on the probe 200. The main body 402 is formed in a streamlined shape such that the thickness of both ends of the probe 200 in the insertion and removal direction of the cannula needle 22 decreases, so that insertion and removal of the cannula needle 22 can be performed smoothly when the probe 200 is installed on it.
[0060] If the puncture adapter 400 is installed on the head 210, the insertion part 404 is inserted into the through hole 214 formed in the probe 200. The insertion part 404 is formed in an inverted triangle shape according to the shape of the through hole 214 formed in the probe 200.
[0061] The needle guide hole 406 extends straight through the needle inlet portion provided on the upper surface of the main body 402 to the needle outlet portion provided at the front end of the constricted opening of the insertion portion 404, guiding the puncture needle 26 inserted from the main body 402 to the target site (in this embodiment, a tumor, etc. 30).
[0062] In a probe 200 with the puncture adapter 400 installed, punctures can be performed at a fixed angle. In the following description, punctures that guide the puncture needle at a specified fixed angle are referred to as "thread punctures".
[0063] According to this embodiment, regional puncture can be performed in the probe 200 when the puncture adapter 400 is not installed. Furthermore, the puncture adapter 400 in this embodiment is shaped to be installed in the through hole 214 where regional puncture can be performed; therefore, suture puncture can be performed in the probe 200 when the puncture adapter 400 is installed. That is, by selecting whether to install the puncture adapter 400 on the probe 200 outside the abdominal cavity, the user can use the same probe 200 to perform either regional puncture or suture puncture.
[0064] On the other hand, the clamping mechanism is formed by a pair of clamps 408 that extend in opposite directions from the side of the main body 402 and are curved along the outer surface of the probe 200. The root portion of the pair of clamps 408, i.e., the part that engages with the main body 402, is formed of an elastic component such as spring steel. In order to prevent jamming when inserting and withdrawing the probe 200 from the insertion portion 204 of the cannula needle 22, the clamps 408 are formed in a curved shape along the outer surface of the mounting position of the probe 200.
[0065] When performing regional punctures, the user does not attach the puncture adapter 400 to the probe 200. However, when performing suture punctures, the user attaches the puncture adapter 400 to the probe 200 outside the body cavity. Specifically, the user aligns the puncture adapter 400 with the through-hole 214 of the head 210, inserts the insertion part 404 into the through-hole 214, and presses the main body 402 against the head 210 until the clamp 408 reliably holds it. Thus, the puncture adapter 400 is reliably installed, preventing it from falling off even when the probe 200 is inserted into or removed from the cannula 22.
[0066] (Display of ultrasound image)
[0067] As described above, in this embodiment, the puncture adapter 400 can be easily installed onto the probe 200 outside the body cavity, and the installation status of the puncture adapter 400 inside the body cavity can be easily confirmed. Furthermore, the probe 200, which passes through the cannula 22 through the abdominal wall 20, can be smoothly inserted and withdrawn. In this embodiment, if the puncture adapter 400 is not installed on the probe 200, regional puncture can be performed; on the other hand, by installing the puncture adapter 400 into the through hole 214 of the probe 200, suture puncture can be performed. However, although both regional and suture punctures can be performed using the same probe 200, it is more convenient to observe the ultrasound image displayed on the first display unit 106 while confirming the different puncture angles depending on whether the puncture adapter 400 is installed.
[0068] Therefore, in this embodiment, the angle at which puncture can be performed is displayed based on the installation state of the puncture adapter 400 on the probe 200. Specifically, when the puncture adapter 400 is not installed on the probe 200, a predetermined range of angles at which area puncture can be performed is displayed; when the puncture adapter 400 is installed on the probe 200, a fixed angle at which the suture is punctured is displayed.
[0069] The display is performed by the display processing unit 120 under the control of the control unit 122. That is, the display processing unit 120 forms an ultrasound image based on the received signal from the probe 200 and displays it on the first display unit 106, but generates a graphic image superimposed on the ultrasound image. Specifically, when the puncture adapter 400 is not installed on the head 210 of the probe 200, the display processing unit 120 generates a first graphic image representing a predetermined angle range, i.e., the range of angles from which area puncture can be performed. Furthermore, in the following description, the superimposed display of the generated first graphic image on the ultrasound image is also referred to as "area display."
[0070] On the other hand, when the puncture adapter 400 is installed on the head 210 of the probe 200, the display processing unit 120 generates a second graphic image as a graphic image, representing a predetermined fixed angle, i.e., the angle at which line puncture can be performed. Furthermore, in the following description, the superimposed display of the generated second graphic image on the ultrasound image is also referred to as "line display".
[0071] In the following description, the display that involves overlaying a first or second graphic image onto an ultrasound image is referred to as a "guided display." Guided display can also be considered a general term for area display and line display.
[0072] The following is a detailed description of the display of characteristic areas and lines in this embodiment, using the accompanying drawings.
[0073] Figure 6 This is a schematic diagram illustrating the area displayed in this embodiment. Figure 6 The image shown is an example of a screen display where a first graphic image is superimposed on a B-mode ultrasound image 502 displayed on the first display unit 106. Furthermore, for ease of explanation, in Figure 6 The image shows the positional relationship between the ultrasonic image 502 and the probe head 210, particularly the positional relationship between the transducer array 212 and the through hole 214 on the head 210. The first graphic image has a first line 504a and a second line 504b representing the upper and lower limits of a defined angular range, respectively. Furthermore, if the direction orthogonal to the transducer array 212 is considered... Figure 6If the vertical direction of the drawing represented by a single-dot dashed line is set to 0 degrees, then the inclination angle (hereinafter "inclination angle") of the first line 504a is θ1, and the inclination angle of the second line 504b is θ2. This angle depends on the angle of the inner wall of the through hole 214, which serves as the main guide hole for guiding the puncture needle.
[0074] like Figure 6 As shown, when the puncture adapter is not installed in the through hole 214, a specified angle range for puncture based on the first line 504a and the second line 504b is superimposed and displayed on the ultrasonic image 502, so that the user can perform puncture with reference to the displayed angle range.
[0075] In addition, Figure 6 The example shown illustrates displaying the first line 504a within the ultrasonic image 502 and the second line 504b extending beyond the ultrasonic image 502. However, the display range of each line 504a and 504b, i.e., the relationship between the ultrasonic image 502 and the first graphic image, can be appropriately determined. The same applies to line displays described later.
[0076] Figure 7 This is a schematic diagram illustrating the line display in this embodiment. Figure 7 The image shown is an example of a screen display where a second graphic image is overlaid on a B-mode ultrasound image 502 displayed on the first display unit 106. Furthermore, for ease of explanation, in Figure 7 The second graphic image shows the positional relationship between the ultrasonic image 502 and the probe head 210, particularly the positional relationship between the transducer array 212 of the head 210 and the puncture adapter 400 having an insertion portion inserted into the through hole 214. The second graphic image has a third line 504c representing a predetermined fixed angle. Furthermore, if the direction orthogonal to the transducer array 212 is... Figure 7 If the vertical direction of the plane represented by the single-dot dashed line is set to 0 degrees, then the tilt angle of the third line 504c is θ3. The tilt angle θ3 depends on the tilt angle of the needle guide hole 406, which is a secondary guide hole formed in the puncture adapter 400 that guides the puncture needle.
[0077] like Figure 7 As shown, with the puncture adapter 400 installed in the through hole 214 of the head 210, a prescribed angle for puncture based on the third line 504c is superimposed and displayed on the ultrasonic image 502, so that the user can perform puncture in a manner that the puncture needle will not fall off the third line 504c.
[0078] As explained above, in Figure 6 The image shows an example of a region display. Figure 7The image shows an example of an underlined display. However, the content displayed is not limited to this example. For example, in Figure 8 The image shows a variation of the line drawing.
[0079] exist Figure 8 In this process, since the puncture adapter 400 is installed in the through hole 214 of the head 210, it is essentially performed. Figure 7 The lines shown in the example are displayed. However, as... Figure 8 As shown, both line 504a and line 504b displayed in the area display can also be shown. In this case, the second graphic image has line 504a and line 504b in addition to line 3 504c. Alternatively, it can be said that the first graphic image is overlaid on the ultrasonic image 502 in addition to the second graphic image. Furthermore, each line 504a to 504c can be depicted by referring to the specification information described later.
[0080] exist Figure 9 In the process, since the puncture adapter 400 is not installed in the through hole 214 of the head 210, it is basically performed Figure 6 The area shown in the example is displayed. However, it is known that puncture can be performed between the first line 504a and the second line 504b, but the user may also want to predetermine the actual angle at which the puncture will be performed. Therefore, in this embodiment, it is assumed that the fourth line 506 can be displayed according to the instructions given by the user. The user inputs the display of the fourth line 506 and the display angle by operating the operation panel 110. The display processing unit 120 can generate a first graphic image including the fourth line 506 according to the user's instructions, and can also generate a third graphic image having the fourth line 506, and overlay the first graphic image and the third graphic image in the ultrasound image 502.
[0081] However, in this embodiment, the control unit 122 determines whether the puncture adapter 400 is installed on the probe 200 and selects either a display mode, i.e., a region display or a line display. Here, the method for determining whether the puncture adapter 400 is installed will be explained.
[0082] Figure 10 This diagram illustrates an example of the operation panel 110 in this embodiment. A switch 110a for selecting a display mode is provided on the operation panel 110. Furthermore, a switch for user instruction is also provided. Figure 9 The trackball 110b at the angle of line 506 is shown. With the puncture adapter 400 installed on the probe 200, the user operates switch 110a to select line display. Furthermore, without the puncture adapter 400 installed on the probe 200, the user operates switch 110a to select area display. Figure 6The image shows an example of a selected area being displayed. The control unit 122 determines whether the puncture adapter 400 is installed on the probe 200 based on input instructions from the user.
[0083] Furthermore, when the user selects "Display Off" by operating switch 110a, the control unit 122 does not instruct the display processing unit 120 to generate graphics or images. Therefore, Figures 6-8 The lines 504a to 504c shown in the example are not displayed in the ultrasound image.
[0084] Furthermore, when the user selects "automatic" by operating switch 110a, the control unit 122 determines whether the puncture adapter 400 has been installed on the head 210, rather than relying on the user's selection. In this embodiment, since the laparoscope 300 is connected to the ultrasound diagnostic device 10, the control unit 122 can make the determination based on the photographic images from the laparoscope 300.
[0085] For example, if the console 100 acquires a photographic image from the laparoscope 300, the control unit 122 analyzes the photographic image to extract the head 210 and determines whether the puncture adapter 400 is installed on the extracted head 210. For example, an image of the head 210 without the puncture adapter 400 is acquired beforehand as a reference image. Furthermore, since it is unclear from which angle the laparoscope 300 photographed the head 210, it is preferable to set the reference image as a three-dimensional image. Alternatively, multiple two-dimensional images may be prepared.
[0086] In summary, the control unit 122 compares the image of the head 210 extracted from the photographed image with a reference image. If the comparison result determines that the captured image of the head 210 is the same as the reference image, the control unit 122 determines that the puncture adapter 400 is not installed. At this time, the control unit 122 selects an area display and instructs the display processing unit 120 to generate a first graphic image. On the other hand, if the comparison result determines that they are different, the control unit 122 determines that the puncture adapter 400 is installed. At this time, the control unit 122 selects a line display and instructs the display processing unit 120 to generate a second graphic image.
[0087] Automatic determination based on photographic images from the laparoscope 300 is one example, but it is not limited to this. For example, an image of the head 210 with the puncture adapter 400 installed can be used as a reference image, or images of both can be used as reference images.
[0088] Furthermore, while the installation of the aforementioned puncture-free adapter 400 is described as being performed by the control unit 122, it can also be implemented in conjunction with other components. For example, the control unit 122 can also instruct the image processing unit 118 to perform image analysis on the photographed image.
[0089] Furthermore, a learning model generated by performing machine learning on images of the head 210 with and without the puncture adapter 400 installed can be used. This learning model does not necessarily need to be executed in the console 100 and can be generated using another computer. In short, the learning model is pre-registered in the console 100 when it is used. Furthermore, if the console 100 acquires a radiographic image from the laparoscopy 300, the control unit 122 inputs the radiographic image into the learning model and uses the output of the learning model, i.e., whether or not the puncture adapter 400 is installed, as the determination result.
[0090] Furthermore, in this embodiment, the user is allowed to choose between area display and line display, and can then automatically determine whether the piercing adapter 400 is installed on the head 210. However, the method for determining whether the piercing adapter 400 is installed on the head 210 is just one example; other methods may also be used. Also, in this embodiment, the user is allowed to select the display mode by operating the switch 110a, and can then select the automatic determination of the display mode; however, it is also possible to use only one of these methods.
[0091] As explained above, according to this embodiment, the content of the guided display (i.e., area display or line display) is determined based on whether the puncture adapter 400 is installed on the head 210. The user only needs to use the lines 504a to 504c displayed through the guided display as a reference when performing the puncture.
[0092] However, it is possible that lines 504a to 504c are always displayed correctly. For example, the head 210 of probe 200 or the puncture adapter 400 is manufactured according to design specifications (hereinafter referred to as "design information"), but the manufacturing result may contain discrepancies between the design information and the actual product. Therefore, in this embodiment, a scheme is provided to eliminate such errors. The correction method for eliminating this error will be described below.
[0093] Figure 11 This is an enlarged view showing a portion of head 210 without the puncture adapter installed. Figure 11 The image shows the oscillator array 212 and the through hole 214. No piercing adapter 400 is installed in the through hole 214, indicating an example of a zone display. Figure 11 In the diagram, the through hole 214, represented by a single-dot dash, indicates the reference position that should be formed according to the design information, while the through hole 214', represented by a solid line, indicates a through hole that, although formed according to the design information, is actually formed at a position deviating from the reference position.
[0094] During invasive puncture, the puncture needle always passes through the exit of the through hole 214, regardless of the angle at which it is inserted. Therefore, in this embodiment, the exit of the through hole 214 is defined as the origin of the two-dimensional coordinate system in the first graphic image.
[0095] In a two-dimensional coordinate system, the direction along the oscillator array 212 is defined as the X-axis, and the direction orthogonal to the oscillator array 212 is defined as the Y-axis. If the coordinates of the origin in the through hole 214 are set to (Xa, Ya), and the coordinates of the origin in the through hole 214' are set to (Xa', Ya'), it means that in the X-axis direction, an error of DxA (=Xa'-Xa) is generated in the actual product.
[0096] However, in the area display, a first graphic image, representing the range of puncture angles indicated by the through-hole 214, is overlaid on the ultrasonic image generated based on the transducer array 212. Therefore, by setting a predetermined position in the transducer array 212 as a reference point R, the origin in the first graphic image can be determined as long as the relative position from this reference point R to the exit of the through-hole 214 is known. Figure 11 In this design, the corner of the oscillator array 212 closest to the through hole 214 is set as the reference point R. Furthermore, the position (Xa, Ya) of the oscillator array 212 relative to the origin from the reference point R can be determined based on the design information of the probe 200. Figure 11 In practice, an error DxA (=Xa´-Xa) is generated, but it can be corrected to the actual X-axis position Xa´ (=Xa+DxA) of the origin. Regarding the Y-axis direction, although not illustrated, it can be corrected in the same way as the X-axis direction.
[0097] Incidentally, a specific position in the head 210 can also be set as a reference point. However, considering that errors may also occur in the installation position of the oscillator array 212 in the head 210, it is preferable to set any position in the oscillator array 212 as a reference point.
[0098] As described above, if the actual position of the through hole 214' can be determined, the display processing unit 120 draws each line 504a, 504b at a predetermined angle, starting from the origin (Xa', Ya').
[0099] However, while the position of the origin can be corrected as described above, errors may also occur in determining the inclination angles θ1 and θ2 of the inner wall of the through hole 214, which determine the inclination angles θ1 and θ2 of each line 504a and 504b. Incidentally, the inclination angle θ1 of the first line 504a is determined by the inclination angle θu in the through hole 214. The inclination angle θ2 of the second line 504b is determined by the inclination angle θb in the through hole 214. As described above, due to errors generated during the manufacturing process, the inclination angle of the inner wall in the actually formed through hole 214' may be angle θu' (≠ θu) or angle θb' (≠ θb). Therefore, the angles θu and θb of the inner wall in the through hole 214 are corrected to θu' and θb'.
[0100] The origin (Xa', Ya') and angles θu' and θb' in the aforementioned actual through-hole 214' are known through pre-shipment inspection of the probe 200. Therefore, as described above, the origin (Xa, Ya) and angles θu and θb are corrected in the design to create specification information. In this specification information, the position information of the origin in the first graphic image, i.e., the coordinate data (Xa', Ya'), is set according to the positional relationship with the specified position in the head 210 (the aforementioned "reference point R"). If we assume that the first and second reference lines pass through the origin, the tilt angle θu' in the first reference line and the tilt angle θb' in the second reference line are set. This specification information is stored in the ultrasonic diagnostic device 10 connected to the probe 200.
[0101] The display processing unit 120 generates a first graphic image based on specification information. That is, the display processing unit 120 draws a first line 504a with the origin (Xa', Ya') as the starting point and the tilt angle θu' in the first reference line as θ1. And, the display processing unit 120 draws a second line 504b with the origin (Xa', Ya') as the starting point and the tilt angle θb' in the second reference line as θ2.
[0102] According to this embodiment, the first line 504a and the second line 504b can be drawn based on the specifications of the actual probe 200 used, rather than on the design information. Therefore, the user can perform punctures within the specified range consistent with the actual probe 200 used.
[0103] Figure 12 This is an enlarged view showing a portion of the head 210 with the puncture adapter 400' installed. Figure 12 In addition to the oscillator array 212 and the through hole 214, a piercing adapter 400 is also shown. The piercing adapter 400 is installed in the through hole 214, thus indicating an example of a line display. Figure 12In the diagram, the through hole 214, represented by a double-dotted line, indicates a reference position to be formed according to the design information, and the piercing adapter 400, represented by a single-dotted line, indicates a piercing adapter installed in the through hole 214. On the other hand, the through hole 214', represented by a dashed line, indicates a through hole that, although formed according to the design information, is actually formed at a position deviating from the reference position. The piercing adapter 400', represented by a solid line, indicates a piercing adapter actually installed in the through hole 214'.
[0104] During online puncture, the puncture needle always passes through the outlet of the needle guide hole 406 of the puncture adapter 400. Therefore, in this embodiment, the outlet of the needle guide hole 406 is set as the origin of the two-dimensional coordinate system in the second graphic image.
[0105] The basic concept of position correction in the line display is the same as that explained in the area display. If the origin coordinates of the exit of the needle guide hole 406 in the design are set to (Xl, Yl), and the origin coordinates of the exit of the needle guide hole 406' are set to (Xl', Yl'), it means that an error of DxL (=Xl'-Xl) has occurred in the actual product in the X-axis direction. Therefore, it can be corrected to the actual origin X-axis position Xl' (=Xl+DxL). Regarding the Y-axis direction, although not illustrated, it can be corrected in the same way as the X-axis direction.
[0106] Furthermore, errors may also occur in determining the tilt angle θl of the needle guide hole 406, which determines the tilt angle θ3 of the third line 504c. Therefore, the tilt angle θl of the needle guide hole 406 is corrected to θl´.
[0107] The origin (Xl', Yl') and angle θl' of the needle guide hole 406' in the actual puncture adapter 400' are determined by installing the actual manufactured puncture adapter 400' into the through hole 214' of the head 210 and inspecting it before leaving the factory. Therefore, as described above, the origin (Xl, Yl) and angle θl in the design are corrected to create specification information. In this specification information, the position information of the origin in the second graphic image, i.e., the coordinate data (Xl', Yl'), and the tilt angle θl' in a third reference line passing through the origin are set according to the positional relationship with the specified position in the head 210 (the aforementioned "reference point"). This specification information is stored in the ultrasound diagnostic device 10 connected to the probe 200.
[0108] The display processing unit 120 generates a second graphic image based on the specification information. That is, the display processing unit 120 draws the third line 504c with the origin (Xl´, Yl´) as the starting point and the tilt angle θl´ in the third reference line as θ3.
[0109] According to this embodiment, the third line 504c can be drawn according to the specifications of the actual probe 200 used, rather than according to design information. Therefore, the user can perform puncture at a fixed angle consistent with the actual probe 200 used.
[0110] In this embodiment, specification information including the corrected origin coordinates and tilt angle values is sent to the console 100. However, specification information may also be created in a manner that includes correction values, such as the aforementioned DxA, DxL, or tilt angle error, and stored in the console 100 along with the design information. In this case, the display processing unit 120 corrects the origin and tilt angle when generating the graphic image and then displays each line 504a to 504c.
[0111] However, in the case of regional puncture, the user... Figure 6 The area shown in the example is used as a reference. The tilt angle of line 1 (504a) is set to the upper limit, and the tilt angle of line 2 (504b) is set to the lower limit for piercing. When displaying this area, for user convenience, the display method can be similar to... Figure 6 The areas shown are displayed differently. For example, in an ultrasound image, the area enclosed by line 1 504a and line 2 504b and the area outside of that area are displayed differently.
[0112] Figure 13 This is a schematic diagram illustrating a modified example of the area display in this embodiment. Figure 13 In the middle, the inner side of the area enclosed by line 1 504a and line 2 504b is usually displayed, that is, in conjunction with Figure 6 In the same way, on the other hand, the outer part can be displayed in a way that is difficult or impossible to visually discern. For example, the brightness of the outer image area can be reduced to make it appear darker.
[0113] Figure 14 This is a schematic diagram illustrating another variation of the area display in this embodiment. Figure 14 In this design, the outer portion of the area enclosed by lines 1 504a and 2 504b is typically displayed, while the inner portion of that area is displayed in a manner that is easily visually recognizable or easily attracts attention. For example, the brightness of the inner image area is increased to make it appear brighter, or it is displayed with a bright background color.
[0114] Thus, by making the display different in the areas where puncture can be performed and the areas where puncture cannot be performed, users can improve the visual recognition of the areas where puncture can be performed.
[0115] According to this embodiment, it is configured to perform area display or line display based on the installation of the puncture adapter 400. In area display, the range of angles capable of area puncture is shown by lines 504a and 504b. In line display, the angle capable of line puncture is shown by the third line 504c. Furthermore, in Figure 6 In the diagram, dashed lines represent lines 504a and 504b. Figure 7 In the diagram, the third line 504c is represented by a dashed line, and then... Figure 9 In the example, line 4 (506) is represented by a double-dotted line. These examples illustrate that lines do not need to be displayed with the same line type; different line types can be used. Furthermore, not limited to line types, lines 504a-504c and 506 can be displayed in various ways, such as by using different colors or by continuously displaying symbols like "+". In graphic images, line types other than those used in ultrasound images can be used to easily distinguish whether a line displayed on the screen is from the ultrasound image or the graphic image.
Claims
1. An ultrasonic diagnostic system, characterized in that, have: An ultrasonic probe with a front end that can be inserted into a body cavity; A puncture adapter, detachably mounted on the front end; and The processor forms an ultrasonic image based on the received signal from the ultrasonic probe, and generates a graphic image superimposed on the ultrasonic image for display. The front end has a main guide hole that guides the puncture needle at any angle within a specified angle range. The puncture adapter has: The insertion part is inserted into the main guide hole when installed on the ultrasonic probe; and The secondary guide port guides the puncture needle at a fixed angle. The processor performs the following processing: Determine whether the puncture adapter is installed at the anterior end within the body cavity; and As the graphic image, when the puncture adapter is not installed at the front end, a first graphic image representing the specified angle range is generated; when the puncture adapter is installed at the front end, a second graphic image representing the fixed angle is generated.
2. The ultrasonic diagnostic system according to claim 1, characterized in that, The first graphic image has a first line and a second line that respectively represent the upper and lower limits of the specified angle range.
3. The ultrasonic diagnostic system according to claim 2, characterized in that, The processor determines the position and tilt angle of the first line and the second line based on pre-registered specification information.
4. The ultrasonic diagnostic system according to claim 3, characterized in that, In the specification information, based on the positional relationship with the specified position in the front end, the positional information of the origin in the graphic image and the angle of the reference line, which serves as the reference line passing through the origin and is used to determine the tilt angle of the line in the graphic image are set.
5. The ultrasonic diagnostic system according to claim 1, characterized in that, The second graphic image has a third line representing the fixed angle.
6. The ultrasonic diagnostic system according to claim 5, characterized in that, The processor determines the position and tilt angle of the third line based on pre-registered specification information.
7. The ultrasonic diagnostic system according to claim 6, characterized in that, In the specification information, based on the positional relationship with the specified position in the front end, the positional information of the origin in the graphic image and the angle of the reference line, which serves as the reference line passing through the origin and is used to determine the tilt angle of the line in the graphic image are set.
8. The ultrasonic diagnostic system according to claim 1, characterized in that, The processor determines whether the puncture adapter has been installed on the front end based on input from the user.
9. The ultrasonic diagnostic system according to claim 1, characterized in that, The ultrasound diagnostic system includes a laparoscope. The processor determines whether the puncture adapter is installed at the front end based on the photographic images from the laparoscope.
Citation Information
Patent Citations
Ultrasonic probe in body cavity and puncture adapter
JP2013233261A