Electronic Endoscope System

The electronic endoscope system addresses noise interference in ultrasound images by employing frequency detection and filter processing to generate accurate ultrasound images, improving image quality by attenuating unwanted frequencies and adjusting ultrasound parameters.

JP7577045B2Active Publication Date: 2024-11-01PENTAX MEDICAL CONTRACT CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2021169093
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-10-14
Publication Date
2024-11-01
Estimated Expiration
2041-10-14

AI Technical Summary

Technical Problem

Conventional ultrasound image processors are ineffective in reducing unintended noise components, such as electromagnetic interference and artifacts, which degrade the accuracy of ultrasound images acquired by electronic endoscopes.

Method used

An electronic endoscope system equipped with a frequency band detection section and a filter processing section that attenuates noise components above a preset threshold, adjusts ultrasound pulse duration, and applies gain changes to suppress noise, using low-pass and band-pass filters to refine echo signals and generate accurate ultrasound images.

Benefits of technology

The system effectively suppresses noise components, enabling the generation of highly accurate ultrasound images by filtering out unwanted frequencies and adjusting ultrasound parameters to minimize interference and artifacts.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007577045000001
    Figure 0007577045000001
  • Figure 0007577045000002
    Figure 0007577045000002
  • Figure 0007577045000003
    Figure 0007577045000003
Patent Text Reader

Abstract

To generate a highly accurate ultrasonic image by suppressing a noise component included in the ultrasonic image when acquiring the ultrasonic image by using an ultrasonic probe.SOLUTION: An electronic endoscope system according to an embodiment of the present invention for acquiring an ultrasonic image comprises: an electronic endoscope including an image pickup device which images a biological tissue and an ultrasonic probe which obtains an echo signal by applying the ultrasonic wave to the biological tissue at its tip; a processor for photographed image including an image processing unit which processes an imaging signal output from the image pickup device to generate the photographed image; and a processor for ultrasonic image including an ultrasonic image processing unit which generates an ultrasonic image by processing the echo signal output from an ultrasonic probe, a frequency band detection unit which detects a frequency band of a noise component equal to or greater than a preset threshold level included in the echo signal and a filter processing unit which performs filter processing on the echo signal so as to attenuate a signal of the detected frequency band.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an electronic endoscope system for acquiring ultrasound images. [Background technology]

[0002] Electronic endoscope systems are used for observing and treating biological tissues inside the human body. In addition to obtaining optical observation images of a subject using an imaging element as images of biological tissues, electronic endoscope systems can also obtain ultrasound images (ultrasonic tomographic images) using an ultrasound endoscope equipped with an ultrasound probe. A processor connected to the ultrasound endoscope functions as an ultrasound diagnostic device and performs examinations and diagnoses. Hereinafter, an endoscope equipped with an imaging element and an ultrasound probe will be referred to as an ultrasound endoscope (or electronic endoscope).

[0003] The ultrasonic endoscope includes an imaging element and an ultrasonic probe, and an imaging signal transmission line is disposed in a flexible tube extending from the ultrasonic endoscope to a processor, connecting the imaging element at the tip of the insertion section to a connector connected to the processor, and an imaging signal is transmitted through the imaging signal transmission line. Also, an ultrasonic signal transmission line is disposed in the flexible tube, connecting the ultrasonic probe at the tip of the insertion section to a connector connected to the processor, and an ultrasonic signal is transmitted through the ultrasonic signal line.

[0004] When performing an examination or diagnosis using ultrasound, the processor supplies power to the ultrasound probe, which transmits ultrasound to biological tissue and receives the reflected waves. The reflected waves received by the ultrasound probe are converted into echo signals, which are then sent to the processor via an ultrasound signal transmission line, where they are processed to produce an ultrasound image.

[0005] The processor includes a signal processing unit that processes data using transmission signals (ultrasound signals, imaging signals) from the ultrasonic endoscope, a control unit that controls image display, and a switching power supply. The switching power supply generates and supplies the voltages required to operate the ultrasonic endoscope and each of the constituent devices in the processor. The processor is connected to a monitor that displays the captured images and ultrasound images.

[0006] The ultrasonic image obtained based on the echo signal of the ultrasonic probe and displayed on the monitor may be contaminated with noise components generated in the ultrasonic endoscope or processor, or noise superimposed on the AC power supply and entering from the outside. The noise components include, for example, noise components caused by switching of the switching power supply, or noise components caused by mutual interference between the transmission lines. For example, in the flexible tube, the image signal transmission line and the ultrasonic signal transmission line are provided close to each other, so that the electrostatic coupling or electromagnetic coupling between the transmission lines becomes strong, and the pulse control signal or the like that controls the image sensor interferes with the ultrasonic probe or the ultrasonic signal transmission line, causing noise components to be mixed into the echo signal.

[0007] Furthermore, in ultrasound images, noise specific to ultrasound, called artifacts (virtual images that do not actually exist), may occur. Ultrasound is generated, and echoes reflected from inside the living body are received to obtain echo signals, but virtual images, i.e., artifacts, are generated as noise due to factors such as side lobe artifacts, grating lobes, and multiple reflections. In addition, artifacts may appear in ultrasound images generated by ultrasound diagnostic imaging when high-frequency noise generated by a switching power supply is superimposed on the received signal of the ultrasound signal.

[0008] Regarding these noise components in ultrasonic images, Patent Document 1 discloses an ultrasonic image processor that can remove periodic noise caused by the operation of a DC / DC converter. The processor is equipped with a main converter that receives power from a power input unit and outputs a constant-voltage power supply, and multiple sub converters that receive this constant-voltage power supply and output power supply to circuits that constitute the ultrasonic image processor, and the switching operations of the main converter and the sub converter are synchronized to reduce spike noise. [Prior art documents] [Patent documents]

[0009] [Patent Document 1] JP 2014-003801 A Summary of the Invention [Problem to be solved by the invention]

[0010] However, while the above-mentioned conventional ultrasonic image processor can remove periodic noise, it cannot reduce unintended noise. For example, unintended noise superimposed on the AC power supply may enter the ultrasound diagnostic device. In addition, when multiple devices are operating, unintended noise may enter the ultrasound diagnostic device. For example, when an endoscope and an ultrasound diagnostic device operate simultaneously, as in an ultrasound endoscopic system, electromagnetic waves generated by the operation of the endoscope are induced in the ultrasound probe, generating noise. When unintended noise like this gets into an ultrasound system, there is a problem in that the noise cannot be effectively removed.

[0011] Therefore, an object of the present invention is to provide an electronic endoscope system that can suppress noise components contained in an ultrasound image and generate a highly accurate ultrasound image when acquiring the ultrasound image using an ultrasound probe. [Means for solving the problem]

[0012] One aspect of the present invention is an electronic endoscope system for acquiring ultrasound images, comprising: an electronic endoscope having at its tip an imaging element for imaging biological tissue and an ultrasonic probe for applying ultrasonic waves to the biological tissue to obtain an echo signal; a captured image processor having an image processing unit that processes an image signal output from the imaging element to generate a captured image; an ultrasonic image processor including: an ultrasonic image processing unit that processes the echo signal output from the ultrasonic probe to generate an ultrasonic image; a frequency band detection unit that detects a frequency band of noise components included in the echo signal and equal to or higher than a preset threshold level; and a filter processing unit that performs a filter process on the echo signal so that the detected signal in the frequency band is attenuated; Equipped with picture, The ultrasonic image processor has an adjustment unit that adjusts a pulse duration of the ultrasonic waves applied to the biological tissue by the ultrasonic probe, The filter processing unit performs filter settings for the filtering process based on the pulse duration adjusted by the adjustment unit. It is characterized by:

[0013] The ultrasonic image processor has a low-pass filter that attenuates a signal of a frequency component equal to or higher than a predetermined frequency among the echo signals, The filtering unit may perform the filtering process so as to attenuate a signal having a frequency component of the echo signal that is equal to or higher than a frequency lower than the predetermined frequency.

[0014] The echo signal includes a signal component of a fundamental frequency and a harmonic component having a frequency N times the fundamental frequency (N: an integer of 2 or more), and The ultrasonic image processing unit generates the ultrasonic image based on the two or more harmonic components, The filter processing unit may perform a filter process on the echo signal so as to attenuate signals other than a frequency that is N times the fundamental frequency.

[0016] The ultrasound image processor may have a frequency change unit that changes the frequency of the ultrasound applied to the biological tissue by the ultrasound probe so as not to overlap with the frequency band of the noise components detected by the frequency band detection unit.

[0017] The ultrasound image processor may perform a gain change process such that an amplification gain value is changed between a noise pixel in the ultrasound image corresponding to the noise component and a pixel other than the noise pixel.

[0018] The ultrasound image processing unit may replace a pixel value at a noise pixel position in the ultrasound image corresponding to the noise component with an interpolated pixel value generated based on pixel values ​​of surrounding pixels located around the noise pixel position. Effect of the Invention

[0019] According to the above-described electronic endoscope system, when an ultrasonic image is acquired using an ultrasonic probe, noise components contained in the ultrasonic image can be suppressed, and a highly accurate ultrasonic image can be generated. [Brief description of the drawings]

[0020] [Figure 1] 1 is a block diagram showing an example of an overall configuration of an electronic endoscope system according to an embodiment; [Diagram 2] 1 is a diagram illustrating an example of an electronic endoscope equipped with an ultrasonic probe used in an electronic endoscope system according to an embodiment. [Diagram 3] 1A to 1C are diagrams illustrating the principle of forming an ultrasonic image in an electronic endoscope system according to an embodiment of the present invention. [Figure 4] 3A to 3C are diagrams illustrating an example of signal processing in which an echo signal is displayed as a B-mode ultrasound image when an ultrasound image is acquired in the electronic endoscope system of one embodiment. [Diagram 5] 5A and 5B are diagrams illustrating examples of filter characteristics applied to echo signals. [Figure 6]5A and 5B are diagrams illustrating examples of filter characteristics applied to echo signals. [Figure 7] 5A and 5B are diagrams illustrating examples of filter characteristics applied to echo signals. [Figure 8] 5A and 5B are diagrams illustrating examples of filter characteristics applied to echo signals. [Figure 9] 1A and 1B are diagrams illustrating an example of a digital echo signal and brightness after an echo signal including periodically occurring noise obtained by the electronic endoscope system of one embodiment passes through a band limiting filter. [Figure 10] 3A to 3C are diagrams illustrating an example of signal processing in which an echo signal is processed when an ultrasound image is acquired and then displayed as a B-mode ultrasound image in the electronic endoscope system of one embodiment. [Figure 11] FIG. 11 is a diagram showing an example of an operational flow of noise correction performed in the electronic endoscope system of the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] An electronic endoscope system according to one embodiment includes a captured image processor and an ultrasonic image processor. The captured image processor includes an electronic endoscope having at its tip an imaging element for imaging biological tissue, an ultrasonic probe for applying ultrasonic waves to the biological tissue to obtain echo signals, and an image processing unit for processing the imaging signals output from the imaging element to generate a captured image. The ultrasonic image processor includes an ultrasonic image processing unit, and processes the echo signals output from the ultrasonic probe to generate an ultrasonic image. Here, the echo signal output from the ultrasonic probe may contain unintended noise superimposed on the AC power supply that operates the electronic endoscope system. In addition, the echo signal may contain noise due to electromagnetic waves induced in the ultrasonic probe by the operation of the electronic endoscope. Such unintended noise may appear in the generated ultrasonic image and degrade the accuracy of the image. Therefore, in an electronic endoscope system according to one embodiment, the ultrasonic image processor includes a frequency band detection section and a filter processing section in order to effectively suppress unintended noise. The frequency detection unit detects a frequency band of noise components included in the echo signal and equal to or higher than a preset threshold level. The filter processing unit performs a filter process on the echo signal so that a signal in the frequency band detected by the frequency band detection unit is attenuated. In other words, the filter processing unit performs a filter process on the echo signal taking into account the frequency band of the detected noise components, thereby making it possible to effectively suppress unintended noise.

[0022] In the following description, an echo signal that does not include noise is referred to as an "ultrasonic signal." In other words, in this disclosure, an ultrasonic signal is a signal that is included in a reflected wave (echo signal) from a subject and is caused only by ultrasonic waves transmitted in accordance with a drive signal. In reality, an echo signal is an ultrasonic signal to which noise has been added.

[0023] (Overall configuration of electronic endoscope system) 1 is a block diagram showing the overall configuration of an electronic endoscope system according to an embodiment of the present invention. The electronic endoscope system 10 for acquiring ultrasonic images includes an electronic endoscope 12, a captured image processor 22, and an ultrasonic image processor 30.

[0024] (Electronic Endoscope 12) The electronic endoscope 12 includes an illumination unit 14 that irradiates biological tissue, an image sensor 16 that images the biological tissue, a driver signal processor 18 that preprocesses the signal imaged by the image sensor 16, an ultrasonic probe 20 that applies ultrasonic waves to the biological tissue to obtain echo signals, and a memory 92. The ultrasonic probe 20 is a phased array type probe in which a plurality of probe elements that output ultrasonic waves are arranged in a predetermined direction, and each probe element outputs ultrasonic waves with a predetermined time difference, thereby enabling echo signals along various directions to be obtained.

[0025] An image signal of a living tissue is input to the driver signal processing unit 18 from the imaging element 16 at a predetermined frame period, and is output to a captured image processing unit 26 of the captured image processor 22. The frame period is, for example, 1 / 30 seconds or 1 / 60 seconds.

[0026] The driver signal processor 18 also accesses the memory 92 to read out the unique information of the electronic endoscope 12. The unique information of the electronic endoscope 12 recorded in the memory 92 includes, for example, the number of pixels and sensitivity of the image sensor 16, the operable frame rate, the model number, etc.

[0027] (Captured image processor 22) The captured image processor 22 includes a light source section 24 that transmits a light source to the illumination section 14, and a captured image processing section 26 that processes the imaging signal output from the imaging element 16 to generate a captured image.

[0028] The light source unit 24 transmits illumination light to the illumination unit 14 of the electronic endoscope 12 through a light guide 94. For example, a high-intensity lamp such as a xenon lamp, a halogen lamp, a mercury lamp, or a metal halide lamp is used as the light source. The illumination light transmitted from the light source is focused by a focusing lens (not shown) and limited to an appropriate amount of light via an aperture. A motor is mechanically connected to the aperture via a transmission mechanism such as an arm or gear (not shown). The aperture can be adjusted to change the opening in order to adjust the brightness of an image displayed on a display screen of a captured image display unit (not shown). The light source of the light source unit 24 may be a semiconductor light emitting element such as a light emitting diode or a laser diode that emits light in a predetermined wavelength range, instead of a white light source that emits white light.

[0029] The captured image processing unit 26 is provided with a front-stage signal processing circuit, which performs demosaic processing on each of the R, G, and B image signals input from the driver signal processing unit 18 at frame intervals. Specifically, each R image signal is subjected to interpolation processing using surrounding G and B pixels, each G image signal is subjected to interpolation processing using surrounding R and B pixels, and each B image signal is subjected to interpolation processing using surrounding R and G pixels. As a result, all image signals are converted into image data having information on the three color components R, G, and B. Furthermore, the front-stage signal processing circuit performs well-known processing such as color correction, matrix calculation, and white balance correction. The captured image processing unit 26 may include a post-stage signal processing circuit. The post-stage signal processing circuit performs a predetermined signal processing on the image data to generate moving image data and converts the moving image data into a predetermined video format signal. The converted video format signal is used to display the moving image on the display unit 46. As a result, the moving image of the biological tissue is displayed on the display screen.

[0030] (Ultrasound image processor 30) The ultrasonic image processor 30 includes a transmitting / receiving unit 38 , an ultrasonic image processing unit 32 , a noise frequency detection unit 34 , a signal processing unit 36 ​​, and a control unit 40 . The transmitting / receiving unit 38 transmits a drive signal to the ultrasonic probe 20 and receives an echo wave (echo signal). The signal processing unit 36 ​​performs predetermined signal processing including binarization processing on the echo signal received by the transmitting / receiving unit 38. The ultrasonic image processing unit 32 generates an ultrasonic image based on the echo signal processed by the signal processing unit 36.

[0031] The noise frequency detector 34 detects the frequency of noise contained in the echo signal that has been subjected to predetermined signal processing by the signal processor 36. The detailed configurations of the noise frequency detector 34 and the signal processor 36 will be described later. The control unit 40 is mainly composed of a microprocessor, and controls each part within the ultrasonic image processor 30 .

[0032] The ultrasonic image processor 32 performs a predetermined calculation on the digital echo signals as gray-scale image data, for example by brightness modulation, to generate a one-dimensional B-mode image along one direction. Furthermore, the ultrasonic image processor 32 creates one two-dimensional B-mode image by arranging the one-dimensional B-mode images along multiple directions, which are generated based on the echo signals obtained from the phased array ultrasonic probe 20, along a predetermined azimuth direction in accordance with the phased array scan. Furthermore, the created image is subjected to image processing using known techniques such as gain processing and contrast processing, and gradation processing corresponding to the display range of the image on the display unit 46 is also performed.

[0033] The ultrasonic image processor 30 includes a display unit 46 having a display function for displaying the generated ultrasonic image and an input function for inputting data by a touch panel method. The ultrasonic image processor 30 further includes an input unit 42 for operating the ultrasonic image processor 30, a power supply unit 44, and an AC power supply input unit 48.

[0034] The input unit 42 accepts input of various information using a keyboard, a mouse, a touch panel, etc. The display unit 46 displays various information including the generated ultrasound image. The power supply unit 44 supplies power for driving the ultrasonic image processor 30, the electronic endoscope 12, and the captured image processor 22 based on the AC power input from the AC power input unit 48. The power supply unit 44 includes, for example, a DC / DC converter, which is a switching power supply, as a component device, and generates a DC voltage according to the switching frequency of the DC / DC converter. A plurality of DC / DC converters are provided, and each DC / DC converter converts the input DC voltage into a desired DC voltage and supplies power to each device.

[0035] (Structure of electronic endoscope 12) FIG. 2 is a diagram for explaining an example of an electronic endoscope equipped with an ultrasonic probe used in the electronic endoscope system of one embodiment.

[0036] The electronic endoscope 12 comprises an operating section 52, an insertion section 54 having a tip section 56 and a soft section 58 mainly inside, a flexible cable 60 having a light guide cable inside, a scanner connector cable 62, a connector 64, and a scanner connector 66.

[0037] The tip 56 is a sensor for inspecting biological tissue, and includes an imaging element 68, an emission end surface 70, and an ultrasonic probe 20. The ultrasonic probe 20 has a plurality of ultrasonic transducers as probe elements, for example, a transducer array in which piezoelectric elements are arranged in an array. Each of these transducers transmits ultrasonic waves according to a drive signal, and receives reflected waves from the subject and outputs an analog reception signal. Each transducer is configured using an element in which electrodes are formed on both ends of a piezoelectric body made of, for example, PZT (Lead Zirconate Titanate), a piezoelectric ceramic, or PVDF (Poly Vinylidene Di Fluoride), a polymeric piezoelectric element.

[0038] The imaging element section 68 of the tip 56 is provided with an objective lens and an imaging element 16. The objective lens forms an image on the light receiving surface of the imaging element 16 of the return light from the living tissue irradiated with the illumination light. The imaging element 16 is, for example, a single-plate color CCD (Charge Coupled Device) image sensor having a Bayer type pixel arrangement. The single-plate color CCD image sensor accumulates an optical image formed at each pixel on the light receiving surface as an electric charge according to the amount of light, and generates and outputs an image signal corresponding to the color components of R (Red), G (Green), and B (Blue). The imaging element 16 is not limited to a CCD image sensor, and a CMOS (Complementary Metal Oxide Semiconductor) image sensor or other types of imaging devices can also be used. The imaging element 16 may also be equipped with a complementary color filter.

[0039] The illumination light from the illumination unit 14 passes through a light distribution lens and is emitted from an exit end surface 70 at the tip 56. The incident illumination light passes through a light distribution lens and is emitted from the exit end surface 70. The illumination light is incident on the illumination unit 14 of the electronic endoscope 12 via a light guide 94.

[0040] The outer portion of the tip portion 56 is made of hard resin. The imaging element section 68 is provided with the imaging element 16, and an objective lens, an illumination lens, and the like (not shown) for imaging by the imaging element 16.

[0041] Furthermore, the tip portion 56 is provided with an air / water nozzle 72 for discharging or sucking liquid or gas. The air / water nozzle 72 discharges liquid such as water for cleaning the surfaces of the objective lens and the illumination lens attached to the image pickup element 16, and discharges gas such as air for removing liquid or foreign matter remaining on the surfaces of the objective lens and the illumination lens. The tip portion 56 is also provided with a balloon (not shown) for use in ultrasonic diagnosis by filling the balloon with liquid and bringing it into contact with biological tissue, and is provided with a balloon water inlet 88 and a balloon water inlet 90. The tip portion 56 is also provided with a forceps raising base 76 for bringing a flexible puncture needle (not shown) into contact with biological tissue, and an opening for sucking liquid or gas on the biological tissue through the forceps raising base 76 is also provided.

[0042] The insertion section 54 is provided with a curved section 78 that curves in the up-down and left-right directions. The portion on the base end side (the side of the operation section 52) from the curved section 78 is a flexible soft section 58 that can bend in response to its own weight or the operation of the practitioner.

[0043] The flexible section 58 is provided between the bending section 78 and the operating section 52, and has therein a signal line of the sensor provided at the tip section 56 and a plurality of individual flow paths through which gas or fluid flows from the openings. These individual flow paths are formed by pipes, tubes, or long holes.

[0044] A treatment tool insertion port protrusion 80 and a forceps raising wire cleaning port 74, which are flexible and used to insert a puncture needle, are provided on the side of the operation section 52 and the tip section 56. A cap is removably attached to the end opening of the treatment tool insertion port protrusion 80. A treatment tool insertion and suction tube, which is flexible and extends from the treatment tool insertion port protrusion 80 toward the tip section 56, is provided inside the insertion section 54. The treatment tool insertion and suction tube opens at the forceps raising base 76. The puncture needle inserted into the treatment tool insertion and suction tube from the treatment tool insertion port protrusion 80 can protrude outward from the tip opening of the treatment tool insertion and suction tube in the forceps raising base 76, and is used to palpate biological tissue by protruding it from the tip opening.

[0045] The operation unit 52 is equipped with a plurality of operation buttons 84 of a flow path changeover switch, and has a common flow path therein through which the fluid flows, extending from the connector 64 through the flexible cable 60. The bending operation lever 82 is a lever that the surgeon operates to bend the bending portion 78 in the up-down and left-right directions. The bending portion 78 is bent in the up-down and left-right directions in response to the rotational operation of the bending operation lever 82.

[0046] A flexible cable 60 connects the operation unit 52 to a connector 64 which is connected to the captured image processor 22. The connector 64 is also provided with an opening port of a common flow path for supplying or suctioning a fluid.

[0047] The connector 64 has a light source plug-in section 86 and is connected to the captured image processor 22. Illumination light generated by a light source unit in the captured image processor 22 is transmitted from the connector 64 through the flexible cable 60, the operation section 52, and a light guide cable in the insertion section 54 toward the tip section 56. Furthermore, a drive signal is sent from the captured image processor 22 to the image sensor 16 via a signal line in the flexible cable 60 from the connector 64. An image signal captured by the image sensor 16 is sent to the captured image processor 22 via the flexible cable 60, the operation section 52, and a signal line in the insertion section 54.

[0048] The scanner connector 66 is connected to the ultrasonic image processor 30, and sends echo signals scanned by the ultrasonic probe 20 to the ultrasonic image processing unit 32 via the scanner connector cable 62. The ultrasonic image processing unit 32 processes the echo signals to generate diagnostic images of the biological tissue of the test subject, and displays the generated images on the display unit 46. Furthermore, the scanner connector cable 62 transmits drive signals for the ultrasonic probe 20 from the ultrasonic image processor 30 to the piezoelectric element of the ultrasonic probe 20. The piezoelectric element can convert electrical energy into mechanical energy, and generates ultrasonic waves by expanding and contracting due to a change in voltage.

[0049] The connector 64 is connected to a driver signal processing unit 18. An image signal of a biological tissue is input from the imaging element 16 to the driver signal processing unit 18 at a predetermined frame period, and is output to a system controller of the captured image processor 22 and a captured image processing unit 26. The frame period is, for example, 1 / 30 seconds or 1 / 60 seconds.

[0050] (Principle of ultrasound image formation) Next, referring to FIG. 3, the principle of ultrasonic image formation in an electronic endoscope system according to one embodiment is shown. Image formation using ultrasound is based on the ultrasonic pulse reflection method. Figure 3 shows the state in which an ultrasonic beam is generated from an ultrasonic probe 20 inside a living body. The ultrasonic beam is emitted from the ultrasonic probe 20 into the living body in the form of pulses of ultrasonic waves, for example, around 10 MHz. The emitted ultrasonic waves become reflected waves due to differences in acoustic impedance of the body tissues inside the living body, and are received again by the ultrasonic probe 20. This reflected wave becomes an echo signal.

[0051] The ultrasonic beam scan in the electronic endoscope 12 is a sector scan using a phased array method, and this sector scan makes it possible to obtain echo signals along a predetermined direction. Figure 3 shows an example of an echo signal displayed in A mode. In A mode, echo signals are displayed with time on the horizontal axis and reflection intensity (amplitude) on the vertical axis. Time represents the depth of the body, and is the distance between internal tissues.

[0052] In the B mode, the waveform of the A mode echo signal is converted into brightness by brightness modulation according to the reflection intensity, and the tomographic image is displayed as a grayscale image based on the brightness, as shown in Fig. 3. In addition to the above, the imaging modes of the ultrasonic image processor 30 may include the well-known M mode and Doppler mode.

[0053] (Signal processing of ultrasonic image processor 30) Next, with reference to FIG. 4, the signal processing performed in the ultrasound image processor 30 of one embodiment will be described in more detail. FIG. 4 is a diagram for explaining an example of signal processing in the ultrasound image processor 30 according to one embodiment, in which echo signals when acquiring an ultrasound image are displayed as a B-mode ultrasound image.

[0054] As shown in FIG. 4, the signal processing unit 36 ​​includes an amplifier circuit 120, an integration circuit 122, an A / D converter 124, a digital filter setting unit 125, and a band-limiting filter 126. The echo signal obtained by the ultrasonic probe 20 is amplified by the amplifier circuit 120 and integrated by the integrator circuit 122 to remove harmonic noise. The amplifier circuit 120 and the integrator circuit 122 may be provided with an amplification function and a low-pass filter function by an integrated inverting amplification type integrator circuit. Next, the echo signal, which is an analog signal, is digitized (binarized) by the A / D converter 124 at a sampling period based on a clock signal to become a digital echo signal. In one embodiment, the band-limiting filter 126 (an example of a filter processing unit) performs band-limiting on the digital echo signal based on a digital filter setting value set by the digital filter setting unit 125. The band-limiting filter 126 is, for example, a low-pass filter or a band-pass filter. When the band-limiting filter 126 is a low-pass filter, the cut-off frequency, or when the band-limiting filter 126 is a band-pass filter, the cut-off frequency on the high frequency side is lower than the cut-off frequency by the integrating circuit 122.

[0055] As shown in FIG. 4, the ultrasound image processing unit 32 includes a brightness modulation unit 128, an ultrasound image generation unit 130, and a D / A converter 132. The digital echo signal output from the signal processing unit 36 ​​is converted to brightness by brightness modulation in the brightness modulation unit 128 according to the reflection intensity. The digital echo signal converted to brightness is image processed in the ultrasound image generation unit 130 to become a two-dimensional B-mode tomographic image. This digital image signal is converted to an analog signal by the D / A converter 132 and displayed on the display unit 46 as a B-mode tomographic image.

[0056] The noise frequency detector 34 (an example of a frequency band detector) detects the frequency band of noise components that are included in the echo signal and are equal to or higher than a preset threshold level. That is, since the frequency components of the echo signal (ultrasonic reception signal) that does not contain noise are known, a frequency band of noise components equal to or higher than a preset threshold level is identified from a band excluding the frequency components of the ultrasonic signal by performing frequency analysis using FFT (Fast Fourier Transform). In order to grasp the frequency characteristics of a wide band including a frequency band with little noise, it is preferable to increase the sampling rate of the A / D converter 124.

[0057] The digital filter setting unit 125 of the signal processing unit 36 ​​performs filter setting for the echo signal (that is, filter setting in the band limiting filter 126) so that the signal in the frequency band detected by the noise frequency detection unit 34 is attenuated.

[0058] (Filter processing contents) Next, the contents of the filtering process performed by the digital filter setting section 125 and the band limiting filter 126 in the signal processing section 36 will be described with reference to FIGS.

[0059] The band-limiting filter 126 of one embodiment is a low-pass filter that attenuates the signal of a frequency component equal to or higher than a predetermined frequency, including the frequency band of the noise component detected by the noise frequency detection unit 34, among the echo signal. Referring to FIG. 5, FIG. 5(a) shows the spectrum of the ultrasonic signal included in the echo signal and the filter characteristic of the low-pass filter defined by the integration circuit 122 of the signal processing unit 36. Here, when the frequency band of the noise detected by the noise frequency detection unit 34 is a higher frequency band than the ultrasonic signal, as shown in the spectrum of the echo signal in FIG. 5(b), a low-pass filter (filter characteristic in FIG. 5(b)) is set so that the noise in the detected frequency band is attenuated. In the filter characteristic in FIG. 5(b), the cutoff frequency is set lower than the filter characteristic in FIG. 5(a) (by the integration circuit 122), so that the noise is effectively removed. As shown in FIG. 5(c), when the frequency band of the noise components detected by the noise frequency detection unit 34 includes both a lower band and a higher band than the frequency band of the ultrasonic signal, it is preferable to set a bandpass filter as the band limiting filter 126.

[0060] The band-limiting filter 126 of one embodiment has filter characteristics suitable for tissue harmonic imaging (THI) when the ultrasonic image processor 32 generates an image corresponding to THI. THI is known as an imaging method that generates an ultrasonic image based on second or higher harmonic components, which are N times (N: an integer of 2 or more) the fundamental frequency and are generated due to distortion of the ultrasonic waveform accompanying propagation, and generally has the effect of improving resolution and reducing artifacts.

[0061] Referring to FIG. 6(a), the spectrum of the echo signal includes a signal component with a fundamental frequency f0 as a center frequency, and harmonic components of second, third, fourth, etc. with frequencies 2f0, 3f0, 4f0, etc., which are N times the fundamental frequency (N: an integer of 2 or more). In this case, since the frequencies 2f0, 3f0, 4f0, etc. are known, the noise frequency detection unit 34 identifies (detects) a frequency band of noise components equal to or higher than a preset threshold level from a band excluding the frequency band with frequencies 2f0, 3f0, 4f0, etc. as a center frequency. Then, the digital filter setting unit 125 sets a filter for the echo signal so that signals in the frequency band detected by the noise frequency detection unit 34 are attenuated (i.e., signals other than the frequency N times the fundamental frequency are attenuated). As a result, the filter characteristic of the band limiting filter 126 can be, for example, a band pass filter characteristic as shown in FIG. 6(b).

[0062] In one embodiment, it is also effective to increase the pulse duration of the ultrasonic pulse transmitted from the ultrasonic probe to the biological tissue, which narrows the bandwidth of the ultrasonic signal contained in the echo signal, and therefore the filter characteristics can be set to effectively remove noise. Therefore, the control unit 40 (see FIG. 4) may function as an adjustment unit that controls the transmission / reception unit 38 to adjust the pulse duration of the ultrasonic pulse applied to the biological tissue by the ultrasonic probe. In this case, the digital filter setting unit 125 performs filter setting for the band-limiting filter 126 based on the pulse duration adjusted by the control unit 40.

[0063] Referring to FIG. 7, FIG. 7(a) shows an ultrasonic pulse (pulse duration Tp1) before the change, and FIG. 7(b) shows an ultrasonic pulse (pulse duration Tp2; however, Tp2>Tp1) after the change. In this case, as seen in the spectrum of the echo signal in FIG. 7(c), the ultrasonic signal received by the ultrasonic pulse after the change has a narrower band than that before the change (shown by the dashed line). Therefore, even if the frequency band of the ultrasonic signal received by the ultrasonic pulse before the change overlaps with that of the noise, for example, as shown in FIG. 7(c), the frequency band of the ultrasonic signal and the noise can be distinguished after the change of the ultrasonic pulse. Therefore, as shown in FIG. 7(d), by setting a bandpass filter as the filter characteristic of the band limiting filter 126 so that the signal in the frequency band of the detected noise is attenuated, it becomes possible to effectively attenuate only the noise component.

[0064] When the frequency band of a relatively large noise component detected by the noise frequency detection unit 34 overlaps or is close to the frequency band of the ultrasonic signal, the noise level can be effectively attenuated without attenuating the signal level of the ultrasonic signal by shifting the frequency band of the ultrasonic signal. Therefore, in one embodiment, the control unit 40 of the ultrasound image processor 30 functions as a frequency change unit that changes the frequency of the ultrasound applied to the biological tissue by the ultrasound probe so as not to overlap with the frequency band of the noise components detected by the noise frequency detection unit 34. For example, assuming the spectrum of the ultrasonic signal shown in Fig. 8(a), if it overlaps with the frequency band of the noise components detected by the noise frequency detection unit 34, the frequency band of the ultrasonic signal is shifted lower (in the case of Fig. 8(b)) or higher (in the case of Fig. 8(c)) depending on the frequency band of the noise components. In this case as well, the filter characteristics of the band-limiting filter 126 can be set so that the noise in the detected frequency band is effectively attenuated.

[0065] As described above, the digital filter setting unit 125 and the band limiting filter 126 perform filtering on the received echo signal in consideration of the frequency band of the noise components detected by the noise frequency detection unit 34, so that unintended noise can be effectively suppressed. If the noise is not removed by any one of the above-described filter processes or a combination of them, it is possible to adopt a method for removing the periodically occurring noise, taking into consideration that the noise often occurs at regular intervals (i.e., periodically). Such periodic noise includes, for example, noise components generated by synchronization of the frequency of a clock signal used in a plurality of constituent devices or an integer multiple of the frequency of a switching signal of a plurality of constituent devices, noise components generated in a switching power supply, and noise components generated in the insertion section 54 of the electronic endoscope 12. There are two methods for suppressing the periodically occurring noise components: a method for suppressing the periodic noise components contained in the echo signal, and a method for eliminating noise pixels by performing image processing on a two-dimensional B-mode image obtained from an echo signal containing the noise components.

[0066] (Suppression of noise component amplification gain) As described above, as a method for suppressing periodic noise components contained in an echo signal, in one embodiment, the ultrasound image processing unit 32 may perform a gain change process so that the amplification gain value is changed between noise pixels in the ultrasound image corresponding to the noise components and pixels other than the noise pixels. In this case, the ultrasonic image processor 32 sets a threshold for noise level in advance, and among the digital echo signals (echo signals before processing by the luminance modulator 128) obtained from the band limiting filter 126, signals equal to or greater than the set threshold are determined to be noise components. The period (e.g., T1, T2, T3, ...) of the digital echo signals detected as noise components is measured. The period (T1, T2, T3, ...) can be obtained by, for example, identifying multiple occurrence times of the noise components and calculating the time intervals between the occurrence times using a period calculated from the peak frequency of the power spectrum obtained by frequency analysis using FFT of the digital echo signal from the waveform of the digital echo signal displayed in A mode.

[0067] The measured periods (T1, T2, T3, ...) fluctuate within a certain range, and the ultrasonic image processor 32 determines the width of the variation, the maximum period value Tmax, and the maximum period value Tmin. The digital filter setting unit 125 designs a band-limiting filter 126 that removes the frequency band of the minimum frequency 1 / Tmax and the maximum frequency 1 / Tmin, using the period width detected by the ultrasonic image processor 32 as the bandwidth of the frequency domain (sets the removal band). By passing the digital echo signal through this band-limiting filter 126, even if noise components occur periodically in the echo signal, the amplitude of the noise components can be suppressed, and periodic noise components in the B-mode image can be suppressed.

[0068] 9 is a diagram showing an example of a digital echo signal obtained after an echo signal including periodically occurring noise obtained in the electronic endoscope system of one embodiment has passed through a band elimination filter. Harmonic noise is suppressed by the integration circuit 122, and the digital echo signal after passing through the band limiting filter 126 is also suppressed. As a result, the periodically occurring noise components are suppressed in the luminance signal obtained by the luminance modulation unit 128.

[0069] (Interpolation of noise pixel values) As described above, in one embodiment, a method for suppressing periodic noise components contained in an echo signal can be adopted in which image processing is performed on a two-dimensional B-mode image obtained from an echo signal containing noise components to eliminate noise pixels. The configuration of the ultrasonic image processor 30 in this case is shown in FIG. 10. Compared with FIG. 4, FIG. 10 differs in an ultrasonic image processing unit 32A. The ultrasonic image processing unit 32A has an image interpolation unit 160 added to the ultrasonic image processing unit 32. The image interpolation unit 160 replaces pixel values ​​at noise pixel positions in an ultrasonic image corresponding to noise components with interpolated pixel values ​​generated based on pixel values ​​of surrounding pixels located around the noise pixel positions.

[0070] The image interpolation unit 160 performs pixel interpolation using, for example, four surrounding pixels adjacent to the four sides of the noise pixel. The pixel value of the noise pixel is interpolated using the pixel values ​​of the four surrounding pixels adjacent to the noise pixel. For example, the average value of the pixel values ​​of the four surrounding pixels is set as the pixel value of the noise pixel. This interpolation method is called bilinear interpolation, but other methods may be used as the interpolation method, for example, bicubic interpolation. When a noise pixel is adjacent to the noise pixel, the image interpolation unit 160 searches for pixels adjacent to the noise pixel until a non-noise pixel adjacent to the noise pixel is found, and performs pixel interpolation using the pixel values ​​of multiple non-noise pixels surrounding the area of ​​the noise pixel.

[0071] In this way, the signal processing unit 36 ​​performs a correction process to replace the pixel value at the noise pixel position in the ultrasound image of the detected noise component with an interpolated pixel value generated based on the pixel values ​​of the surrounding pixels located around the noise pixel position. Therefore, even if noise components occur periodically in the echo signal, the noise components can be suppressed in the B-mode image.

[0072] (Noise suppression flow) FIG. 11 is a diagram illustrating an exemplary operation flow of noise correction. First, in step S2, the frequency band of noise contained in the received echo signal is detected. For example, the frequency band of noise components contained in the echo signal and equal to or above a preset threshold level is detected. Next, in step S4, the echo signal is filtered so that the signal in the detected frequency band is attenuated. If the result of the filtering process is that noise equal to or above a preset threshold level is not detected (step S6: NO), the process ends. If noise is detected in step S6, it means that the filter processing in step S4 was not sufficient to suppress the noise. Therefore, the driving method of the ultrasonic wave is changed (step S8), the pulse duration of the ultrasonic pulse is lengthened, the bandwidth of the ultrasonic signal contained in the echo signal is narrowed, and a filter setting corresponding to the narrow-band ultrasonic signal is set. In step S8, the frequency band of the ultrasonic signal may also be shifted, and a filter setting corresponding to the shifted frequency band may be set. Then, it is determined again whether noise equal to or above a preset threshold level is detected, and if not detected (step S10: NO), the process ends. If noise is detected in step S10, this means that the change in the ultrasonic driving method in step S8 was not effective. Therefore, in step S12, a two-dimensional B-mode image obtained from an echo signal containing noise components is corrected. In the image correction, the pixel value at the noise pixel position in the ultrasonic image corresponding to the noise component is replaced with an interpolated pixel value generated based on the pixel values ​​of the surrounding pixels located around the noise pixel position. Then, it is determined again whether noise equal to or above a preset threshold level is detected, and if not detected (step S14: NO), the process ends. If noise is detected in step S14, a warning is output in step S16 and the process ends. The warning is output by displaying it on the display unit 46. In this case, the operator is informed of the presence of noise so that the diagnosis using the ultrasound image is not affected.

[0073] The electronic endoscope system of the present invention has been described in detail above. However, the electronic endoscope system of the present invention is not limited to the above-described embodiment, and various improvements and modifications may be made without departing from the spirit and scope of the present invention. [Explanation of symbols]

[0074] 10. Electronic endoscope system 12...Electronic endoscope 14…Lighting section 16...Image sensor 18...Driver signal processing section 20...Ultrasound probe 92…Memory 22...Image capture processor 24...Light source section 26...Image capture processing unit 28...Captured image display section 30...Ultrasound image processor 32, 32A…Ultrasound image processing unit 128…Luminance modulation section 130...Ultrasound image generating unit 132...D / A converter 160...Image Interpolation Section 34…Noise frequency detection section 36...Signal processing unit 120…Amplification circuit 122...Integrator circuit 124...A / D converter 125...Digital filter setting section 126...Bandwidth limiting filter 38...Transmitter / receiver 40...Control unit 42...Input section 44…Power supply section 46...Ultrasound image display unit 48…AC power input section 52...Operation unit 54…Insertion part 56...Tip 58…Soft part 60...Flexible cable 62…Scanner connector cable 64…Connector 66…Scanner connector 68...Image sensor section 70…Injection end face 72…Air / water supply nozzle 74…Forceps lift wire cleaning port 76…forceps lifting platform 78…Bend 80…Treatment tool insertion port protrusion 82...Bending operation lever 84...Operation button 86…Light source insertion part 88…Balloon water inlet 90…Balloon water intake 94…Light guide

Claims

1. An electronic endoscope system for acquiring ultrasound images, comprising: an electronic endoscope having at its tip an imaging element for imaging biological tissue and an ultrasonic probe for applying ultrasonic waves to the biological tissue to obtain an echo signal; a captured image processor having an image processing unit that processes an image signal output from the imaging element to generate a captured image; an ultrasonic image processor including: an ultrasonic image processing unit that processes the echo signal output from the ultrasonic probe to generate an ultrasonic image; a frequency band detection unit that detects a frequency band of noise components included in the echo signal and equal to or higher than a preset threshold level; and a filter processing unit that performs a filter process on the echo signal so that the detected signal in the frequency band is attenuated; Equipped with The ultrasonic image processor has an adjustment unit that adjusts a pulse duration of the ultrasonic waves applied to the biological tissue by the ultrasonic probe, The filter processing unit performs filter settings for the filter processing based on the pulse duration adjusted by the adjustment unit.

2. The ultrasonic image processor has a low-pass filter that attenuates a signal of a frequency component equal to or higher than a predetermined frequency among the echo signals, the filtering process is performed so as to attenuate a signal of a frequency component of the echo signal that is equal to or higher than a frequency that is lower than the predetermined frequency.

2. An electronic endoscope system according to claim 1.

3. The echo signal includes a signal component of a fundamental frequency and two or more harmonic components having a frequency N times the fundamental frequency (N: an integer equal to or greater than 2), The ultrasonic image processing unit generates the ultrasonic image based on the two or more harmonic components, The filter processing unit performs a filter process on the echo signal so as to attenuate signals other than a frequency that is N times the fundamental frequency.

2. An electronic endoscope system according to claim 1.

4. The ultrasonic image processor has a frequency change unit that changes a frequency of the ultrasonic wave applied to the biological tissue by the ultrasonic probe so as not to overlap with a frequency band of the noise component detected by the frequency band detection unit.

4. An electronic endoscope system according to claim 1.

5. the ultrasonic image processing unit performs a gain change process so that an amplification gain value is changed between a noise pixel in the ultrasonic image corresponding to the noise component and a pixel other than the noise pixel; 5. An electronic endoscope system according to claim 1.

6. The ultrasound image processing unit replaces a pixel value at a noise pixel position in the ultrasound image corresponding to the noise component with an interpolated pixel value generated based on pixel values ​​of surrounding pixels located around the noise pixel position.

5. An electronic endoscope system according to claim 1.

Citation Information

Patent Citations

  • Ultrasonic diagnostic apparatus

    JP2009136626A

  • Ultrasonic diagnostic system

    JP2010042048A

  • Ultrasonic diagnostic apparatus

    JP2014003801A

  • Portable Ultrasound System

    JP2019534110A

  • Systems and methods for reducing noise in imaging

    JP2020508168A