Imaging system, ultrasonic imaging system and endoscope system for operating room

Abstract

An imaging system, ultrasound imaging system and endoscope system for an operating room introduces a communication component (e.g., a first communication component and / or a second communication component) to establish communication between the endoscope system and the ultrasound imaging system, thereby enabling the ultrasound imaging system to send, for example, ultrasound images to the endoscope system through the communication component, therefore, the endoscope display not only displays the endoscope image but also displays the ultrasonic image on the same interface, so that a user does not need to switch the sight between the endoscope display and the ultrasonic display back and forth, and the operation is very convenient.

Description

Technical Field

[0001] The present invention relates to the field of medical equipment, and more particularly to an imaging system, an ultrasound imaging system and an endoscope system for an operating room. Background Art

[0002] Due to the needs of surgery, there are many types of medical equipment in surgical operating rooms, such as endoscopes. Endoscopes are one of the important equipment. They can present the tissue morphology of the patient's internal organs and the pathological conditions in the body during minimally invasive surgery, which is convenient for diagnosis and surgery. They are one of the important tools for diagnosis and treatment in modern medicine. In addition to using an endoscope system to view images on an endoscope display, doctors often need to view images collected by other medical equipment, such as using an ultrasound imaging system to view ultrasound images on an ultrasound display, which can cause inconvenience to doctors in actual scenarios. Summary of the invention

[0003] In order to solve the above problems, the present invention provides an imaging system, an ultrasonic imaging system and an endoscope system for an operating room, which are described in detail below.

[0004] According to a first aspect, an embodiment provides an imaging system for an operating room, comprising an endoscope system, an ultrasound imaging system, and a communication component, wherein the communication component is used to establish a communication connection between the endoscope system and the ultrasound imaging system;

[0005] The endoscopic imaging system comprises an endoscope, a light source, a camera host connected to the endoscope, and an endoscope display for display; the light source is used to provide illumination to the patient's part to be observed; the endoscope comprises an insertion portion and a handheld operation portion, the insertion portion is used to be inserted into the patient's part to be observed; the handheld operation portion is used for handheld operation by a user; the endoscope is provided with one or more image sensors, the image sensors are used to collect endoscopic image signals of the part to be observed; the camera host is used to obtain the endoscopic image signals and generate endoscopic images, and send the endoscopic images to the endoscopic display;

[0006] The ultrasonic imaging system comprises an ultrasonic probe, an ultrasonic host and an ultrasonic display; the ultrasonic probe is used to transmit ultrasonic waves and receive echo signals of the ultrasonic waves; the ultrasonic host is used to generate an ultrasonic image according to the echo signals; and the ultrasonic display is used to display the ultrasonic image;

[0007] The ultrasound host also sends the ultrasound image to the camera host through the communication component, and the camera host receives the ultrasound image and sends it to the endoscope display; the endoscope display displays the endoscope image and the ultrasound image on an interface.

[0008] In one embodiment, the ultrasound probe has a first operating component, which is used for a user to operate to generate display parameter instructions; the communication component is used to transmit the display parameter instructions to the camera host to set the display parameters of the endoscope display; wherein the display parameter instructions are used to set the display ratio, display size and / or display position of the endoscopic image and the ultrasound image displayed on the interface of the endoscope display.

[0009] In one embodiment, the ultrasound probe has a first operating component, which is used for a user to operate to generate imaging parameter instructions and transmit them to the ultrasound host; wherein the imaging parameter instructions are used to set the imaging parameters of the ultrasound imaging system, and the imaging parameters include one or more of the following: one or more imaging modes, imaging sub-parameters corresponding to each imaging mode, and navigation function parameters.

[0010] In one embodiment, the ultrasound probe has a first operating component; the first operating component can be operated by a user to generate a closing instruction, and the communication component is used to transmit the closing instruction to the camera host, and the closing instruction is used to close the ultrasound image displayed on the interface of the endoscope display; and / or, the first operating component can be operated by a user to generate a starting instruction, and the communication component is used to transmit the starting instruction to the camera host, and the starting instruction is used to start displaying the ultrasound image on the interface of the endoscope display.

[0011] In one embodiment, the communication component includes a first communication component and a second communication component; the ultrasound host has a first communication interface, and the first communication interface is used to plug the first communication component; the camera host or the endoscope display has a second communication interface, and the second communication interface is used to plug the second communication component; the first communication component and the second communication component are used to establish a wireless communication connection with each other.

[0012] In one embodiment, the first communication component and the second communication component are WiHD communication components.

[0013] According to a second aspect, an embodiment provides an ultrasound imaging system, comprising:

[0014] An ultrasonic probe comprises a shell and an array element group; the array element group is used to transmit ultrasonic waves and receive echo signals of the ultrasonic waves; the shell forms a gripping portion for a user to hold;

[0015] An ultrasound host, the ultrasound host being used to generate an ultrasound image according to the echo signal;

[0016] An ultrasound display, used for displaying the ultrasound image;

[0017] A first communication component, wherein the first communication component is used to establish a communication connection with a second communication component of an endoscope system; the ultrasound host is also used to transmit the ultrasound image to the endoscope system through the first communication component, so that the endoscope system displays the endoscope image and the ultrasound image on an interface of its endoscope display.

[0018] In one embodiment, the ultrasound probe also includes a first operating component arranged on the shell; the first operating component is used for user operation to generate display parameter instructions; the first communication component is used to transmit the display parameter instructions to the endoscope system to set the display parameters of the endoscope display; wherein the display parameter instructions are used to set the display ratio, display size and / or display position of the endoscopic image and the ultrasound image displayed on the interface of the endoscope display.

[0019] In one embodiment, the ultrasound probe also includes a first operating component arranged on the shell; the first operating component is used for a user to operate to generate imaging parameter instructions and transmit them to the ultrasound host; wherein the imaging parameter instructions are used to set the imaging parameters of the ultrasound imaging system, and the imaging parameters include one or more of the following: one or more imaging modes, imaging sub-parameters corresponding to each imaging mode, and navigation function parameters.

[0020] In one embodiment, the ultrasound probe has a first operating component; the first operating component can be operated by a user to generate a closing instruction, and the first communication component is used to transmit the closing instruction to the endoscope system, and the closing instruction is used to close the ultrasound image displayed on the interface of the endoscope display; and / or, the first operating component can be operated by a user to generate a starting instruction, and the first communication component is used to transmit the starting instruction to the endoscope system, and the starting instruction is used to start displaying the ultrasound image on the interface of the endoscope display.

[0021] In one embodiment, the ultrasound probe has a first operating component, and the first operating component is used for a user to operate to generate an interactive menu; the interactive menu is used for the user to control ultrasound imaging through the first operating component, and / or the interactive menu is used for the user to set display parameters of the endoscope display through the first operating component;

[0022] The ultrasound display displays the interactive menu, and / or the first communication component is used to transmit the interactive menu to the endoscope system so that the interactive menu is displayed on an interface of its endoscope display.

[0023] In one embodiment, the ultrasound host has a first communication interface, and the first communication interface is used to plug in the first communication component.

[0024] In one embodiment, the first communication component is a wifi communication component, a WHDI communication component or a WiHD communication component.

[0025] According to a third aspect, an embodiment provides an endoscope system, including an endoscope, a light source, a camera host connected to the endoscope, an endoscope display, and a second communication component;

[0026] The light source is used to provide illumination to the part of the patient to be observed;

[0027] The endoscope comprises an insertion portion and a handheld operation portion, wherein the insertion portion is used to be inserted into a patient to observe the part to be observed; the handheld operation portion is used for handheld operation by a user; the endoscope is provided with one or more image sensors, and the image sensors are used to collect endoscopic image signals of the part to be observed;

[0028] The camera host is used to obtain the endoscopic image signal and generate an endoscopic image;

[0029] The second communication component is used to establish a communication connection with the first communication component of the ultrasonic imaging system; the camera host is also used to receive an ultrasonic image from the ultrasonic imaging system through the second communication component;

[0030] The camera host transmits the endoscopic image and the ultrasound image to the endoscopic display, and the endoscopic display displays the endoscopic image and the ultrasound image on an interface.

[0031] In one embodiment, the handheld operating unit of the endoscope includes a second operating component; the second operating component is used for user operation to generate display parameter instructions; the display parameter instructions are used to set the display ratio, display size and / or display position of the endoscopic image and the ultrasound image displayed on the interface of the endoscope display.

[0032] In one embodiment, the handheld operating part of the endoscope includes a second operating component; the second operating component is used for user operation to generate imaging parameter instructions, and the second communication component is used to transmit the imaging parameter instructions to the ultrasound host; wherein the imaging parameter instructions are used to set the imaging parameters of the ultrasound imaging system, and the imaging parameters include one or more of the following: one or more imaging modes, imaging sub-parameters corresponding to each imaging mode, and navigation function parameters.

[0033] In one embodiment, the handheld operating part of the endoscope includes a second operating component; the second operating component can be operated by a user to generate a close instruction, and the close instruction is used to close the ultrasound image displayed on the interface of the endoscope display; and / or, the second operating component can be operated by a user to generate an open instruction, and the open instruction is used to turn on the display of the ultrasound image on the interface of the endoscope display.

[0034] In one embodiment, the second communication component is capable of receiving display parameter instructions transmitted by the ultrasound imaging system, wherein the display parameter instructions are generated by the user operating the first operating component of the ultrasound probe of the ultrasound imaging system; the display parameter instructions are used to set the display ratio, display size and / or display position of the endoscopic image and the ultrasound image displayed on the interface of the endoscope display.

[0035] In one embodiment, the second communication component is capable of receiving a close instruction transmitted by the ultrasound imaging system, wherein the close instruction is generated by a first operating component of an ultrasound probe of the ultrasound imaging system being operated by a user, and the close instruction is used to close the ultrasound image displayed on the interface of the endoscope display; and / or, the second communication component is capable of receiving an open instruction transmitted by the ultrasound imaging system, wherein the open instruction is generated by a first operating component of an ultrasound probe of the ultrasound imaging system being operated by a user, and the open instruction is used to open the display of the ultrasound image on the interface of the endoscope display.

[0036] In one embodiment, the camera host or the endoscope display has a second communication interface, and the second communication interface is used to plug in the second communication component.

[0037] In one embodiment, the second communication component is a wifi communication component, a WHDI communication component or a WiHD communication component.

[0038] According to the above-mentioned embodiments, the imaging system, ultrasound imaging system and endoscope system used in the operating room are used. A communication component (for example, a first communication component and / or a second communication component) is introduced to establish communication between the endoscope system and the ultrasound imaging system, so that the ultrasound imaging system can send ultrasound images to the endoscope system through the communication component, so that the endoscope display can display not only the endoscope image but also the ultrasound image on the same interface, so that the user does not have to switch the line of sight back and forth between the endoscope display and the ultrasound display, which is very convenient.

[0039] According to the imaging system, ultrasound imaging system and endoscope system used in the operating room according to the above embodiment, the ultrasound probe of the ultrasound imaging system has a first operating component, so that the user can directly control the display parameters of the endoscope display, the imaging parameters of the ultrasound imaging system, etc. through the first operating component, without having to operate the operation panel of the ultrasound host, which is very beneficial to the operation;

[0040] According to the above-mentioned embodiments, the imaging system, ultrasound imaging system and endoscope system used in the operating room, the handheld operating unit of the endoscope system has a second operating component, so that the user can directly control the display parameters of the endoscope display, the imaging parameters of the ultrasound imaging system, etc. through the second operating component, which is very beneficial to the progress of the operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 is a schematic structural diagram of an imaging system for an operating room according to an embodiment;

[0042] Figure 2 is a schematic structural diagram of an imaging system for an operating room according to an embodiment;

[0043] Figure 3 is a schematic structural diagram of an ultrasonic imaging system according to an embodiment;

[0044] Figure 4 is a schematic structural diagram of an ultrasonic probe according to an embodiment;

[0045] Figure 5 is a schematic structural diagram of a first operating component of an embodiment;

[0046] Figure 6 A schematic diagram of an interactive menu of an embodiment;

[0047] FIG. 7( a ) is a schematic diagram showing an example of performing data rearrangement; FIG. 7( b ) is a schematic diagram showing another example of performing data rearrangement; FIG. 7( c ) is a schematic diagram showing yet another example of performing data rearrangement;

[0048] Figure 8 A schematic diagram of the structure of an ultrasound host according to an embodiment;

[0049] Fig. 9 is a schematic structural diagram of an endoscope system according to an embodiment;

[0050] Fig.10 An example diagram of an interface of an endoscope display according to an embodiment. DETAILED DESCRIPTION

[0051] The present invention is further described in detail below by specific embodiments in conjunction with the accompanying drawings. Wherein similar elements in different embodiments adopt associated similar element numbers. In the following embodiments, many detailed descriptions are for making the present application better understood. However, those skilled in the art can easily recognize that some features can be omitted in different situations, or can be replaced by other elements, materials, methods. In some cases, some operations related to the present application are not shown or described in the specification, this is to avoid the core part of the present application being overwhelmed by too much description, and for those skilled in the art, it is not necessary to describe these related operations in detail, and they can fully understand the related operations according to the description in the specification and the general technical knowledge in the art.

[0052] In addition, the features, operations or characteristics described in the specification can be combined in any appropriate manner to form various implementations. At the same time, the steps or actions in the method description can also be interchanged or adjusted in a manner that is obvious to those skilled in the art. Therefore, the various sequences in the specification and the drawings are only for the purpose of clearly describing a certain embodiment and are not meant to be a required sequence, unless otherwise specified that a certain sequence must be followed.

[0053] The serial numbers of the components in this document, such as "first", "second", etc., are only used to distinguish the objects described and do not have any order or technical meaning. The "connection" and "coupling" mentioned in this application, unless otherwise specified, include direct and indirect connections (couplings).

[0054] Different medical devices display information, content and images on their respective displays. However, in special scenarios such as operating rooms, users (e.g. doctors) need to use different medical devices and view images acquired by multiple different medical devices. This requires users to switch their vision back and forth between the display screens of various medical devices. This is also very inconvenient for users when they need to carefully compare the images acquired by different medical devices.

[0055] The applicant has found that the demand and frequency for viewing ultrasonic images of the ultrasonic imaging system and endoscopic images of the endoscope system during surgery are very high, so the present application proposes corresponding solutions to solve the above problems.

[0056] Please refer to Figure 1 In some embodiments, an imaging system 300 for an operating room is disclosed. The imaging system 300 may include an ultrasound imaging system 100, an endoscope system 200, and a communication component 310. The communication component 310 is used to establish a communication connection between the endoscope system 200 and the ultrasound imaging system 100.

[0057] By introducing the communication component 310, a communication connection is established between the endoscope system 200 and the ultrasound imaging system 100, so that the ultrasound imaging system 100 can send, for example, ultrasound images to the endoscope system 200, so that the endoscope display of the endoscope system 200 displays the endoscope image and the ultrasound image on the interface, and the endoscope display can display not only the endoscope image but also the ultrasound image on the same interface, so that the user does not have to switch the line of sight back and forth between the endoscope display and the ultrasound display, which is very convenient.

[0058] Please refer to Figure 2 In some embodiments, the communication component 310 includes a first communication component 01 and a second communication component 02, which will be described in further detail below.

[0059] The ultrasound imaging system 100 , the endoscope system 200 , and the communication component 310 are described below respectively.

[0060] Figure 3 is an example diagram of an ultrasound imaging system 100 ; in some embodiments, the ultrasound imaging system 100 includes an ultrasound probe 10 , an ultrasound host 30 , and an ultrasound display 50 , which will be described in detail below.

[0061] The ultrasonic probe 10 is used to transmit ultrasonic waves and receive echo signals of the ultrasonic waves. Specifically, the ultrasonic probe 10 is used to transmit ultrasonic waves to a region of interest, receive ultrasonic echoes returned from the region of interest, and convert the ultrasonic echoes into electrical signals to obtain ultrasonic echo signals.

[0062] In some embodiments, the ultrasound probe 10 includes a housing 10 and an array element group 11; Figure 4 As an example, the following is a detailed description.

[0063] In some embodiments, the housing 10 is formed with a hand-holding area for holding. The user can hold the ultrasound probe 10 through the hand-holding area of ​​the housing 10 .

[0064] In some embodiments, the array element group 11 is used to transmit ultrasound to the region of interest, and to receive ultrasound echoes returned from the region of interest and obtain ultrasound echo signals. In some embodiments, the array element group 11 includes multiple array elements, which are used to realize the mutual conversion between electrical pulse signals and ultrasound, so as to realize the transmission of ultrasound to the region of interest and the reception of ultrasound echoes reflected by tissues, and then convert the ultrasound echoes into electrical signals to obtain ultrasound echo signals. In some embodiments, the multiple array elements included in the array element group 11 can be arranged in a row to form a linear array; in some embodiments, the multiple array elements included in the array element group 11 are arranged in a two-dimensional matrix to form a surface array. The array element can transmit ultrasound according to the excitation electrical signal, or convert the received ultrasound into an electrical signal. Therefore, each array element can be used to transmit ultrasound to the region of interest, and can also be used to receive ultrasound echoes returned from the region of interest. When performing ultrasonic testing, the transmission sequence and the reception sequence can be used to control which array elements are used to transmit ultrasound and which array elements are used to receive ultrasound, or control the array elements to transmit ultrasound or receive ultrasound echoes in time slots. All array elements participating in ultrasonic emission may be excited by electrical signals simultaneously, thereby simultaneously emitting ultrasonic waves; or array elements participating in ultrasonic emission may also be excited by a number of electrical signals with a certain time interval, thereby continuously emitting ultrasonic waves with a certain time interval.

[0065] In some embodiments, the ultrasound probe 10 may further include a first operating component 13, which is used for user operation, such as for user operation to control ultrasound imaging, etc. For example, the user sets imaging parameters through the first operating component 13, and for another example, the user freezes, saves and / or thaws the displayed ultrasound image through the first operating component 13.

[0066] Through the first operating component 13 on the ultrasound probe 10, the user does not need to operate the operation panel of the ultrasound host 30, but can directly control the ultrasound imaging by operating the first operating component 13 of the ultrasound probe 10 during the process of holding the ultrasound probe 10 for ultrasound imaging, which is very convenient.

[0067] The first operating component 13 may include one or more physical function keys. Since the ultrasound probe 10 itself has a relatively small area for setting function keys, in order to reduce the number of function keys and achieve more functions with as few function keys as possible, an interactive menu may be designed specifically for the first operating component 13.

[0068] In some embodiments, the first operating component 13 of the ultrasound probe 10 is used for the user to operate to generate an interactive menu, so that the ultrasound display 50 displays the interactive menu.

[0069] In some embodiments, the interactive menu is used for the user to control the ultrasound imaging through the first operating component 13 , wherein the interactive menu may be displayed on the ultrasound display 50 .

[0070] In some embodiments, the interactive menu is used for the user to set imaging parameters through the first operating component 13. In some embodiments, the interactive menu is used for the user to freeze, save or unfreeze the ultrasound image through the first operating component 13.

[0071] In some embodiments, the imaging parameters include one or more of the following:

[0072] 1) One or more imaging modes, such as one or more of B-mode, C-mode, PW mode, CW mode, Power mode, contrast imaging mode and elastic imaging mode.

[0073] 2) Imaging sub-parameters corresponding to each imaging mode;

[0074] For example, the imaging sub-parameters corresponding to the B mode include: one or more of gain, frequency, focus, depth, and dynamic range;

[0075] For example, the imaging sub-parameters corresponding to the C mode include one or more of gain, frequency, pulse repetition frequency, sampling frame size, sampling line angle, inversion color, wall filtering, smoothing, persistence, and color map;

[0076] For example, the imaging sub-parameters corresponding to the PW mode include one or more of gain, frequency, pulse repetition frequency, sampling volume, sampling line angle, wall filtering, and baseline position;

[0077] For example, the imaging sub-parameters corresponding to the CW mode include one or more of gain, frequency, sampling line angle, and wall filtering;

[0078] For example, the imaging sub-parameters corresponding to the Power mode include one or more of gain, frequency, pulse repetition frequency, sampling frame size, sampling line angle, wall filtering, smoothing, persistence, dynamic range, and energy spectrum;

[0079] For example, the imaging sub-parameters corresponding to the contrast imaging mode include one or more of focus, frequency, acoustic output power, and MI mechanical index;

[0080] For example, the imaging sub-parameters corresponding to the elastic imaging mode include one or more of shear wave elasticity, strain elasticity, transient elasticity and viscoelasticity.

[0081] 3) Navigation function parameters; for example, navigation function parameters include one or more of tumor parameters, guide line parameters, and guide region parameters.

[0082] In some embodiments, the interactive menu includes a first-level menu and a second-level menu. The imaging mode and / or navigation function can be arranged in the first-level menu, so the first-level menu has first-level options for users to select the imaging mode and / or navigation function. After any first-level option of the interactive menu is selected, the interactive menu will expand the second-level menu associated with the selected first-level option; wherein the second-level menu associated with the first-level option of the imaging mode is the setting option of the imaging sub-parameter corresponding to the imaging mode, and the second-level menu associated with the first-level option of the navigation function is the setting option of the navigation function parameter.

[0083] In some embodiments, the first operating component 13 includes a menu button 13a and direction keys 13b disposed on both sides of the menu button 13a. There may be one or more direction keys 13b, for example Figure 5 This is an example with four direction keys 13b, which respectively represent up, down, left and right movements on the interface; when the menu button 13a is triggered, it is used to generate or close the interactive menu - for example, by double-clicking the menu button 13a to generate the interactive menu, and double-clicking the menu button 13a again to close the interactive menu; the direction key 13b is used to select the first-level options of the first-level menu and the setting options of the second-level menu.

[0084] Figure 6 is an example of an interactive menu; in some examples, the user generates or calls out the interactive menu by double-clicking the menu button 13a, and the user moves between the first-level options in the first-level menu by using the direction key 13b; after staying on any first-level option for more than a preset time, the interactive menu automatically expands the second-level menu associated with the first-level option, or the user selects the first-level option by single-clicking the menu button 13a, and after the first-level option is selected, the interactive menu expands the second-level menu associated with the first-level option, or the user selects the first-level option by using the right direction key 13b, and after the first-level option is selected, the interactive menu expands the second-level menu associated with the first-level option. After entering the secondary menu, the user can use the arrow keys 13b to move between the various setting options in the second-level menu. For example, after entering the second-level menu of the B mode, if the second-level menu of the B mode includes setting options for gain, frequency, focus, depth, and dynamic range, the arrow keys 13b can be used to move between the various setting options in the B mode; the user selects a setting option in the second-level menu by clicking the menu button 13a, or the user selects a setting option in the second-level menu by using the right arrow key 13b; if a setting option requires a numerical value, the setting option in the second-level menu can have a default numerical value or a numerical value corresponding to the current ultrasound image after it is selected, and the numerical value can be adjusted by, for example, using the up and down arrow keys 13b. It should be noted that in Figure 5In the example of the interactive menu, C mode is selected and the second-level menu corresponding to C mode is expanded.

[0085] It should be noted that the above are only some examples of interacting with the interactive menu through buttons. In specific implementation examples, technicians can also design specific interaction logic between buttons and interactive menus based on needs.

[0086] In some embodiments, the options and settings of the interactive menu can also be set based on user needs. For example, if the user does not need all imaging modes, but only needs a few imaging modes that the user often uses, the first level menu of the interactive menu can be set to only retain the several imaging modes that the user often uses through the ultrasound host 30. Similarly, if the user only needs to adjust a few imaging sub-parameters that the user often uses in a certain imaging mode, the user can set the second level menu in the corresponding imaging mode through the ultrasound host 30 to only retain the setting options corresponding to the several imaging sub-parameters that the user often uses.

[0087] The above is some description of the first operating component 13 on the ultrasound probe 10. It can be seen that in some examples, the user can switch the image imaging mode by operating the first operating component 13 on the ultrasound probe 10, and adjust and set the imaging sub-parameters in the specific imaging mode; in some examples, the user can freeze, save and / or unfreeze the ultrasound image by operating the first operating component 13 on the ultrasound probe 10.

[0088] In some embodiments, the ultrasound host 30 is used to process the echo signal of the ultrasound wave to obtain ultrasound data. The ultrasound host 30 and the ultrasound probe may be connected by wire or by wireless.

[0089] In some embodiments, the ultrasound host 30 processes the ultrasound echo signal and generates an ultrasound image, which includes one or more processing steps. For example, the processing of the ultrasound echo signal may include the following steps: analog-to-digital conversion, signal demodulation, amplification, filtering, downsampling, beamforming, modulo, logarithmic compression, and grayscale conversion of the ultrasound echo signal. The following is an explanation of each data processing step.

[0090] The ultrasonic echo signal received by the array element group 11 of the ultrasonic probe 10 is an analog signal, and digital ultrasonic data is obtained after the analog-to-digital conversion link. The signal demodulation link refers to the signal demodulation of the input ultrasonic data, wherein the input ultrasonic data can be a digital signal obtained after the analog-to-digital conversion link; the demodulation method can include: simple demodulation, orthogonal demodulation, Hilbert transform demodulation, secondary sampling demodulation, multiple sampling demodulation or baseband sampling demodulation, etc. The commonly used demodulation method is orthogonal demodulation. That is, the received echo signal is divided into two paths, and multiplied by cos(ωnTs ) and sin(ωnT s ). The amplification processing link includes: according to the different receiving moments of the ultrasonic data, using different amplification factors to amplify the ultrasonic data to compensate for the attenuation of the data signal; or, according to the different positions of the ultrasonic data, giving different amplification factors to compensate for the attenuation of the data signal; the amplification processing link may be after the signal demodulation link.

[0091] The filtering process is usually performed after signal demodulation, for example, by a low-pass filter to improve the signal quality. Downsampling is to reduce the sampling rate of the signal and reduce the amount of calculation. Data normalization can include scaling normalization or standard normalization. Data normalization can limit the data to a certain range, thereby eliminating the adverse effects caused by singular (sample) data.

[0092] Principal component analysis includes: centering the ultrasound data to obtain features, solving the covariance matrix of the features, solving the eigenvalues ​​of the covariance matrix, selecting the maximum eigenvalue to form a eigenvector, and projecting the ultrasound data to the eigenvector; principal component analysis mainly plays the role of reducing the feature dimension of the data.

[0093] Data enhancement includes translating and / or adding noise to ultrasound data, which is to improve the accuracy of neural network processing data. For example, when training a neural network, in limited training data, operations such as translating and adding noise to the data expand the size of the data set, thereby enhancing the accuracy of the neural network.

[0094] The data rearrangement includes rearranging the ultrasonic data in at least one of the following ways: arranging the ultrasonic data received by each array element of the ultrasonic probe 10 into two columns after demodulation (one column is I data and the other column is Q data. Assuming that the data received by a certain array element is (Npoint*1), it is arranged in two columns as shown in FIG. 7(a) I1Q1 two columns of data) or arranging it into one column before demodulation; arranging the ultrasonic data (Npoint*2n) received by all effective array elements of the ultrasonic probe 10 after the ultrasonic probe 10 transmits ultrasonic waves at the same time into a matrix (as shown in FIG. 7(b) I1Q1...I n Q n The ultrasonic data (Npoint*1) received by each array element of the ultrasonic probe 10 is divided into multiple (for example, m) and then arranged into a matrix (Npoint / m, 2m, as shown in FIG. 7( c)). 1-1 Q 1-1 ,I 1-2 Q 1-2 Figure 7(c) shows an example where m is 2. It should be noted that if the data is before demodulation, it is no longer arranged in two columns, i.e. Figure 7(a) to Figure 7(c)The number of columns in is reduced by half. In addition, in other examples, Figure 7(a) to Figure 7(c) The rearranged data can be combined into three-dimensional or even higher-dimensional data input. The rearranged data is input into the neural network as the input data of the neural network, which can improve the accuracy of the neural network.

[0095] The beamforming process refers to the reconstruction and transformation of ultrasonic data (which can be the RF signal before demodulation or the baseband signal after demodulation) from the channel domain (for example, the data dimension is: time direction * number of channels * number of transmissions) into beam domain data (i.e., beamforming data, for example, the data dimension is: number of vertical points * number of horizontal points, which are points in the actual physical space); beamforming can adopt a variety of beamforming methods, including but not limited to the delay apodization sum (DAS) method, adaptive beamforming method, coherence factor beamforming method and / or incoherent beamforming method or frequency domain beamforming method, etc.

[0096] Modulo, logarithmic compression and grayscale conversion are the processing steps for ultrasound data in the image domain. These three items can also be collectively referred to as scan conversion, thereby obtaining an ultrasound image for display on the ultrasound display 50.

[0097] In some embodiments, please refer to Figure 8 The ultrasound host 30 includes a transmitting and receiving control circuit 31, and a processor 33, which will be described in detail below.

[0098] In some embodiments, the transmitting and receiving control circuit 31 is used to control the ultrasonic probe 10 to transmit ultrasonic waves and receive ultrasonic echo signals. For example, the transmitting and receiving control circuit 20 is used to control the ultrasonic probe 10 to transmit ultrasonic waves to the region of interest on the one hand, and to control the ultrasonic probe 10 to receive ultrasonic echoes reflected by the tissue on the other hand. In some specific embodiments, the transmitting and receiving control circuit 20 is used to generate a transmitting sequence and a receiving sequence, and output them to the ultrasonic probe 10. The transmitting sequence is used to control part or all of the multiple array elements in the ultrasonic probe 10 to transmit ultrasonic waves to the region of interest. The parameters of the transmitting sequence include the number of array elements used for transmission and ultrasonic transmission parameters (such as amplitude, frequency, number of wave transmissions, transmission interval, transmission angle, waveform and / or focus position, etc.). The receiving sequence is used to control part or all of the multiple array elements to receive the echo of the ultrasonic wave after passing through the tissue. The parameters of the receiving sequence include the number of array elements used for reception and the receiving parameters of the echo (such as reception angle, depth, etc.). The ultrasonic parameters in the transmitting sequence and the echo parameters in the receiving sequence are different depending on the use of the ultrasonic echo or the image generated according to the ultrasonic echo. For example, different working modes, such as B mode, C mode, M mode and D mode (Doppler mode), may have different transmission sequence parameters. After the echo signal is received by the ultrasound probe 10 controlled by the transmission and reception control circuit 20 and processed by subsequent modules and corresponding algorithms, a B image reflecting the tissue anatomical structure, a C image reflecting the blood flow information, and a D image reflecting the Doppler spectrum image can be generated.

[0099] In some embodiments, the processor 33 can perform one or more steps of the above-mentioned processing of ultrasonic echo signals, such as receiving and forming channel data, analog-to-digital conversion, signal demodulation, amplification, filtering, downsampling, beamforming, modulo, logarithmic compression and grayscale conversion.

[0100] In some embodiments, the processor 33 includes but is not limited to a central processing unit (CPU), a micro controller unit (MCU), a field programmable gate array (FPGA), a digital signal processing (DSP), and other devices for interpreting computer instructions and processing data in computer software.

[0101] In some embodiments, the processor 33 is used to execute each computer application in the non-transitory computer-readable storage medium, thereby executing the corresponding steps and methods. For example, the processor 30 can be implemented by software, hardware, firmware, or a combination thereof, and can use at least one of a circuit, a single or multiple application-specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), a field programmable gate array (FPGA), a central processing unit (CPU), a controller, a microcontroller, and a microprocessor.

[0102] The ultrasound display 50 is used to display information, such as content related to ultrasound imaging.

[0103] In some embodiments, the ultrasound imaging system 100 communicates with the endoscope system 200 through the first communication component 01, for example, transmitting data to the endoscope system 200 or acquiring data from the endoscope system 200. In some embodiments, the ultrasound imaging system 100 may include the first communication component 01, for example, the first communication component 01 is integrated in the ultrasound host 30, and for another example, the ultrasound host 30 has a first communication interface 01a, and the first communication interface 01a is used to plug the first communication component 01, that is, the first communication component 01 is pluggable and arranged on the first communication interface 01a of the ultrasound host 30.

[0104] The above is some description of the ultrasound imaging system 100 .

[0105] Fig. 9 2 is an example diagram of an endoscope system 200; in some embodiments, the endoscope system 200 includes an endoscope and a camera host 250 connected to the endoscope, wherein the endoscope may include an insertion portion 230 and a handheld operation portion 260, the insertion portion 230 is used to be inserted into a patient to observe the part to be observed, and the handheld operation portion 260 is used for handheld operation by a user; in some embodiments, the insertion portion 230 and the handheld operation portion 260 may be an integral structure or a detachable structure; in some embodiments, the endoscope further includes at least one image sensor (not shown), and illustratively, the image sensor may be disposed at the front end of the insertion portion 230 of the endoscope. The camera host 250 is used to obtain image signals from the endoscope to perform signal processing on the image signals.

[0106] In some embodiments, the endoscope system 200 further includes a light source 210; the light source 210 is used to provide illumination to the patient's part to be observed. For example, the light source 210 may include a visible light source and a special light source. Exemplarily, the visible light source is an LED light source, which can provide multiple monochromatic lights of different wavelength ranges, a combination of multiple monochromatic lights, or a wide-spectrum white light source. The special light source can be a laser light source corresponding to a fluorescent agent, such as near-infrared light. In some embodiments, before imaging using the endoscope system 200, a fluorescent agent is injected into the part to be observed, and the fluorescent agent can generate fluorescence after absorbing the laser generated by the laser light source.

[0107] In some embodiments, the endoscope system 200 may include a light guide 220 and a cable 240 , etc.; the light source 210 is connected to the endoscope via the light guide 220 , the handheld operating unit 260 is connected to the camera host 250 via the cable 240 , and is connected to the light source 210 via the light guide 220 .

[0108] In some embodiments, the insertion portion 230 of the endoscope includes a tube, an image sensor, and an illumination light path. The front end of the tube is used to be inserted into the human body and penetrate into the part to be inspected. The illumination light path is connected to the light guide 220, and is used to irradiate the light generated by the light source 210 to the part to be detected / observed of the target object. The image sensor is used to convert the optical signal into an electrical signal, including but not limited to a CCD sensor, a CMOS sensor, etc. The image signal collected by the image sensor is sent to the camera host 250 for subsequent image processing after the handheld operation part 260 performs preliminary signal processing. The preliminary signal processing includes amplification and filtering, and finally an endoscopic image of the part to be detected / observed can be generated. In addition, in some embodiments, the image sensor can also specifically include a first image sensor and a second image sensor, which are used to convert the optical signal into an electrical signal, including but not limited to a CCD sensor, a CMOS sensor, etc. The image signal collected by the image sensor is sent to the camera host 250 for subsequent image processing after the handheld operation part 260 performs preliminary signal processing. The preliminary signal processing includes amplification and filtering. The optical axes of the first image sensor and the second image sensor can be arranged in parallel or at a certain angle. The first image signal and the second image signal collected by the first image sensor and the second image sensor can correspond to a stereo pair of images observed by the left and right eyes of a person, thereby simulating binocular stereoscopic vision of the human eye.

[0109] The other end of the handheld operating unit 260 is connected to the camera host 250 via the cable 240, and transmits the image signal to the camera host 250 for processing via the cable 240. In some embodiments, the handheld operating unit 260 can also send the image data to the camera host 250 by wireless transmission.

[0110] In some embodiments, the camera host 250 is provided with a processor, which obtains the image signal output by the handheld operating unit 260, processes the image signal, and outputs the processed image data.

[0111] In some embodiments, the endoscope system 200 further includes an endoscope display 270, and the camera host 250 can be connected to the endoscope display 270 by wired means such as a video cable. For example, the camera host 250 can send the endoscope image to the endoscope display 270 for display.

[0112] In some embodiments, the handheld operating unit 260 includes a second operating component 261. The second operating component 261 may include one or more physical function keys.

[0113] In some embodiments, the user controls the endoscopic imaging through the second operating component 261 ; in some embodiments, the user controls the display of the endoscopic display 270 through the second operating component 261 .

[0114] It should be noted that Fig. 9 The endoscope system 200 is merely an example and does not constitute a limitation on the endoscope system 200. The endoscope system 200 may include Fig. 9 More or fewer components, or a combination of certain components, or different components may be shown. For example, the endoscope system 200 may also include a dilator, a smoke control device, input and output devices, a network access device, etc.

[0115] In some embodiments, the endoscope system 200 communicates with the ultrasound imaging system 100 via the second communication component 02, for example, transmitting data to the ultrasound imaging system 100 or acquiring data from the ultrasound imaging system 100. In some embodiments, the endoscope system 200 may include the second communication component 02, for example, the second communication component 02 is integrated in the camera host 250, and for another example, the camera host 250 or the endoscope display 270 has a second communication interface 02a, and the second communication interface 02a is used to plug the second communication component 02, that is, the second communication component 02 is pluggable and arranged on the second communication interface 02a.

[0116] The above is some description of the endoscope system 200.

[0117] As described above, different medical devices display information, content and images on their respective displays. For example, the ultrasound imaging system 100 displays ultrasound images through the interface of its ultrasound display 50, and the endoscope system 200 displays endoscopic images through the interface of its endoscope display 270. When the user needs to view the endoscopic image and the ultrasound image, or even needs to compare the two images, the user needs to frequently switch his or her line of sight between the interfaces of different displays, which affects the smooth progress of, for example, surgery and is very inconvenient.

[0118] To this end, by introducing the communication component 310, a communication connection is established between the endoscope system 200 and the ultrasound imaging system 100, so that the ultrasound imaging system 100 sends, for example, ultrasound images to the endoscope system 200, so that the endoscope display of the endoscope system 200 displays the endoscope image and the ultrasound image on the interface, so that the endoscope display not only displays the endoscope image but also the ultrasound image on the same interface, so that the user does not have to switch his or her line of sight back and forth between the endoscope display and the ultrasound display, which is very convenient.

[0119] Therefore, in some embodiments, the ultrasound host 30 sends the ultrasound image to the camera host 250 through the communication component 310, and the camera host 250 receives the ultrasound image and sends it to the endoscope display 270; the endoscope display 270 displays the endoscope image and the ultrasound image on the interface. Fig.10 This is an example of displaying an endoscopic image and an ultrasound image on the interface A on the endoscope display 270 .

[0120] In some examples, the user may also perform control through the first operating component 13 of the ultrasound probe 10 .

[0121] In some embodiments, the first operating component 13 of the ultrasound probe 10 can be operated by the user to generate a display parameter instruction, and the display parameter instruction is used to set the display parameters of the endoscope display 270, such as the display ratio, display size and / or display position of the endoscope image and the ultrasound image displayed on the interface of the endoscope display 270. In some embodiments, the first communication component 01 transmits the display parameter instruction to the endoscope system 200 (e.g., the camera host 250) to set the display parameters of the endoscope display 270.

[0122] In some embodiments, the first operating component 13 of the ultrasound probe 10 can be operated by a user to generate imaging parameter instructions and transmit them to the ultrasound host 30. The imaging parameter instructions are used to set the imaging parameters of the ultrasound imaging system 100. The imaging parameters of the ultrasound imaging system can be found in the above description and will not be repeated here.

[0123] In some embodiments, the first operating component 13 of the ultrasound probe 10 is used for the user to operate to generate an interactive menu. In some embodiments, the interactive menu is used for the user to set the display parameters of the endoscope display 270 through the first operating component 13. The display parameters of the endoscope display 270 refer to the above description and will not be repeated here. In some embodiments, the interactive menu is used for the user to control the ultrasound imaging through the first operating component 13, such as setting the imaging parameters of the ultrasound imaging system 100. The imaging parameters can refer to the above description and will not be repeated here.

[0124] In some embodiments, the ultrasound display 50 displays an interactive menu.

[0125] In some embodiments, the communication component 310 is used to transmit the interactive menu to the endoscope system 200 so as to display the interactive menu on the interface of the endoscope display 270 thereof.

[0126] It can be seen that the user can switch the image imaging mode by operating the first operating component 13 of the ultrasound probe 10, and adjust and set the imaging sub-parameters under the specific imaging mode. In this way, when the user switches from one imaging mode to another by operating the ultrasound probe 10, the ultrasound image displayed on the endoscope display 270 will also be switched. When the user adjusts and sets the imaging sub-parameters by operating the ultrasound probe 10, the ultrasound image displayed on the endoscope display 270 will be updated accordingly.

[0127] In some examples, the user may also control the second operating component 261 of the handheld operating unit 260 .

[0128] In some embodiments, the second operating component 261 of the handheld operating unit 260 can be operated by a user to generate display parameter instructions, which are used to set the display parameters of the endoscope display 270, such as the display ratio, display size and / or display position of the endoscopic image and the ultrasound image displayed on the interface of the endoscope display 270.

[0129] In some embodiments, the second operating component 261 of the handheld operating unit 260 can be operated by the user to generate an imaging parameter instruction, and the imaging parameter instruction is used to set the imaging parameters of the ultrasound imaging system 100; the imaging parameters of the ultrasound imaging system can refer to the above description, which will not be repeated here. In some embodiments, the second communication component 02 transmits the imaging parameter instruction to the ultrasound imaging system 100 (for example, the ultrasound host 30) to set the imaging parameters of the ultrasound imaging system 100 of the endoscope display 270.

[0130] In some embodiments, the second operating component 261 of the handheld operating unit 260 is used for the user to operate to generate an interactive menu. In some embodiments, the interactive menu is used for the user to set the display parameters of the endoscope display 270 through the second operating component 261 of the handheld operating unit 260. The display parameters of the endoscope display 270 refer to the above description and will not be repeated here. In some embodiments, the interactive menu is used for the user to control the ultrasound imaging through the second operating component 261, such as setting the imaging parameters of the ultrasound imaging system 100. The imaging parameters can refer to the above description and will not be repeated here.

[0131] In some embodiments, the endoscope display 270 displays an interactive menu.

[0132] In some embodiments, the communication component 310 is used to transmit the interactive menu to the ultrasound imaging system 100 so as to display the interactive menu on an interface within the ultrasound display 50 thereof.

[0133] It can be seen that the user can switch the imaging mode of the ultrasound imaging system 100 by operating the second operating component 261 of the handheld operating unit 260, and adjust and set the imaging sub-parameters under the specific imaging mode. In this way, when the user switches from one imaging mode to another by operating the handheld operating unit 260, the ultrasound image displayed on the endoscope display 270 will also be switched. When the user adjusts and sets the imaging sub-parameters by operating the handheld operating unit 260, the ultrasound image displayed on the endoscope display 270 will be updated accordingly.

[0134] In some examples, the user can turn on or off the display of the ultrasound image on the interface of the endoscope display 270 by operating the first operating component 13 of the ultrasound probe 10 and / or operating the handheld operating unit 260 .

[0135] In some embodiments, the first operating component 13 of the ultrasound probe 10 can be operated by the user to generate a closing instruction, and the closing instruction is used to close the display of the ultrasound image on the interface of the endoscope display 270. In some examples, the first communication component 01 is used to transmit the closing instruction to the endoscope system 200 (for example, the camera host 250), so as to close the display of the ultrasound image on the interface of the endoscope display 270.

[0136] In some embodiments, the first operating component 13 of the ultrasound probe 10 can be operated by the user to generate an opening instruction, and the opening instruction is used to open the display of the ultrasound image on the interface of the endoscope display 270. In some examples, the first communication component 01 is used to transmit the opening instruction to the endoscope system 200 (for example, the camera host 250), so as to open the display of the ultrasound image on the interface of the endoscope display 270.

[0137] In some embodiments, the second operating component 261 of the handheld operating unit 260 can be operated by the user to generate a closing instruction, and the closing instruction is used to close the display of the ultrasound image on the interface of the endoscope display 270.

[0138] In some embodiments, the second operating component 261 of the handheld operating unit 260 can be operated by the user to generate an opening instruction, and the opening instruction is used to start displaying the ultrasound image on the interface of the endoscope display 270.

[0139] By displaying the endoscopic image and the ultrasound image on the endoscope display 270, the user can view the endoscopic image and the ultrasound image on the same screen on a display interface; at the same time, through the first operating component 13 of the ultrasound probe 10 or the second operating component 261 of the handheld operating unit 260, parameters such as display parameters and ultrasound imaging parameters can be adjusted and set, which makes the user's operation process more convenient.

[0140] It can be understood that the interactive menu displayed on the interface of the endoscope display 270 and / or the ultrasound display 50 can automatically disappear or become a menu icon after the operation is completed, and can also automatically disappear or become a menu icon if it is not operated for a period of time; similarly, the interactive menu displayed on the interface of the ultrasound display 50 can automatically disappear or become a menu icon after the operation is completed, and can also automatically disappear or become a menu icon if it is not operated for a period of time.

[0141] By introducing the communication component 310, a communication connection is established between the endoscope system 200 and the ultrasound imaging system 100, so that the ultrasound imaging system 100 can send, for example, ultrasound images to the endoscope system 200, so that the endoscope display of the endoscope system 200 displays the endoscope image and the ultrasound image on the interface, and the endoscope display can display not only the endoscope image but also the ultrasound image on the same interface, so that the user does not have to switch the line of sight back and forth between the endoscope display and the ultrasound display, which is very convenient.

[0142] In the operating room, there are many kinds of medical equipment, for example, not only ultrasonic imaging system 100 and endoscope system 200, but also equipment such as pendant, shadowless lamp, ventilator and monitoring equipment, so the space in the operating room is limited, and the wired connection must take into account the position of the cavity ultrasonic imaging system 100 and the endoscope system 200, which limits the placement of the equipment; in addition, there are many people during the operation (such as the surgeon, assistants, nurses, etc.), the space is limited, and the personnel have to operate various equipment, and the wired connection increases the risk; and the wired connection needs to be set up in advance, which is relatively cumbersome and complicated, especially for medical staff without IT technology background.

[0143] Therefore, in some embodiments, the communication component 310 is a wireless communication component, which is used to establish a wireless communication connection between the endoscope system 200 and the ultrasound imaging system 100 .

[0144] Therefore, in some embodiments, the first communication component 01 is a wireless communication component; for example, the first communication component 01 is a wifi communication component, a WHDI communication component or a WiHD communication component.

[0145] Therefore, in some embodiments, the second communication component 02 is a wireless communication component; for example, the second communication component 02 is a wifi communication component, a WHDI communication component or a WiHD communication component.

[0146] This document is described with reference to various exemplary embodiments. However, those skilled in the art will recognize that changes and modifications may be made to the exemplary embodiments without departing from the scope of this document. For example, various operating steps and components for performing the operating steps may be implemented in different ways (e.g., one or more steps may be deleted, modified, or incorporated into other steps) depending on the specific application or considering any number of cost functions associated with the operation of the system.

[0147] Although the principles of this invention have been shown in various embodiments, many modifications of structures, arrangements, proportions, elements, materials and components particularly suitable for specific environments and operational requirements can be used without departing from the principles and scope of this invention. The above modifications and other changes or amendments will be included in the scope of this invention.

[0148] The foregoing specific description has been described with reference to various embodiments. However, those skilled in the art will recognize that various modifications and changes can be made without departing from the scope of the present disclosure. Therefore, the consideration of the present disclosure will be illustrative rather than restrictive, and all these modifications will be included in its scope. Similarly, the advantages, other advantages and solutions to the problems of various embodiments have been described above. However, the benefits, advantages, solutions to the problems and any elements that can produce these, or make them more clear, should not be interpreted as critical, necessary or necessary. The term "include" and any other variants used in this article are all non-exclusive inclusions, so that the process, method, article or device including the list of elements not only includes these elements, but also includes other elements that are not explicitly listed or do not belong to the process, method, system, article or device. In addition, the term "coupled" and any other variants used in this article refer to physical connections, electrical connections, magnetic connections, optical connections, communication connections, functional connections and / or any other connections.

[0149] Those skilled in the art will appreciate that many changes may be made to the details of the above-described embodiments without departing from the basic principles of the invention. Therefore, the scope of the present invention should be determined solely by the claims.

Claims

1. An imaging system for an operating room, characterized in that: It includes an endoscope system, an ultrasonic imaging system and a communication component, wherein the communication component is used to establish a communication connection between the endoscope system and the ultrasonic imaging system; The endoscopic imaging system comprises an endoscope, a light source, a camera host connected to the endoscope, and an endoscope display for display; the light source is used to provide illumination to the patient's part to be observed; the endoscope comprises an insertion portion and a handheld operation portion, the insertion portion is used to be inserted into the patient's part to be observed; the handheld operation portion is used for handheld operation by a user; the endoscope is provided with one or more image sensors, the image sensors are used to collect endoscopic image signals of the part to be observed; the camera host is used to obtain the endoscopic image signals and generate endoscopic images, and send the endoscopic images to the endoscopic display; The ultrasonic imaging system comprises an ultrasonic probe, an ultrasonic host and an ultrasonic display; the ultrasonic probe is used to transmit ultrasonic waves and receive echo signals of the ultrasonic waves; the ultrasonic host is used to generate an ultrasonic image according to the echo signals; and the ultrasonic display is used to display the ultrasonic image; The communication component includes a first communication component and a second communication component, and the first communication component and the second communication component are used to establish a wireless communication connection with each other; the ultrasound host also sends the ultrasound image to the camera host through the first communication component, and the camera host receives the ultrasound image through the second communication component and sends it to the endoscope display; the endoscope display displays the endoscope image and the ultrasound image on an interface.

2. The imaging system according to claim 1, wherein: The ultrasound probe has a first operating component, which is used for a user to operate to generate display parameter instructions; the communication component is used to transmit the display parameter instructions to the camera host to set the display parameters of the endoscope display; wherein the display parameter instructions are used to set the display ratio, display size and / or display position of the endoscopic image and the ultrasound image displayed on the interface of the endoscope display.

3. The imaging system according to claim 1, wherein: The ultrasound probe has a first operating component, which is used for a user to operate to generate imaging parameter instructions and transmit them to the ultrasound host; wherein the imaging parameter instructions are used to set the imaging parameters of the ultrasound imaging system, and the imaging parameters include one or more of the following: one or more imaging modes, imaging sub-parameters corresponding to each imaging mode, and navigation function parameters.

4. The imaging system according to claim 1, wherein: The ultrasound probe has a first operating component; the first operating component can be operated by a user to generate a closing instruction, the communication component is used to transmit the closing instruction to the camera host, and the closing instruction is used to close the ultrasound image displayed on the interface of the endoscope display; And / or, the first operating component can be operated by a user to generate an opening instruction, the communication component is used to transmit the opening instruction to the camera host, and the opening instruction is used to start displaying the ultrasound image on the interface of the endoscope display.

5. The imaging system according to claim 1, wherein: The ultrasound host has a first communication interface, and the first communication interface is used to plug the first communication component; the camera host or the endoscope display has a second communication interface, and the second communication interface is used to plug the second communication component.

6. The imaging system according to claim 5, characterized in that The first communication component and the second communication component are WiHD communication components.

7. An ultrasonic imaging system, characterized in that: include: An ultrasonic probe comprises a shell and an array element group; the array element group is used to transmit ultrasonic waves and receive echo signals of the ultrasonic waves; the shell forms a gripping portion for a user to hold; An ultrasound host, the ultrasound host being used to generate an ultrasound image according to the echo signal; An ultrasound display, used for displaying the ultrasound image; A first communication component, wherein the first communication component is used to establish a communication connection with a second communication component of an endoscope system; the ultrasound host is also used to transmit the ultrasound image to the endoscope system through the first communication component, so that the endoscope system displays the endoscope image and the ultrasound image on an interface of its endoscope display.

8. The ultrasonic imaging system according to claim 7, wherein: The ultrasound probe also includes a first operating component arranged on the shell; the first operating component is used for user operation to generate display parameter instructions; the first communication component is used to transmit the display parameter instructions to the endoscope system to set the display parameters of the endoscope display; wherein the display parameter instructions are used to set the display ratio, display size and / or display position of the endoscopic image and the ultrasound image displayed on the interface of the endoscope display.

9. The ultrasonic imaging system according to claim 7, wherein: The ultrasound probe also includes a first operating component arranged on the shell; the first operating component is used for a user to operate to generate imaging parameter instructions and transmit them to the ultrasound host; wherein the imaging parameter instructions are used to set the imaging parameters of the ultrasound imaging system, and the imaging parameters include one or more of the following: one or more imaging modes, imaging sub-parameters corresponding to each imaging mode, and navigation function parameters.

10. The ultrasonic imaging system according to claim 7, wherein: The ultrasound probe has a first operating component; the first operating component can be operated by a user to generate a closing instruction, and the first communication component is used to transmit the closing instruction to the endoscope system, and the closing instruction is used to close the ultrasound image displayed on the interface of the endoscope display; And / or, the first operating component can be operated by a user to generate an activation instruction, the first communication component is used to transmit the activation instruction to the endoscope system, and the activation instruction is used to activate the display of the ultrasound image on the interface of the endoscope display.

11. The ultrasonic imaging system according to claim 7, wherein: The ultrasound probe has a first operating component, and the first operating component is used for a user to operate to generate an interactive menu; the interactive menu is used for the user to control ultrasound imaging through the first operating component, and / or the interactive menu is used for the user to set display parameters of the endoscope display through the first operating component; The ultrasound display displays the interactive menu, and / or the first communication component is used to transmit the interactive menu to the endoscope system so that the interactive menu is displayed on an interface of its endoscope display.

12. The ultrasonic imaging system according to claim 7, wherein: The ultrasound host has a first communication interface, and the first communication interface is used to plug in the first communication component.

13. The ultrasonic imaging system according to claim 7 or 12, characterized in that: The first communication component is a wifi communication component, a WHDI communication component or a WiHD communication component.

14. An endoscope system, characterized in that: It includes an endoscope, a light source, a camera host connected to the endoscope, an endoscope display and a second communication component; The light source is used to provide illumination to the part of the patient to be observed; The endoscope comprises an insertion portion and a handheld operation portion, wherein the insertion portion is used to be inserted into a patient to observe the part to be observed; the handheld operation portion is used for handheld operation by a user; the endoscope is provided with one or more image sensors, and the image sensors are used to collect endoscopic image signals of the part to be observed; The camera host is used to obtain the endoscopic image signal and generate an endoscopic image; The second communication component is used to establish a communication connection with the first communication component of the ultrasonic imaging system; the camera host is also used to receive an ultrasonic image from the ultrasonic imaging system through the second communication component; The camera host transmits the endoscopic image and the ultrasound image to the endoscopic display, and the endoscopic display displays the endoscopic image and the ultrasound image on an interface.

15. The endoscope system according to claim 14, characterized in that: The handheld operating part of the endoscope includes a second operating component; the second operating component is used for user operation to generate display parameter instructions; the display parameter instructions are used to set the display ratio, display size and / or display position of the endoscopic image and the ultrasound image displayed on the interface of the endoscope display.

16. The endoscope system according to claim 14, wherein: The handheld operating part of the endoscope includes a second operating component; the second operating component is used for user operation to generate imaging parameter instructions, and the second communication component is used to transmit the imaging parameter instructions to the ultrasound host; wherein the imaging parameter instructions are used to set the imaging parameters of the ultrasound imaging system, and the imaging parameters include one or more of the following: one or more imaging modes, imaging sub-parameters corresponding to each imaging mode, and navigation function parameters.

17. The endoscope system according to claim 14, wherein: The handheld operating part of the endoscope includes a second operating component; the second operating component can be operated by a user to generate a closing instruction, and the closing instruction is used to close the ultrasound image displayed on the interface of the endoscope display; And / or, the second operating component can be operated by a user to generate an opening instruction, and the opening instruction is used to start displaying the ultrasound image on the interface of the endoscope display.

18. The endoscope system according to claim 14, wherein: The second communication component is capable of receiving display parameter instructions transmitted by the ultrasound imaging system, wherein the display parameter instructions are generated by the user operating the first operating component of the ultrasound probe of the ultrasound imaging system; the display parameter instructions are used to set the display ratio, display size and / or display position of the endoscopic image and the ultrasound image displayed on the interface of the endoscope display.

19. The endoscope system according to claim 14, wherein: The second communication component is capable of receiving a closing instruction transmitted by the ultrasound imaging system, wherein the closing instruction is generated by a first operating component of the ultrasound probe of the ultrasound imaging system being operated by a user, and the closing instruction is used to close the ultrasound image displayed on the interface of the endoscope display; and / or, the second communication component is capable of receiving an opening instruction transmitted by the ultrasound imaging system, wherein the opening instruction is generated by a first operating component of the ultrasound probe of the ultrasound imaging system being operated by a user, and the opening instruction is used to open the display of the ultrasound image on the interface of the endoscope display.

20. The endoscope system according to claim 14, wherein: The camera host or the endoscope display has a second communication interface, and the second communication interface is used for plugging the second communication component.

21. The endoscope system according to claim 14 or 20, characterized in that: The second communication component is a wifi communication component, a WHDI communication component or a WiHD communication component.

Images