Method and system for expanding the functionality of ultrasound imaging equipment
By identifying and configuring the functions and modes of ultrasonic imaging devices, using communication interfaces and cloud processing, the problem of integrating new functions of existing devices is solved, and the function expansion of the device and the application scope is achieved, reducing costs and complexity.
Patent Information
- Application Number
- CN202210203574.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-03
- Publication Date
- 2024-12-31
- Estimated Expiration
- 2042-03-03
AI Technical Summary
Existing ultrasonic imaging devices have difficulty integrating new functions, resulting in limited application range of equipment, high cost and complex operation, and are unable to be compatible with probe interfaces and software systems of different manufacturers.
By identifying and comparing the functions of integrated imaging devices and hosts, configuring operating parameters and modes, using communication interfaces to transmit data, and performing signal and image processing in the cloud, multi-dimensional display of ultrasonic data is realized without modifying hardware circuits.
It realizes the expansion of functions on existing equipment, reduces development costs, improves flexibility and universality, simplifies maintenance and upgrade processes, and is suitable for a variety of ultrasonic imaging applications.
Smart Images

Figure CN114533119B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of ultrasonic imaging, and more particularly to a method for expanding the functions of ultrasonic imaging equipment and an ultrasonic imaging system with expandable functions. Background Art
[0002] Ultrasound applications for diagnostic purposes include structural imaging and functional imaging, which are used to visualize the anatomical structure of the object being tested and measure the physiological function of the object being tested, respectively. Traditional ultrasound imaging technology is widely used in medical practice and serves ultrasound examinations with some fixed classic functions. Due to fierce market competition and large capital investment, in order to gain a higher market share, equipment with traditional functions is mainly produced and dominated by large-scale manufacturers. From another perspective, the application areas of the ultrasound industry are relatively independent, and the functions configured depend on the manufacturer. Due to differences in technical barriers, intellectual property ownership, patent protection, talent reserves and development concepts, it is almost impossible to integrate ultrasound equipment produced by different manufacturers on the market.
[0003] However, with the renewal of concepts and technological advances, application- or disease-oriented ultrasound technology is booming and is constantly expanding the scope of the ultrasound industry. As a result, some start-ups and small businesses have occupied areas that traditional large ultrasound manufacturers cannot enter through innovative technologies. Specific examples include: liver fibrosis detection based on transient elasticity measurement, cerebrovascular detection based on transcranial ultrasound Doppler, scoliosis detection based on three-dimensional imaging, carotid artery sclerosis detection based on three-dimensional imaging, and fetal prenatal detection based on four-dimensional imaging. The above functions are mainly realized by independent, application-specific ultrasound systems.
[0004] Traditional ultrasound imaging systems usually consist of three parts: an ultrasound probe, a host, and a display unit. Generally, the probe includes a piezoelectric transducer for scanning the object being measured; the host includes a front-end hardware circuit and a computer for controlling and processing ultrasound data; and the display unit is used to interact with the user. Usually, a single system provides several standard probe interfaces for converting and configuring different probes. Specifically, the "probe" in a narrow sense is only used to transmit ultrasound and receive echo signals. The probe is configured on the ultrasound system to which it belongs based on the probe interface of the front-end hardware circuit, and is connected to the system to which it belongs through a cable to transmit data information. Each probe has a specific imaging purpose and is used to achieve specific functions. If a new probe is to be configured on an existing device, the traditional integration method has the disadvantages of high cost, large workload, complex technology, and difficult operation. At the hardware level, the integration work involves modifying the front-end circuit of the existing device and the probe interface based on the front-end hardware circuit; at the software level, the integration work requires obtaining source code and control rights. Therefore, the above-mentioned traditional configuration scheme has the following defects: First, each manufacturer may have different definitions of the interface line sequence of the probe, resulting in poor compatibility, resulting in the probe being constructed to work only on the system to which it belongs; second, when a new probe used to perform a specific function is configured on an existing device that does not support the application, the function may not be implemented. Specifically, at the software level, the existing device may not be able to display a specific user interface and lacks corresponding processing algorithms; at the hardware level, the existing device may lack circuits and communication interfaces for controlling various components in the probe; third, in order to configure a new probe, it is costly to modify the front-end hardware circuit and probe interface in the existing device.
[0005] It is expected that multiple new functions will be configured on existing equipment without adding additional costs. From the user's perspective, the new functions can meet more diagnostic needs and explore more ultrasound applications; from the perspective of large manufacturers, the new functions can increase the product competitiveness of existing equipment; from the perspective of developers focusing on specific applications, parasitizing the new functions on existing equipment can improve the accessibility and popularity of the functions, which is conducive to strengthening market penetration.
[0006] In summary, how to integrate specific ultrasound functions into traditional ultrasound imaging equipment that is originally incompatible with this function and expand the application scope of existing equipment is an urgent problem that practitioners in the ultrasound industry need to solve. Summary of the invention
[0007] The present invention provides a method for expanding the functions of an ultrasonic imaging device, comprising the following steps:
[0008] S1. Identify and compare the functions of the integrated imaging device and the ultrasound imaging device to be expanded;
[0009] S2. Based on the comparison result, configure the operating parameters and modes of the host machine of the integrated imaging device and the ultrasound imaging device to be expanded;
[0010] S3, communicating and connecting the integrated imaging device and the host machine;
[0011] S4. Operating the integrated imaging device on the user terminal of the host machine and displaying the ultrasound data generated by the integrated imaging device.
[0012] In the method for expanding the functions of an ultrasonic imaging device provided by the present invention, in step S1, the functions of the integrated imaging device and the ultrasonic imaging device to be expanded are identified based on the user's input to the integrated imaging device, based on the user's input to the host machine and / or based on the sensing information of at least one sensor.
[0013] In the method for expanding the functions of an ultrasonic imaging device provided by the present invention, in step S2, if the comparison result is that the functions of the integrated imaging device are incompatible with the functions supported by the ultrasonic imaging device to be expanded, the packaged executable program code is imported into the host machine to configure the host machine.
[0014] In the method for expanding the functions of an ultrasonic imaging device provided by the present invention, the ultrasonic data includes ultrasonic images, videos and measurement values after signal and / or image processing.
[0015] In the method for expanding the functions of an ultrasonic imaging device provided by the present invention, the integrated imaging device is connected to a universal interface of the host machine.
[0016] In the method for expanding the function of an ultrasonic imaging device provided by the present invention, step S4 comprises:
[0017] S41, transmitting the ultrasound data obtained by the integrated imaging device to the cloud server;
[0018] S42, performing signal processing, image processing, image reconstruction and / or multi-dimensional display on the ultrasound data on the cloud server;
[0019] S43: Transmit the processed ultrasound data to the user terminal for display.
[0020] In the method for expanding the function of an ultrasonic imaging device provided by the present invention, step S4 comprises:
[0021] S41', acquiring and processing ultrasound data through an integrated imaging device;
[0022] S42', transmitting the processed ultrasound data to the user terminal for display via the universal interface of the host machine.
[0023] The present invention also provides an ultrasonic imaging system with expandable functions, comprising an integrated imaging device and a host machine of the ultrasonic imaging device to be expanded.
[0024] The integrated imaging device comprises:
[0025] An imaging device, used to scan the object to be measured and process it to generate corresponding ultrasonic data;
[0026] The integrated imaging device communication interface is used to communicate with the host machine to achieve two-way data transmission between the integrated imaging device and the host machine;
[0027] an integrator, for identifying and comparing functions of the integrated imaging device and the host machine, and configuring operating parameters and modes of the integrated imaging device and the host machine based on the comparison results;
[0028] The host machine comprises:
[0029] A user terminal, used to operate the integrated imaging device and display the ultrasound data;
[0030] The host machine communication interface is used to communicate with the integrated imaging device to achieve two-way data transmission between the integrated imaging device and the host machine.
[0031] In the functionally expandable ultrasound imaging system provided by the present invention, the host machine communication interface is a universal interface of the host machine.
[0032] In the functionally expandable ultrasound imaging system provided by the present invention, the ultrasound data includes ultrasound images, videos and measurement values after signal and / or image processing.
[0033] In the functionally expandable ultrasound imaging system provided by the present invention, the integrator identifies the functions of the integrated imaging device and the host machine based on user input to the integrated imaging device, based on user input to the host machine and / or based on sensing information of at least one sensor.
[0034] In the functionally expandable ultrasound imaging system provided by the present invention, if the comparison result shows that the functions of the integrated imaging device are incompatible with the functions supported by the host machine, the integrator imports the packaged executable program code into the host machine to configure the host machine.
[0035] In the functionally expandable ultrasound imaging system provided by the present invention, the integrated imaging device is used for at least one of one-dimensional imaging applications, two-dimensional imaging applications, three-dimensional imaging applications, four-dimensional imaging, elastic imaging, elasticity measurement, viscoelastic imaging, blood flow imaging, acoustic attenuation imaging, and ultra-high-speed ultrasound imaging applications.
[0036] In the functionally expandable ultrasound imaging system provided by the present invention, the communication interface of the integrated imaging device and the communication interface of the host machine are wirelessly connected or wiredly connected.
[0037] In the functionally expandable ultrasound imaging system provided by the present invention, the integrated imaging device also includes at least one sensor for sensing the operating status information of the integrated imaging device, and promoting pairing and integration of the integrated imaging device and the host machine based on the operating status information.
[0038] In the functionally expandable ultrasonic imaging system provided by the present invention, the imaging device completes signal processing, image processing and image reconstruction of the image.
[0039] The functionally expandable ultrasound imaging system provided by the present invention also includes a cloud server for implementing at least one of signal processing, image processing, image reconstruction and multi-dimensional display.
[0040] In the functionally expandable ultrasound imaging system provided by the present invention, the cloud server is wirelessly connected to the integrated imaging device.
[0041] In the functionally expandable ultrasound imaging system provided by the present invention, the cloud server is wirelessly connected to the host machine.
[0042] In the functionally expandable ultrasound imaging system provided by the present invention, the integrated imaging device includes a user interface for receiving user input and / or implementing part of the functions of the user terminal in the host machine.
[0043] In the functionally expandable ultrasound imaging system provided by the present invention, the imaging device is an ultrasound imaging device, a device based on photoacoustic imaging, or a device based on thermoacoustic imaging.
[0044] The method for expanding the functions of ultrasonic imaging equipment and the ultrasonic imaging system with expandable functions implemented in the present invention can at least achieve the following beneficial effects: the present invention makes full use of the software and hardware resources of the existing ultrasonic imaging equipment, integrates the two based on the functions of the integrated imaging equipment and the host machine, and expands the functions of the existing equipment; there is no need to make any changes to the hardware of the host machine of the existing ultrasonic imaging equipment, only need to upgrade or slightly modify the software, so that the new function can be parasitized on the existing equipment, so that the traditional ultrasonic imaging equipment can derive new applications; thereby, the development cost can be greatly reduced, and it can be extended to most ultrasonic imaging fields, with the advantages of flexibility, low cost, high universality, easy maintenance, and easy upgrade. BRIEF DESCRIPTION OF THE DRAWINGS
[0045] In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art are briefly introduced below. Obviously, the drawings in the following description are only embodiments of the invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without creative work:
[0046] Figure 1 A schematic diagram of the principle of an ultrasound imaging system with expandable functions provided in Embodiment 1 of the present invention;
[0047] Figure 2 A schematic diagram of the three-dimensional structure of an ultrasonic imaging system with expandable functions provided in the first embodiment of the present invention;
[0048] Figure 3 is a schematic diagram of the three-dimensional structure of an ultrasonic imaging system with expandable functions provided in Embodiment 2 of the present invention;
[0049] Figure 4 is a schematic diagram of the principle of an ultrasound imaging system with expandable functions provided in Embodiment 3 of the present invention;
[0050] Figure 5 1 is a schematic diagram of the principle of an ultrasound imaging system with expandable functions provided in Embodiment 4 of the present invention;
[0051] Figure 6 1 is a schematic diagram of the principle of an ultrasound imaging system with expandable functions provided in Embodiment 5 of the present invention;
[0052] Figure 7 is a schematic diagram of the principle of an ultrasound imaging system with expandable functions provided in Embodiment 6 of the present invention;
[0053] Figure 8 is a schematic diagram of the principle of an ultrasound imaging system with expandable functions provided in Embodiment 7 of the present invention;
[0054] Fig. 9 is a schematic diagram of the principle of an ultrasound imaging system with expandable functions provided in Embodiment 8 of the present invention;
[0055] Fig.10 A flowchart of the steps of a method for expanding the functions of an ultrasonic imaging device provided in Embodiment 9 of the present invention. DETAILED DESCRIPTION
[0056] The inventive concept of the present invention is to use the universal computer interface and display unit in the existing equipment to integrate the application-specific integrated imaging device and the existing ultrasonic imaging device, build a compatible ultrasonic imaging system at the software level, and expand the functions of the existing equipment. The integrated imaging device has a complete set of hardware systems, and there is no need to use the existing equipment to participate in the realization of functions at the hardware level, including control scheduling and data processing. After integration, the integrated imaging device becomes one of the external devices of the computer in the existing equipment. The display unit in the existing equipment becomes one of the user terminals of the integrated imaging device. The further conception of the present invention is to use the universal computer interface and display unit in the existing equipment to integrate the integrated imaging device based on other imaging means such as photoacoustic imaging or thermoacoustic imaging and the existing ultrasonic imaging device, and build a compatible biomedical imaging system at the software level. Further, all or part of the work of the processing unit in the integrated imaging device or the computer in the existing device is handed over to the cloud server for execution, and the data is analyzed and processed in the cloud. This method does not require the participation of existing equipment in data processing.
[0057] Embodiment 1
[0058] Figure 1 Shown is a block diagram of a functionally expandable ultrasound imaging system.
[0059] See also Figure 1 , this embodiment provides an ultrasound imaging system with expandable functions. The system 100 includes an integrated imaging device 101 and a host machine 105. Those skilled in the art should know that the integrated imaging device 101 has a complete hardware system that can independently run the configured ultrasound imaging function, mainly including an ultrasound imaging device 102, an integrator 103 and an integrated imaging device communication interface 104; the host machine 105 is a part of the existing ultrasound imaging device, mainly including a user terminal 109 and a host machine communication interface 110. The integrator 103 identifies and compares the functions of the integrated imaging device 101 and the host machine 105, and configures the operating parameters and modes of the integrated imaging device and the host machine based on the comparison results. When the integration is completed, the ultrasound data scanned by the ultrasound imaging device 102 is transmitted to the user terminal for display through the integrated imaging device communication interface and the host machine communication interface, and the user can operate the integrated imaging device through the user terminal. As a result, in the system 100, the integrated imaging device 101 becomes one of the external devices of the computer in the host machine 105. At the same time, the user terminal 109 of the host machine 105 becomes one of the terminal devices of the integrated imaging device 101 .
[0060] In this embodiment, the ultrasonic imaging device 102 includes an ultrasonic transducer, a control unit, a processing unit, and a storage unit, and is used to perform ultrasonic scanning on the object to be measured and generate ultrasonic data of the object to be measured to carry out specific imaging applications. The ultrasonic imaging device 102 can generate a one-dimensional ultrasonic image (such as an A-type image and an M-type image), a two-dimensional ultrasonic image (such as a B-type image, a Doppler image, an elastic image), a three-dimensional ultrasonic image, or a four-dimensional ultrasonic image.
[0061] Specifically, the ultrasonic transducer is arranged by a single transducer array element in a point or by a plurality of transducer array elements in a linear array, a convex array or a two-dimensional matrix, and is used to transmit ultrasonic waves to the object under test and receive echo signals. Non-limiting transducer elements include piezoelectric elements, MEMS elements or other transducer elements. The control unit is used to coordinate the functions of each unit or component, and is used to execute instructions to control the operation of the probe. The processing unit is used to process ultrasonic data to construct an ultrasonic image, including an A-type image, an M-type image, a B-type image, a Doppler image, an elastic image, a three-dimensional image or a four-dimensional image. The storage unit is based on at least one of hardware or software, and contains executable program code for driving the integrated imaging device 101, and is used to cache and package data. The data is ultrasound-related data and / or other information, including but not limited to: imaging data, transducer configuration data, other sensor data, user databases from the host machine, and patient databases. It is worth noting that the processing unit and the storage unit can be built into the integrated imaging device 101. In another embodiment, the processing unit and the storage unit are not limited to the integrated imaging device 101, but may also be set in the host machine 105 (described below). The processing unit and the storage unit are at least a part of the host machine 105, and all or part of their functions are performed by the host machine 105. Those skilled in the art should know that the integrated imaging device 101 is based on the ultrasonic imaging device 102, and adopts other imaging means or sets other sensors and components to achieve specific functions. In a non-limiting manner, the integrated imaging device 101 is application-specific and is used to carry out at least one of one-dimensional imaging applications, two-dimensional imaging applications, three-dimensional imaging applications, and four-dimensional imaging, elastic imaging, elastic measurement, viscoelastic imaging, blood flow imaging, acoustic attenuation imaging, and ultra-high-speed ultrasonic imaging applications; it can be an instantaneous elastic measurement device based on low-frequency vibration (with elastic measurement function), an elastic measurement device based on ultrasonic indentation (with elastic measurement function), a shear wave elastic imaging device based on acoustic radiation force pulse (with elastic imaging and measurement function), a strain elastic imaging device based on quasi-static force (with elastic imaging and measurement function), a three-dimensional ultrasonic imaging device based on a spatial sensor (with three-dimensional imaging function), a transcranial ultrasonic Doppler device (with blood flow measurement function), an intravascular ultrasonic imaging device (with vascular imaging function), an ultrasonic endoscope device (with digestive tract imaging function), an ultrasonic tomography device (with tomography and three-dimensional imaging function), etc. It is worth noting that the present invention does not limit the shape, frequency, communication interface type, imaging mode, operation mode, application, and function of the integrated imaging device. The integrated imaging device in this embodiment can carry out any function and application known in the art.
[0062] In this embodiment, the integrator 103 is used to integrate the integrated imaging device 101 into the host machine 105 at the software level, without involving integration at the hardware circuit level, allowing the integrated imaging device 101 to be used with any host machine. It should be understood that if the integrator 103 is not working, the integrated imaging device 101 can only be used with the host machine 105 that supports the functions or applications of the integrated imaging device 101. The integrator 103 has the following functions: 1) identifying the functions of the integrated imaging device 101 and the functions supported / compatible with the host machine 105, and comparing them; 2) configuring the operating parameters and modes in the integrated imaging device 101 to meet the requirements of working on the host machine 105 based on the comparison results of the functions of the integrated imaging device 101 and the host machine 105; 3) based on the pairing results of the integrated imaging device 101 and the host machine 105, if the host machine 105 does not support / is not compatible with the functions of the integrated imaging device 101, then importing the packaged executable program code (including the front-end user interface code and the back-end processing algorithm) into the host machine 105 to configure the operating parameters and modes in the host machine 105 to meet the requirements of working on the integrated imaging device 101, thereby realizing the integration of the integrated imaging device 101 and the host machine 105 at the software level. The application modes include but are not limited to: one-dimensional application, two-dimensional application, three-dimensional application and four-dimensional application, etc.; the operation modes include but are not limited to: ultrasound angiography mode, elasticity measurement mode, elasticity imaging mode, viscoelasticity imaging mode, acoustic attenuation imaging, ultra-high-speed ultrasound imaging, blood flow measurement mode, vascular imaging mode, digestive tract imaging mode, spine three-dimensional reconstruction mode, muscle three-dimensional reconstruction mode, vascular reconstruction mode. The specific mode depends on the functions and applications supported by the integrated imaging device, and the present invention does not limit this.
[0063] In this embodiment, the integrated imaging device communication interface 104 is constructed on the integrated imaging device 101, and is used to communicate with the host machine 105 to achieve two-way data transmission between the integrated imaging device 101 and the host machine 105. The communication connection mode includes wireless connection and wired connection. Wired communication protocols include but are not limited to: Universal Serial Bus (USB), Serial Peripheral Interface (SPI), Thunderbolt, PCIe, Integrated Circuit Bus (I2C). Wireless communication protocols include but are not limited to: WiFi, Bluetooth, Ultra Wideband (UWB), ZigBee, Radio Frequency Identification (RFID), Near Field Communication (NFC), 4G technology or 5G technology, etc. Those skilled in the art should know that the integrated imaging device communication interface 104 is constructed to have a single or multiple communication interfaces for communication connection with a host machine 105 that supports different communication protocols and interface types.
[0064] In this embodiment, the host machine 105 includes a user terminal 109 and a host machine communication interface 110. The user terminal 109 is at least a part of the host machine 105 that has been configured with a computer, and is used to display ultrasound images, display ultrasound-related data, control the operation of the integrated imaging device, manage databases, and post-process data. Specifically, the user terminal 109 includes a display unit 111, a patient database 112, a user database 113, and a computer 114. First, in terms of the display function, the user terminal 109 is only used to display ultrasound data in picture and / or video format, but has nothing to do with data processing. The user terminal 109 uses the existing display unit 111 on the host machine as a terminal platform for interacting with the user, and does not require any changes to the host machine at the hardware level. It is a part of the firmware of the computer in the host machine. The display unit 111 can be an external display device or a cathode ray tube display or liquid crystal screen embedded in the ultrasound imaging device, which is used to display the ultrasound image, measurement results, and / or ultrasound data obtained by the integrated imaging device. The display format depends on the existing settings of the host machine. Second, in terms of the operation control function, when the integrated imaging device 101 is integrated into the host machine 105 at the software level, the user terminal 109 is used to carry the packaged executable program code (including the front-end user interface code and the back-end processing algorithm). It is worth noting that the user interface and the processing algorithm are constructed to be compatible with the host machine 105. The form of user interaction depends on the existing settings of the host machine. Third, in terms of data management, the user can access the patient database 112 and the user database 113 of the integrated imaging device 101 under the current application. Fourth, in terms of data processing functions, the computer 114 in the host machine stores various algorithms for completing all or part of the work of the processing unit 106 in the integrated imaging device 101. This method can save the resources and computing power of the integrated imaging device 101. Optionally, the user terminal 109 participates in signal processing, image processing, image reconstruction or multi-dimensional display, which can be applicable to the following three situations: 1) complete processing of unprocessed data of the integrated imaging device 101; 2) further processing of pre-processed data of the integrated imaging device 101; 3) post-processing of processed data of the integrated imaging device 101.
[0065] In the present embodiment, the host communication interface 110 is at least a part of the host 105 that has been configured with a computer, and is a general computer interface in the host 105. The host communication interface 110 is constructed on the computer of the host 105, and is used to communicate with the integrated imaging device 101 to achieve two-way data transmission between the integrated imaging device 101 and the host 105. It is worth noting that the successful pairing of the integrated imaging device 101 and the host 105 depends on the interface type of the existing host communication interface 110. Preferably, the host communication interface 110 is existing and does not require any changes to the host, and is a part of the firmware of the computer in the host. In another embodiment, if the integrated imaging device communication interface 104 and the host communication interface 110 are incompatible in physical structure, it is only necessary to configure a suitable adapter for the host communication interface 110, and a communication connection can be established by making minor changes at the hardware level. For example, when the host machine communication interface 110 only supports the USB communication protocol, configuring a USB-WiFi adapter on the USB interface may enable the host machine to achieve a pairing connection with an integrated imaging device that supports the WiFi communication protocol.
[0066] Figure 2 It is a schematic diagram of the three-dimensional structure of a system based on a wired communication protocol provided in the first embodiment of the present invention.
[0067] like Figure 2 As shown, a pluggable cable connection 201 is used between the integrated imaging device communication interface 104 and the host computer communication interface 110. Data is transmitted between the integrated imaging device 101 and the host computer 105 via a wired communication protocol. The wired communication protocol includes, but is not limited to: Universal Serial Bus (USB), Serial Peripheral Interface (SPI), Thunderbolt, PCIe, and Integrated Circuit Bus (I2C). As a result, the integrated imaging device is integrated into the existing ultrasound imaging device at the software level and becomes its sub-function so that it can be used with existing devices that are originally incompatible or do not support specific applications.
[0068] Embodiment 2
[0069] Figure 3 It is a three-dimensional structural diagram of a system based on a wireless communication protocol provided in the second embodiment of the present invention.
[0070] The difference between the system provided in this embodiment and the first embodiment is that: Figure 3As shown, a wireless connection 301 is used between the integrated imaging device communication interface 104 and the host machine communication interface 110. In this embodiment, data is transmitted between the integrated imaging device 101 and the host machine 105 via a wireless communication protocol. Wireless communication protocols include, but are not limited to: WiFi, Bluetooth, ultra-wideband (UWB), ZigBee, radio frequency identification (RFID), near field communication (NFC), 4G technology or 5G technology, etc. As a result, the integrated imaging device is integrated into the existing ultrasound imaging device at the software level and becomes its sub-function so that it can be used with existing devices that are originally incompatible or do not support specific applications.
[0071] Embodiment 3
[0072] Figure 4 The figure is a block diagram of a functionally expandable ultrasound imaging system provided in the third embodiment.
[0073] The difference between the system provided in this embodiment and the first embodiment is that: further, the integrated imaging device 101 also includes a power supply unit 401. The power supply unit 401 contains a battery and related circuits, which is used to independently supply power to the integrated imaging device 101. The charging method can be wireless charging or wired charging. In this embodiment, the integrated imaging device 101 does not need to rely on the host machine 105 to provide power, which is particularly suitable for wireless connection.
[0074] Embodiment 4
[0075] Figure 5 The figure is a block diagram of a functionally expandable ultrasound imaging system provided in Embodiment 4.
[0076] The difference between the system provided in this embodiment and the first embodiment is that: further, the integrated imaging device 101 also includes a user interface 501. The user interface 501 is a hardware device, which is physically set at any position of the integrated imaging device 101, and is used to receive instructions input by the user at the integrated imaging device end, and promote the pairing and integration of the integrated imaging device 101 and the host machine 105 based on the instruction content. The instructions include but are not limited to: selection of operation mode, selection of application mode, adjustment of image parameters, etc. The user input method includes but is not limited to: audio input, manual input by keys, manual input by touch pad, and manual input by touch screen. In another embodiment, the user interface 501 is used to implement some functions of the user terminal in the host machine, including displaying ultrasound images (the user interface 501 is used to complete part of the work of the display unit 111), displaying ultrasound-related data (the user interface 501 is used to complete part of the work of the display unit 111), controlling the operation of the integrated imaging device (the user interface 501 is used to complete part of the work of the display unit 111 and the computer 114) and managing the database (the user interface 501 is used to complete part of the work of the patient database 112 and / or the user database 113).
[0077] Embodiment 5
[0078] Figure 6 The figure is a block diagram of a functionally expandable ultrasound imaging system provided in the fifth embodiment.
[0079] The difference between the system provided in this embodiment and the first embodiment is that: further, the integrated imaging device 101 further includes a sensor 601. The sensor 601 can be at least one of a temperature sensor, a force sensor, a motion sensor, a three-dimensional space sensor or a camera, and is used to sense the operation status information of the integrated imaging device 101, and promote the pairing and integration of the integrated imaging device 101 and the host machine 105 based on the operation status information. For example, if the integrated imaging device 101 has a three-dimensional imaging or four-dimensional imaging application, the host machine 105 can analyze and predict the application mode of the integrated imaging device 101 to be connected according to the data changes and operation information obtained by the three-dimensional space sensor 601; if the integrated imaging device 101 has a blood flow imaging application, the host machine 105 can analyze and predict the application mode of the integrated imaging device 101 to be connected according to the data changes and operation information obtained by the motion sensor or force sensor 601; if the integrated imaging device 101 has a breast or liver elastic imaging application, the host machine 105 can analyze and predict the application mode of the integrated imaging device 101 to be connected according to the ultrasound image features obtained by the integrated imaging device 101 combined with the operation information obtained by the force sensor 601. The operation status information sensed by the sensor can further promote the integration of the integrated imaging device and the host machine, thereby improving the pairing efficiency.
[0080] Embodiment 6
[0081] Figure 7 The figure is a block diagram of a functionally expandable ultrasound imaging system provided in Example 6.
[0082] The difference between the system provided in this embodiment and the first embodiment is that the integrated imaging device 101 is not based on ultrasound imaging or the integrated imaging device 101 is not an application-specific ultrasound integrated imaging device, but is based on other biomedical imaging methods such as photoacoustic imaging or thermoacoustic imaging. The integrated imaging device 101 based on photoacoustic imaging includes a photoacoustic imaging device 701, which is used to irradiate the object under test with a pulsed laser, and then collect the ultrasound signal generated by the tissue due to light excitation to generate a photoacoustic image. In another embodiment, the integrated imaging device 101 based on thermoacoustic imaging is used to irradiate the object under test with a radio frequency pulsed laser, and then collect the ultrasound signal generated by the tissue due to light excitation to generate a thermoacoustic image. Biomedical imaging methods based on photoacoustic imaging or thermoacoustic imaging are developing rapidly. The present invention can integrate photoacoustic imaging and thermoacoustic imaging into an existing host machine through an integrated imaging device based on photoacoustic imaging or an integrated imaging device based on thermoacoustic imaging, thereby expanding the scope of use of photoacoustic imaging and thermoacoustic imaging.
[0083] Embodiment 7
[0084] Figure 8 The figure is a block diagram of a functionally expandable ultrasound imaging system provided in Embodiment 7.
[0085] The difference between the system provided in this embodiment and the first embodiment is that: further, the system 100 further includes a cloud server 801. The cloud server 801 is used to implement all or part of the functions of the user terminal 109 of the host machine 105 on the cloud. The cloud server 801 is directly wirelessly connected to the host machine 105.
[0086] Those skilled in the art should know that the system 100 is connected to the cloud server 801 through the host machine 105 in a wired or wireless transmission mode and performs data exchange. Specifically, the system 100 uploads the relevant data obtained by the integrated imaging device 101 to the cloud server 801 and similar processing modules through the user terminal 109; the cloud server 801 performs cloud computing on the data to analyze and process. After analysis, calculation and processing in the cloud, the processed relevant data is transmitted back to the user terminal 109 for display.
[0087] It is worth noting that the cloud server 801 stores various algorithms and has data processing functions for realizing signal processing, image processing, image reconstruction or multi-dimensional display, and can be applied to the following three situations: 1) complete processing of data that has not been processed by the local system 100; 1) further processing of data that has been pre-processed by the local system 100; 2) post-processing of data that has been processed by the local system 100. Preferably, a big data workstation can also be built on the cloud server to participate in data storage, management, retrospective analysis and sharing.
[0088] Embodiment 8
[0089] Fig. 9 The figure is a block diagram of a functionally expandable ultrasound imaging system provided in Embodiment 8.
[0090] The difference between the system provided in this embodiment and the eighth embodiment is that the cloud server 801 is directly wirelessly connected to the integrated imaging device 101 instead of through the host machine.
[0091] Those skilled in the art should know that the system 100 is connected to the cloud server 801 by wired or wireless transmission through the integrated imaging device 101, and data is exchanged. Specifically, the integrated imaging device 101 uploads the obtained relevant data to the cloud server 801 and similar processing modules; the cloud server 801 performs cloud computing on the data for analysis and processing. After analysis, calculation and processing in the cloud, the processed relevant data is transmitted back to the integrated imaging device, and then transmitted to the user terminal of the host machine through the communication interface of the integrated imaging device for display.
[0092] The cloud server 801 is used to exchange information with the integrated imaging device. This method does not require the host machine to participate in data processing and has the following advantages: 1) saving local system resources and computing power; 2) promoting the miniaturization, integration and portability of the hardware of the integrated imaging device; 3) facilitating data management; 4) facilitating the updating, optimization and execution of more advanced artificial intelligence related algorithms.
[0093] Embodiment 9
[0094] like Fig.10 As shown, a method for expanding the function of an ultrasonic imaging device provided in Embodiment 9 includes the following steps:
[0095] S1. Identify and compare the functions of the integrated imaging device and the ultrasound imaging device to be expanded;
[0096] Specifically, the method of identifying the functions of the integrated imaging device and the ultrasound imaging device to be expanded includes: based on the user's input to the integrated imaging device, based on the user's input to the host machine of the ultrasound imaging device to be expanded, and / or based on the sensing information of at least one sensor. The integrated imaging device has a complete hardware system, and can be an integrated imaging device dedicated to the application of ultrasound imaging, or an integrated imaging device based on other biomedical imaging such as photoacoustic imaging or thermoacoustic imaging.
[0097] S2. Based on the comparison result, configure the operating parameters and modes of the host machines of the integrated imaging device and the ultrasound imaging device to be expanded;
[0098] Specifically, if the comparison result is that the function of the integrated imaging device is incompatible with the function supported by the host machine, the packaged executable program code is imported into the host machine to configure the host machine and start the integration work. If the comparison result is that the function of the integrated imaging device is compatible with the function supported by the host machine, it means that the host machine has been configured with the executable program code dedicated to the integrated imaging device. Based on the comparison result of the functions of the integrated imaging device 101 and the host machine 105, the selected operation mode, the selected application mode or the user input, the operating parameters and modes of the integrated imaging device and the host machine are configured, including but not limited to the communication interface type, imaging parameters, measurement parameters, imaging mode, operation mode, application and function.
[0099] The configuration process includes: identifying the type of the integrated imaging device communication interface of the integrated imaging device and / or the supported communication protocol, identifying the type of the host communication interface of the host and / or the supported communication protocol, setting the integrated imaging device to a waiting state, importing packaged executable program code into the host for operating the integrated imaging device (if necessary), and setting the host to a waiting state.
[0100] S3, based on the integrated imaging device communication interface of the integrated imaging device and the host communication interface of the host, communicating and connecting the integrated imaging device and the paired host;
[0101] Specifically, the integrated imaging device communication interface and the host machine communication interface are respectively constructed on the integrated imaging device and the host machine, and are used to complete the communication connection between the integrated imaging device and the host machine, and realize two-way data transmission. The communication connection mode includes wireless connection and wired connection. Among them, the host machine communication interface is at least a part of the host machine that has been configured with a computer, and belongs to a general computer interface in the host machine.
[0102] S4. Operating the integrated imaging device on the user terminal of the host machine and displaying ultrasound data generated by the integrated imaging device.
[0103] Specifically, when the communication connection is established, the integrated imaging device becomes an external device of the computer in the host machine. At the same time, the user terminal of the host machine becomes a terminal device of the integrated imaging device, which is used to display ultrasound images, display ultrasound-related data, control the operation of the integrated imaging device, manage the database, and post-process data.
[0104] In one embodiment of the present invention, the integrated imaging device completes all processing of the ultrasound data, and the processed ultrasound data is transmitted to the user terminal through the universal interface of the host machine for display. Therefore, step S4 includes:
[0105] S41', acquiring and processing ultrasound data through an integrated imaging device;
[0106] S42', transmitting the processed ultrasound data to the user terminal for display via the universal interface of the host machine.
[0107] Furthermore, the method for expanding the functions of an ultrasonic imaging device provided by the present invention can also use a cloud server to analyze and process data, and complete all or part of the data processing work in the cloud. Therefore, in another embodiment of the present invention, step S4 includes:
[0108] S41, transmitting the ultrasound data obtained by the integrated imaging device to a cloud server;
[0109] S42, performing signal processing, image processing, image reconstruction and / or multi-dimensional display on the cloud server based on the integrated imaging device for ultrasound-related data;
[0110] S43: Transmit the processed ultrasound data to the user terminal for display.
[0111] The present invention has been described above with the aid of functional modules that illustrate certain important functions. For ease of description, the boundaries of these functional component modules are specifically defined herein. When these important functions are properly implemented, changes in their boundaries are permitted. Similarly, flow chart modules are also specifically defined herein to illustrate certain important functions, and for wide application, the boundaries and order of the flow chart modules may be additionally defined as long as these important functions can still be implemented. Changes in the boundaries and order of the above-mentioned functional modules, flow chart functional modules, and should still be considered to be within the scope of the claims.
[0112] The invention may also be implemented by means of a computer program product, which contains all the features enabling the implementation of the method of the invention and which, when installed in a computer system, implements the method of the invention. A computer program in this document refers to any expression of a set of instructions, which may be written in any programming language, code or notation, and which enables a system to have information processing capabilities to implement a specific function directly or after one or both of the following steps: a) conversion into another language, code or notation; b) reproduction in a different format.
[0113] Although the present invention is described by specific embodiments, it should be understood by those skilled in the art that various changes and equivalent substitutions may be made to the present invention without departing from the scope of the present invention. In addition, various modifications may be made to the present invention for specific situations or materials without departing from the scope of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed, but should include all implementation methods falling within the scope of the claims of the present invention.
[0114] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.
Claims
1. A method for expanding the function of an ultrasonic imaging device, characterized in that: The following steps are involved: S1. Identify and compare functions of the integrated imaging device and the ultrasound imaging device to be expanded, wherein the integrated imaging device includes an imaging device, and the imaging device includes an ultrasound transducer, a processing unit, and a control unit; identify the functions of the integrated imaging device and the ultrasound imaging device to be expanded based on user input to the integrated imaging device, based on user input to the host machine, and / or based on sensor information of at least one sensor; S2. Based on the comparison result, configure the operating parameters and modes of the host machines of the integrated imaging device and the ultrasonic imaging device to be expanded. If the comparison result shows that the functions of the integrated imaging device are incompatible with the functions supported by the ultrasonic imaging device to be expanded, import the packaged executable program code into the host machine to configure the host machine; S3, communicating and connecting the integrated imaging device and the host computer, wherein the integrated imaging device is connected to a universal computer interface of the host computer; S4. Operating the integrated imaging device on the user terminal of the host machine and displaying the ultrasound data generated by the integrated imaging device.
2. The method for expanding the function of ultrasonic imaging equipment according to claim 1, characterized in that: The ultrasound data includes ultrasound images, videos and measurement values after signal and / or image processing.
3. The method for expanding the function of ultrasonic imaging equipment according to claim 1, characterized in that: The step S4 comprises: S41, transmitting the ultrasound data obtained by the integrated imaging device to the cloud server; S42, performing signal processing, image processing, image reconstruction and / or multi-dimensional display on the ultrasound data on the cloud server; S43: Transmit the processed ultrasound data to the user terminal for display.
4. The method for expanding the function of ultrasonic imaging equipment according to claim 1, characterized in that: The step S4 comprises: S41', acquiring and processing ultrasound data through an integrated imaging device; S42', transmitting the processed ultrasound data to the user terminal for display via the universal interface of the host machine.
5. A functionally expandable ultrasound imaging system, characterized in that: Including the host machine of the integrated imaging device and the ultrasound imaging device to be expanded, The integrated imaging device comprises: An imaging device, used to scan the object to be measured and process it to generate corresponding ultrasonic data, the imaging device comprising an ultrasonic transducer, a processing unit and a control unit; The integrated imaging device communication interface is used to communicate with the host machine to achieve two-way data transmission between the integrated imaging device and the host machine; an integrator, configured to identify and compare the functions of the integrated imaging device and the host machine, and configure the operating parameters and modes of the integrated imaging device and the host machine based on the comparison result; the integrator identifies the functions of the integrated imaging device and the host machine based on the user input to the integrated imaging device, based on the user input to the host machine, and / or based on the sensing information of at least one sensor; if the comparison result shows that the function of the integrated imaging device is incompatible with the function supported by the host machine, the integrator imports the packaged executable program code into the host machine to configure the host machine; The host machine comprises: A user terminal, used to operate the integrated imaging device and display the ultrasound data; The host machine communication interface is used to communicate with the integrated imaging device to realize two-way data transmission between the integrated imaging device and the host machine. The host machine communication interface is a universal computer interface of the host machine; the integrated imaging device communication interface and the host machine communication interface are wirelessly connected or wiredly connected.
6. The functionally expandable ultrasound imaging system according to claim 5, characterized in that: The ultrasound data includes ultrasound images, videos and measurement values after signal and / or image processing.
7. The functionally expandable ultrasound imaging system according to claim 5, characterized in that: The integrated imaging device is used for at least one of one-dimensional imaging applications, two-dimensional imaging applications, three-dimensional imaging applications, four-dimensional imaging, elastic imaging, elasticity measurement, viscoelastic imaging, blood flow imaging, acoustic attenuation imaging, and ultra-high-speed ultrasound imaging applications.
8. The functionally expandable ultrasound imaging system according to claim 5, characterized in that: The integrated imaging device further includes at least one sensor for sensing operation status information of the integrated imaging device and promoting pairing and integration of the integrated imaging device and the host machine based on the operation status information.
9. The functionally expandable ultrasound imaging system according to claim 5, characterized in that: The imaging device completes signal processing, image processing and image reconstruction.
10. The functionally expandable ultrasound imaging system according to claim 5, characterized in that: It also includes a cloud server for implementing at least one of signal processing, image processing, image reconstruction and multi-dimensional display.
11. The functionally expandable ultrasound imaging system according to claim 10, characterized in that: The cloud server is wirelessly connected to the integrated imaging device.
12. The functionally expandable ultrasound imaging system according to claim 10, characterized in that: The cloud server is wirelessly connected to the host machine.
13. The functionally expandable ultrasound imaging system according to claim 5, characterized in that: The integrated imaging device comprises a user interface for receiving user input and / or implementing part of the functions of the user terminal in the host machine.
14. The functionally expandable ultrasound imaging system according to claim 5, characterized in that: The imaging device is an ultrasonic imaging device, a device based on photoacoustic imaging, or a device based on thermoacoustic imaging.
15. The functionally expandable ultrasound imaging system according to claim 5, characterized in that: The integrated imaging device also includes a power supply unit.