Method and system for data transfer for ultrasound acquisition
By employing a dual-band transmission mechanism, the latency and power consumption issues of wireless ultrasound probes when transmitting large amounts of data are resolved, enabling real-time low-resolution image display and high-resolution image generation, thereby improving the efficiency and operability of ultrasound examinations.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- GE PRECISION HEALTHCARE LLC
- Filing Date
- 2023-02-15
- Publication Date
- 2026-06-02
AI Technical Summary
Wireless ultrasound probes suffer from increased latency and power consumption when transmitting large amounts of data, making it difficult to achieve real-time image display and high-quality image synchronization.
A dual-band transmission mechanism is adopted, in which a smaller dataset is transmitted through a lower bandwidth band for real-time display of low-resolution images, and a larger dataset is transmitted through a higher bandwidth band for generating high-resolution images. Untransmitted data is also buffered within the probe to reduce power consumption.
This technology reduces power consumption in wireless ultrasound probes while increasing examination throughput, ensuring operators receive real-time guided images and generate high-quality diagnostic images later.
Smart Images

Figure CN116636875B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the subject matter disclosed herein relate to ultrasound imaging, and more specifically, to the wireless transmission of data between an ultrasound probe and a computing device. Background Technology
[0002] Medical ultrasound is an imaging modality that uses ultrasound waves to probe the internal structures of a patient's body and generate corresponding images. For example, an ultrasound probe, comprising multiple transducer elements, emits ultrasound pulses that are reflected, refracted, or absorbed by structures within the body. The ultrasound probe then receives the reflected echoes, which are processed into images. Ultrasound images of internal structures can be saved for later analysis by clinicians to aid in diagnosis and / or displayed in real-time or near real-time on a display device.
[0003] In some examples, the ultrasound probe may be a wireless probe that communicates with a hub via wireless communication technology. For example, the hub may include electronic components for processing data received from the ultrasound probe to generate ultrasound images. For example, the wireless ultrasound probe may be powered by an internal rechargeable battery. Summary of the Invention
[0004] In one aspect, a method includes: receiving an ultrasound signal of a region of interest using a wireless handheld probe assembly; generating a plurality of received digital signals based on the received ultrasound signals within the wireless handheld probe assembly; generating a larger dataset and each of a smaller dataset based on the plurality of received digital signals; transmitting the smaller dataset from the wireless handheld probe assembly to a hub via a low-bandwidth wireless connection; transmitting the larger dataset from the wireless handheld probe assembly to the hub via a higher-bandwidth wireless connection; generating a low-resolution image based on the smaller dataset and a high-resolution image based on the larger dataset at the hub; and transmitting the low-resolution image from the hub to a first display and the high-resolution image from the hub to an electronic device.
[0005] It should be understood that the above brief description is provided to introduce selected concepts further described in the detailed embodiments in a simplified form. This is not intended to identify key or essential features of the claimed subject matter, the scope of which is uniquely defined by the claims following the detailed embodiments. Furthermore, the claimed subject matter is not limited to embodiments that address any shortcomings mentioned above or in any part of this disclosure. Attached Figure Description
[0006] A better understanding of the various aspects of this disclosure can be achieved by reading the following detailed description and referring to the accompanying drawings, in which:
[0007] Figure 1A block diagram of an exemplary embodiment of an ultrasound system is shown;
[0008] Figure 2 This is a schematic diagram illustrating a first exemplary system for generating ultrasound images via a wireless ultrasound probe according to an exemplary embodiment;
[0009] Figure 3 This is a schematic diagram illustrating a second exemplary system for generating ultrasound images via a wireless ultrasound probe according to an exemplary embodiment;
[0010] Figure 4 This is a flowchart illustrating a first exemplary method for performing ultrasound imaging using a wireless handheld probe according to an exemplary embodiment;
[0011] Figure 5 This is a flowchart illustrating a second exemplary method for performing ultrasound imaging using a wireless handheld probe according to an exemplary embodiment; and
[0012] Figures 6A to 6B An exemplary transmission line pattern and the resulting ultrasound image are shown according to the implementation scheme. Detailed Implementation
[0013] Now, we will use examples to refer to... Figures 1 to 6B To describe the implementation scheme of this disclosure, Figures 1 to 6B This relates to various implementation schemes for ultrasound imaging. Medical ultrasound imaging typically involves placing an ultrasound probe, including one or more transducer elements, onto an imaging subject (such as a patient) at the location of a target anatomical feature (e.g., abdomen, chest, etc.). During an ultrasound examination, images are acquired by the ultrasound probe and displayed on a display device in real-time or near real-time (e.g., images are displayed as soon as they are generated without intentional delay). The operator of the ultrasound probe (e.g., an ultrasound technician) can review the images for guidance and adjust various acquisition parameters and / or positions of the ultrasound probe to obtain high-quality images of the target anatomical feature (e.g., heart, liver, kidney, or another anatomical feature). However, higher-quality diagnostic images can include larger amounts of data compared to lower-quality images. In the case of wireless ultrasound probes, transmitting large amounts of data can lead to longer latency times. Therefore, the operator may experience delays in receiving high-quality images, resulting in delays in adjusting the ultrasound probe and making it difficult to perform an ultrasound examination. Furthermore, acquiring and transmitting large amounts of data can result in higher power consumption at the wireless ultrasound probe.
[0014] Therefore, according to the implementation scheme described herein, ultrasound data can be acquired by an ultrasound imaging system, such as... Figure 1 The ultrasound imaging system shown may include a wireless ultrasound probe that forms a virtual network with a hub, such as... Figure 2This is shown schematically. Alternatively, a hubless network, such as... Figure 3 As illustrated schematically, a wireless ultrasound probe can utilize network slicing to simultaneously transmit data to a hub (such as according to...) via two different frequency bands. Figure 4 (method) or transmit to two different electronic devices (such as according to Figure 5 (Methods). For example, a wireless ultrasound probe may transmit a first smaller dataset (e.g., a partial dataset) to a hub (or a first electronic device) via a first frequency band with a higher transmission speed and lower bandwidth, and a second larger dataset (e.g., a full dataset) to a hub (or a second electronic device) via a second frequency band with a lower transmission speed and higher bandwidth. The smaller image dataset can be used to generate lower-quality images to be displayed to the operator in real time, thereby providing real-time guidance to the operator. Figure 6B The example shown is a smaller image dataset and lower quality images. Larger image datasets can be used to generate higher quality images that can be used for diagnostic purposes. Figure 6A The diagram illustrates an example of a large image dataset and high-quality images. Because high-quality images can be viewed after the ultrasound examination, a lower transmission speed does not affect ultrasound data acquisition. Furthermore, when a high-bandwidth wireless connection is unavailable, the wireless ultrasound probe can continue transmitting a portion of the dataset while storing the entire dataset in a buffer.
[0015] In practice, some implementations of the aforementioned system and technology offer the advantage of reduced probe power consumption while increasing examination throughput. For example, a single full dataset can be acquired by the ultrasound probe, but only a portion of the acquired data (e.g., partial data) can be transmitted in real time via a lower frequency band. This reduces the latency between data acquisition and displaying the image to the operator. Furthermore, transmitting a partial dataset via a lower frequency band reduces probe power consumption. In this way, data can be transmitted more efficiently from the wireless ultrasound probe.
[0016] See Figure 1 A schematic diagram of an ultrasound imaging system 100 according to an embodiment of the present disclosure is shown. The ultrasound imaging system 100 includes a transmit beamformer 101 and a transmitter 102 that drives elements (e.g., transducer elements) 104 within a transducer array (referred to herein as probe 106) to transmit pulsed ultrasound signals (referred to herein as transmit pulses) to a region of interest on a patient or subject's body (not shown). According to one embodiment, probe 106 may be a one-dimensional transducer array probe. However, in some embodiments, probe 106 may be a two-dimensional matrix transducer array probe. According to embodiments herein, probe 106 may be a wireless probe, such as... Figure 2As described below, transducer element 104 can be made of a piezoelectric material. When a voltage is applied to the piezoelectric crystal, the crystal physically expands and contracts, thereby emitting ultrasonic spherical waves. As another example, transducer element 104 can be a capacitive micromechanical ultrasonic transducer (CMUT), which converts energy due to changes in capacitance between the CMUT electrodes. In this way, transducer element 104 can convert an electronic emission signal into an acoustic emission beam.
[0017] After element 104 of probe 106 transmits a pulsed ultrasound signal into the patient's body, the pulsed ultrasound signal is backscattered from internal structures (such as blood cells or muscle tissue) to generate an ultrasound signal echo returning to element 104. The echo is converted into an electrical signal or ultrasound data by element 104, and the electrical signal is received by receiver 108. The electrical signal representing the received echo passes through receiver beamformer 110, which outputs ultrasound data. For example, the ultrasound data may include a beamformed ultrasound image. Additionally, transducer element 104 may generate one or more ultrasound pulses based on the received echo to form one or more transmit beams. The electrical signal may also be referred to herein as a digital signal.
[0018] According to some embodiments, probe 106 may include electronic circuitry to perform all or part of transmit beamforming and / or receive beamforming. For example, all or part of transmit beamformer 101, transmitter 102, receiver 108, and receive beamformer 110 may be located within probe 106. In this disclosure, the terms “scanning” or “under scanning” may also be used to refer to the process of acquiring data by transmitting and receiving ultrasound signals. In this disclosure, the term “data” may be used to refer to one or more datasets acquired using an ultrasound imaging system. User interface 115 may be used to control the operation of ultrasound imaging system 100, including for controlling the input of patient data (e.g., patient history), for changing scan or display parameters, for initiating probe repolarization sequences, etc. User interface 115 may include one or more of the following: a rotary element, a mouse, a keyboard, a trackball, hard keys linked to specific actions, soft keys configurable to control different functions, and a graphical user interface displayed on display device 118.
[0019] The ultrasound imaging system 100 also includes a processor 116 for controlling the transmitting beamformer 101, the transmitter 102, the receiver 108, and the receiving beamformer 110. The processor 116 communicates electronically (e.g., is communicatively connected) with the probe 106. For the purposes of this disclosure, the term "electronic communication" may be defined to include both wired and wireless communication. The processor 116 can control the probe 106 to acquire data according to instructions stored in the processor's memory and / or memory 120. The processor 116 controls which of the elements 104 are active and the shape of the beam emitted from the probe 106. The processor 116 also communicates electronically with a display device 118, and the processor 116 can process data (e.g., ultrasound data) into images for display on the display device 118. The processor 116 may include a central processing unit (CPU) according to one embodiment. According to other embodiments, the processor 116 may include other electronic components capable of performing processing functions, such as a digital signal processor, a field-programmable gate array (FPGA), or a graphics board. According to other embodiments, processor 116 may include multiple electronic components capable of performing processing functions. For example, processor 116 may include two or more electronic components selected from a list of electronic components, including: a central processing unit, a digital signal processor, a field-programmable gate array, and a graphics board. According to another embodiment, processor 116 may also include a composite demodulator (not shown) that demodulates RF data and generates raw data. In yet another embodiment, demodulation may be performed earlier in the processing chain.
[0020] Processor 116 is adapted to perform one or more processing operations based on multiple selectable ultrasound modalities on the data. In one example, data can be processed in real time during a scanning session because echo signals are received by receiver 108 and transmitted to processor 116. For the purposes of this disclosure, the term "real time" is defined as including processes performed without any intentional delay. For example, embodiments may acquire images at a real-time rate of 7 frames / second to 20 frames / second. Ultrasound imaging system 100 is capable of acquiring 2D data of one or more planes at significantly faster rates. However, it should be understood that the real-time frame rate may depend on the length of time spent acquiring each frame of data for display. Therefore, the real-time frame rate may be slow when acquiring relatively large amounts of data. Thus, some embodiments may have a real-time frame rate significantly faster than 20 frames / second, while other embodiments may have a real-time frame rate less than 7 frames / second. Data may be temporarily stored in a buffer (not shown) during a scanning session and processed in real-time or offline operation. Some embodiments of the invention may include multiple processors (not shown) to handle processing tasks processed by processor 116 according to the exemplary embodiments described above. For example, before displaying an image, a first processor can be used to demodulate and extract the RF signal, while a second processor can be used to further process the data (e.g., by augmenting the data as further described herein). It should be understood that other embodiments may use different processor arrangements.
[0021] The ultrasound imaging system 100 can continuously acquire data at frame rates, for example, from 10 Hz to 30 Hz (e.g., 10 to 30 frames per second). Images generated from the data can be refreshed on a display device 118 at a similar frame rate. Other embodiments are capable of acquiring and displaying data at different rates. For example, depending on the frame size and the intended application, some embodiments may acquire data at frame rates less than 10 Hz or greater than 30 Hz. A memory 120 is included for storing frames of processed acquired data. In an exemplary embodiment, the memory 120 has sufficient capacity to store at least several seconds of ultrasound data frames. The data frames are stored in a manner that facilitates retrieval based on their acquisition order or time. The memory 120 may include any known data storage medium.
[0022] In various embodiments of the invention, processor 116 can process data through different mode-related modules (e.g., B-mode, color Doppler, M-mode, color M-mode, spectral Doppler, elastography, TVI, strain, strain rate, etc.) to form 2D or 3D data. For example, one or more modules can generate B-mode, color Doppler, M-mode, color M-mode, spectral Doppler, elastography, TVI, strain, strain rate, and combinations thereof. As an example, one or more modules can process color Doppler data, which may include conventional color flow Doppler, power Doppler, HD flow, etc. Image lines and / or frames are stored in memory and may include timing information indicating the time when image lines and / or frames are stored in memory. These modules may include, for example, a scan transformation module to perform a scan transformation operation to convert the acquired images from beam space coordinates to display space coordinates. A video processor module may be provided that reads the acquired images from memory and displays the images in real time while performing procedures on a patient (e.g., ultrasound imaging). The video processor module may include a separate image memory, and ultrasound images may be written to the image memory for reading and display by the display device 118.
[0023] In various embodiments of this disclosure, one or more components of the ultrasound imaging system 100 may be included in a portable ultrasound imaging device. For example, as referenced... Figure 2 As illustrated, display device 118 and user interface 115 can be integrated into the augmented reality (AR) device, and processor 116 and memory 120 can be included in a hub wirelessly connected to the AR device and probe 106. For example, display device 118 can be included in the headset of the AR device. Probe 106 can be a handheld probe that wirelessly communicates with the hub to collect raw ultrasound data. Transmit beamformer 101, transmitter 102, receiver 108, and receive beamformer 110 can be included in the same or different parts of the ultrasound imaging system 100. For example, transmit beamformer 101, transmitter 102, receiver 108, and receive beamformer 110 can be included in the hub, probe, and combinations thereof.
[0024] The ultrasound images acquired by the ultrasound imaging system 100 can be further processed. In some embodiments, the ultrasound images generated by the ultrasound imaging system 100 can be transmitted to an image processing system that can generate images for display on the display device 118 and other display devices, as described below.
[0025] Now for reference Figure 2 An exemplary wireless ultrasound imaging system 200 is shown. The wireless ultrasound imaging system 200 is... Figure 1One embodiment of the ultrasound imaging system 100. Therefore, although not explicitly shown, Figure 1 Components such as transmitting beamformer 101, transmitter 102, receiver 108, and receiving beamformer 110 may also be included in the wireless ultrasound imaging system 200 and function as described above.
[0026] The wireless ultrasound imaging system 200 includes a virtual network 202 formed between an ultrasound probe 204, a hub 218, and a first display device 226. The ultrasound probe 204 (e.g., Figure 1 The ultrasound probe 106 is a wireless ultrasound probe powered by battery 205. Ultrasound probe 204 may also be referred to herein as a wireless handheld probe assembly and may include components located within a shared housing or enclosure. Figure 1 Some or all of the described transmit beamformer 101, transmitter 102, receiver 108, and receive beamformer 110. Battery 205 may be, for example, a rechargeable battery configured to store power received from a power source in a wired or wireless manner. Ultrasonic probe 204 also includes processor 207 and memory 206. Memory 206 may be configured to at least temporarily store data acquired by ultrasonic probe 204 before it is transmitted to hub 218 via virtual network 202, as will be described below. For example, memory 206 may include buffer memory. Therefore, even if communication between ultrasonic probe 204 and hub 218 is temporarily interrupted, ultrasonic probe 204 can continue to acquire data, store the acquired data in memory 206, and then transmit the acquired data from memory 206 to hub 218 once communication is re-established. Furthermore, memory 206 may include instructions for acquiring ultrasound image data according to different image acquisition modes (examples of which will be described herein), processing the acquired ultrasound image data via processor 207, establishing a wireless connection with hub 218, and transmitting ultrasound image data, such as those described further below. For example, the instructions included in memory 206 may be executed by processor 207.
[0027] The ultrasound probe 204 also includes a wireless transceiver 208. The wireless transceiver 208 may include one or more transceivers that enable the ultrasound probe 204 to transmit and receive data on multiple wireless communication links including multiple frequency bands. Similarly, the hub 218 includes a wireless transceiver 220 that enables data transmission between the hub 218 and the ultrasound probe 204 on multiple frequency bands. The hub 218 may also include a processor 230 and a memory 232, or communicate electronically with the processor and memory. For example, the hub 218 may include an image processing system. The processor 230 includes one or more processors located within or remotely accessible via the hub 218. For example, the processor 230 may include a beamforming engine (e.g., Figure 1 The receiving beamformer 110 receives raw or partially processed ultrasound image data from the ultrasound probe 204 and generates an ultrasound image based on the raw or partially processed ultrasound image data. Similarly, the memory 232 may be located within or remotely accessed via the hub 218, and may store raw ultrasound image data, processed or partially processed ultrasound image data, ultrasound images, instructions for acquiring ultrasound image data, instructions for processing ultrasound images, etc.
[0028] Virtual network 202 utilizes network slicing and includes a first frequency band 210 and a second frequency band 214. The first frequency band 210 is a lower frequency band (e.g., 7 GHz, GHz, or lower) with a larger data transmission range (e.g., distance), while the second frequency band is a higher frequency band (e.g., 60 GHz or millimeter wave, such as 5G) with a smaller data transmission range compared to the lower frequency band. The first frequency band 210 has a lower latency and lower bandwidth frequency, while the second frequency band 214 has a higher latency and higher bandwidth frequency. Therefore, the first frequency band 210 enables faster transmission of smaller data amounts, while the second frequency band 214 enables slower transmission of larger data amounts.
[0029] A first wireless connection 211 is established between the ultrasound probe 204 and the hub 218 on a first frequency band 210, and a second wireless connection 213 is established between the ultrasound probe 204 and the hub 218 on a second frequency band 214. The second frequency band 214 can utilize direct line-of-sight to establish and maintain the second wireless connection 213. For example, the waves of the second frequency band 214 may not be able to penetrate certain structures that may be located between the transceiver 208 of the ultrasound probe 204 and the transceiver 220 of the hub 218. In contrast, the first frequency band 210 cannot utilize line-of-sight to establish and maintain the first wireless connection 211. Therefore, connection interruptions may occur more frequently in the second wireless connection 213 compared to the first wireless connection 211.
[0030] Furthermore, a third wireless connection 215 is established between the hub 218 and the first display device 226 on the first frequency band 210. The hub 218 receives a first smaller dataset 212 of ultrasound image data acquired by the ultrasound probe 204 via the first wireless connection 211 (e.g., via the first frequency band 210), and a second larger dataset 216 of ultrasound image data acquired by the ultrasound probe 204 via the second wireless connection 213 (e.g., via the second frequency band 214). For example, the smaller dataset 212 may include a subset of emission lines, while the larger dataset 216 may include all emission lines acquired during the scan, such as in... Figure 6A and Figure 6B As shown in the diagram and described below, the smaller dataset 312 may include a portion (e.g., a subset) of the data in the larger dataset 216 and may also be referred to herein as a partial dataset. The larger dataset 216 may also be referred to herein as the full dataset. The full dataset may include substantially all data acquired by the ultrasound probe 204 during the scan, or may exclude all data acquired by the ultrasound probe 204 during the scan.
[0031] In at least some examples, the processor 207 of the ultrasound probe 204 can select, based on instructions in memory 206, which data from the larger dataset 216 are included in the smaller dataset 212. For example, the processor 207 can select data based on the bandwidth of the first frequency band 210 to transmit the maximum amount of data over the first wireless connection 211. Therefore, the instructions can include layered format skip lines, field-of-view adjustments, etc., to balance reducing data size with preserving image quality.
[0032] Hub 218 (e.g., via processor 230) processes a smaller dataset 212 to generate low-resolution images 222, which are transmitted to a first display device 226 via a third wireless connection 215 (e.g., via a first frequency band 210). Due to the lower latency of the first frequency band 210 and the improved connection stability of the first wireless connection 211, the smaller dataset 212 and the low-resolution images 222 can be transmitted substantially in real time. For example, hub 218 can receive the smaller dataset 212 substantially instantaneously from ultrasound probe 204 as it is being transmitted via the first frequency band 210 and the first wireless connection 211. Hub 218 can process the smaller dataset 212 in real time upon receipt and transmit the low-resolution images 222 to the first display device 226 in real time. The first display device 226 can receive the low-resolution images 222 substantially instantaneously as they are being transmitted from hub 218 via the first frequency band 210 and the third wireless connection 215.
[0033] Hub 218 is also communicatively connected to electronic device 228 via a wired or wireless connection (e.g., via a second frequency band 214). Hub 218 processes a large dataset 216 to produce a high-resolution image 224, which is further transmitted to electronic device 228. The second frequency band 214 (e.g., compared to the first frequency band 210) has a longer latency but also higher bandwidth, enabling the transmission of larger data volumes, but with greater latency compared to the first frequency band 210. Furthermore, as described above, the second wireless connection 213 may be more prone to connection interruptions. Therefore, in some embodiments, the large dataset 216 may be transmitted from ultrasound probe 204 to hub 218 at a slower rate than real-time via the second frequency band 214 and the second wireless connection 213. In some examples, the transmission of the large dataset 216 from ultrasound probe 204 may be delayed by seconds, minutes, hours, or more. Once hub 218 receives the larger dataset 216, hub 218 can process the larger dataset 216 to produce a high-resolution image 224 without intentional delay or at a later time (e.g., in response to a user's request to process the larger dataset 216). Furthermore, once generated, the high-resolution image 224 can be transmitted from hub 218 to electronic device 228 without intentional delay or at a later time (e.g., in response to a user's request to display the high-resolution image 224).
[0034] Electronic device 228 may include one or more of a computing device, an image archiving and communication system, and a second display device. The first display device 226 is a display device used by a technician operating the ultrasound probe 204, while electronic device 228 may be located remotely from the ultrasound probe 204 or locally at the ultrasound probe. For example, the second display device may be a display device remote from the ultrasound examination for a diagnostic clinician (e.g., located in a different room or different facility). For example, the diagnostic clinician may review the high-resolution image 224 after the ultrasound examination to make a diagnosis. The first display device 226 may be a headset for an AR device worn by the technician, as described above. Alternatively, the first display device 226 may be another type of device located locally at the technician's location, such as a computer monitor, touchscreen, etc. The second display device of electronic device 228 can utilize virtually any type of display technology. For example, electronic device 228 may be a desktop computer, laptop computer, tablet computer, or smartphone and may utilize an external monitor, built-in display, touchscreen, and / or projector to display the high-resolution image 224. Therefore, the low-resolution image 222 can be displayed to the technician in real time to provide guidance for probe operation, while the high-resolution image 224 can provide diagnostic images, which can be displayed to the clinician with a certain delay compared to the low-resolution image 222. In this way, network slicing of the virtual network 202 enables the acquisition of high-quality ultrasound images via the ultrasound probe 204 without delay in providing real-time visual guidance to the technician operating the ultrasound probe 204.
[0035] It should be understood that Figure 2 The wireless ultrasound imaging system 200 shown is an illustrative example of one embodiment of a wireless ultrasound imaging system that utilizes network slicing to transmit different datasets on different frequency bands, including multiple portions of the dataset. Another suitable wireless ultrasound imaging system may include more, fewer, or different components without departing from the scope of this disclosure.
[0036] For example, go to Figure 3 The image shows a wireless ultrasound imaging system 300. The wireless ultrasound imaging system 300 is similar to... Figure 2 The wireless ultrasound imaging system 200 differs from the wireless ultrasound imaging system 300 in that it is a hubless system. Therefore, previously in Figure 2 The introduction in Figure 3 The components, whose numbers are the same as those previously described for their functions, do not need to be repeated.
[0037] The wireless ultrasound imaging system 300 includes and Figure 2Virtual network 302 is similar to virtual network 202. For example, virtual network 302 uses network slicing to connect ultrasound probe 204 to first electronic device 326 via first wireless connection 211 and first frequency band 210, and connects ultrasound probe to second electronic device 328 via second wireless connection 213 and second frequency band 214. Therefore, instead of sending both smaller dataset 212 and larger dataset 216 to a single electronic device (e.g., ...), ... Figure 2 Instead of using a hub 218, the smaller dataset 212 and the larger dataset 216 could be sent directly to different electronic devices for further processing and / or display.
[0038] In the illustrated embodiment, the first electronic device includes a wireless transceiver 320, a processor 330, and a memory 332. For example, the wireless transceiver 320 enables the first electronic device 326 to receive a smaller dataset 212 from the ultrasound probe 204 via a first lower bandwidth wireless connection 211, and the processor 330 can further process the smaller dataset 212 based on instructions stored in the memory 332 to generate and display a low-resolution image 222. The first electronic device 326 may further include or be communicatively coupled to a first display device that can display the low-resolution image 222 in real time when ultrasound signals in the smaller dataset 212 have been acquired. For example, the first electronic device 326 may be a portable computing device, such as a personal digital assistant, tablet computer, laptop computer, AR headset, smartphone, etc. Therefore, the first display device 338 can be integrated into the first electronic device 326 that receives the smaller dataset 212 from the ultrasound probe 204. Furthermore, the first electronic device 326 may be located locally on the ultrasonic probe 204, making the first display device 338 visible to the operator of the ultrasonic probe 204.
[0039] Similarly, in the illustrated embodiment, the second electronic device 328 includes a wireless transceiver 322, a processor 334, and a memory 336. The wireless transceiver 322 enables the second electronic device 328 to receive a larger dataset 216 from the ultrasound probe 204 via a second, larger bandwidth wireless connection 213. The processor 334 can further process the larger dataset 216 based on instructions stored in the memory 336 to generate, display, and / or save a high-resolution image 224 (e.g., to the memory 336). In some embodiments, the second electronic device 328 may include a second display device 340 or be communicatively coupled to such a second display device. The high-resolution image 224 may be output to the second display device 340 in response to a user request to receive, for example, view, the high-resolution image 224. As an example, the second electronic device 328 may include a picture archiving and communication system. Additionally or alternatively, the second electronic device 328 may include computing devices such as personal digital assistants, tablet computers, laptop computers, desktop computers, smartphones, and distributed computing systems. Furthermore, in some embodiments, at least a portion of the second electronic device 328 may be located away from the ultrasonic probe 204.
[0040] Furthermore, it can be understood that at least one of the wireless transceiver 322, the processor, the memory, and the second display device 340 may be located in separate housings and / or locations, rather than in a shared enclosure. For example, the components described with respect to the second electronic device 328 may be distributed across multiple devices. For example, a large dataset 216 may be received by the wireless transceiver 322, which may be included in an access point that is further electrically connected to the processor 334 and / or the memory 336 via wireless or wired communication technology.
[0041] Figure 4 A flowchart is shown illustrating an exemplary method 400 for transmitting ultrasound image data via a virtual network during an ultrasound examination. (About...) Figure 1 and Figure 2 The system and components described herein constitute method 400; however, it is understood that method 400 may be implemented with other systems and components without departing from the scope of this disclosure. Method 400 may be implemented by one or more processors (e.g., Figure 2 Processors 207 and 230) are based on storage in at least one non-transitory memory (such as Figure 2 The method 400 is executed by means of instructions stored in the memory 232 of the hub 218 and / or the memory 206 of the ultrasound probe 204. For example, the processor of the wireless ultrasound probe and the processor of the hub (e.g., an image processing hub) can be combined to execute method 400.
[0042] At 402, method 400 includes establishing a wireless network between the wireless ultrasound probe, the hub, and the first display device. The wireless network may include a first frequency band with lower bandwidth (e.g., ...). Figure 2 The first frequency band 210) and the second frequency band with higher bandwidth (e.g., Figure 2 The second frequency band 214). Therefore, the wireless network can be a multi-frequency wireless network using network slicing. Compared to the second frequency band, the first frequency band can transmit data over a longer distance with lower latency. For example, the first frequency band can be 7 GHz or lower, while the second frequency band can be at least 60 GHz or millimeter-wave technology (e.g., 5G). Therefore, the first frequency band can be a lower frequency band, while the second frequency band can be a higher frequency band. Wireless ultrasound probes (e.g., Figure 2 The ultrasonic probe 204 can be configured to be connected to a hub (e.g., via both a first frequency band and a second frequency band) Figure 2 The hub 218), and the hub can be further configured to be connected to the first display device via a first frequency band (instead of a second frequency band). The first display device (e.g., Figure 2 The first display device 226) is located locally (e.g., in the same room) of the wireless ultrasound probe and includes a display for a technician to perform an ultrasound examination. (As mentioned above...) Figure 1 and Figure 2 The first display device may be included in an augmented reality headset worn by a technician; however, other types of display devices are also possible. Therefore, establishing a wireless network may include: establishing a first low-bandwidth wireless connection between the wireless ultrasound probe and the hub via a first frequency band; establishing a second high-bandwidth wireless connection between the wireless ultrasound probe and the hub via a second frequency band; and establishing a third wireless connection between the hub and the first display device via the first frequency band.
[0043] An ultrasound examination can be performed in response to establishing a connection between the wireless ultrasound probe, the hub, and the first display device via a first frequency band. For example, the connection on the first frequency band can be established in response to the start of an ultrasound examination (such as in response to the selection of an ultrasound examination protocol or the receipt of another type of user input for starting an ultrasound examination). Additionally or alternatively, the first and third wireless connections can be established in response to data acquisition via the wireless ultrasound probe. For example, the wireless ultrasound probe can automatically establish a wireless connection on the first frequency band in response to transmitting and / or receiving ultrasound signals. Because the data transmission range for the second frequency band is lower, and the second frequency band can utilize direct line-of-sight connections, there may be situations where the wireless ultrasound probe's connection to the hub via the second wireless connection is at least temporarily disconnected. For example, during an ultrasound examination, the wireless ultrasound probe may at least temporarily lose line-of-sight with the hub. In some embodiments, the operation of the wireless ultrasound probe can be adjusted in response to the second frequency band being unavailable for establishing a second wireless connection, in order to reduce the power consumption of the wireless ultrasound probe.
[0044] Therefore, at 404, method 400 includes determining whether the second frequency band is available. For example, a wireless ultrasound probe may attempt to establish a second wireless connection to the hub on the second frequency band (or vice versa), and may determine that the second frequency band is unavailable in response to the failure to establish a second wireless connection for a predetermined non-zero threshold duration. Additionally or alternatively, the wireless ultrasound probe may repeatedly attempt to establish a second wireless connection to the hub, and determine that the second frequency band is unavailable in response to the number of consecutive attempts without establishing a second wireless connection reaching a predetermined non-zero threshold.
[0045] Additionally or alternatively, in some embodiments, the second frequency band may be selectively available. For example, a technician may use this information to input a request to establish a second wireless connection, and in response to receiving the request, the second frequency band becomes available. This request may include, for example, a "freeze" or "store" request, and may be accessible via a user interface (e.g., Figure 1 The user interface 115 receives the request. In such an example, a second wireless connection may not be established until the request is received. Similarly, a technician may enter a different second request to disconnect the wireless ultrasound probe from the hub via the second connection, and in response to receiving the second request, the second frequency band may become unavailable. As another example, the first request may time out after a predetermined duration or a predetermined amount of data transmission via the second wireless connection.
[0046] If the second frequency band is available (e.g., an active connection via the second frequency band exists between the wireless ultrasound probe and the hub), method 400 proceeds to 406 and includes operating the wireless ultrasound probe in a first acquisition mode to acquire ultrasound data. The first acquisition mode, used when establishing both the first and second wireless connections between the wireless ultrasound probe and the hub, can be a higher power consumption mode, as described below at 414, compared to a second acquisition mode that can be used when the second frequency band is unavailable. Therefore, the wireless ultrasound probe's battery consumes power at a faster rate when operating in the first acquisition mode compared to operating in the second acquisition mode. Operating the wireless ultrasound probe in the first acquisition mode may include: acquiring more transmit lines; acquiring data at a higher pulse repetition frequency; acquiring data at a higher frame rate; acquiring data from a larger region of interest (ROI); and / or performing more data processing on the acquired ultrasound data via the probe's processor compared to operating in the second acquisition mode. Therefore, operating in the first acquisition mode may include performing more comprehensive or detailed acquisition at the wireless ultrasound probe. Furthermore, it can be understood that both the operation in the first acquisition mode and the operation in the second acquisition mode include: receiving ultrasound signals from the ROI using a wireless ultrasound probe; generating multiple received digital signals within the wireless ultrasound probe based on the received ultrasound signals; and generating each of the larger and smaller datasets based on the multiple received digital signals.
[0047] At 408, method 400 includes transmitting a larger dataset of acquired ultrasound data from a wireless ultrasound probe to a hub via a second frequency band. In at least some embodiments, the larger dataset may include substantially all data acquired during the ultrasound examination, including the larger field of view and each acquired transmit line. Alternatively, the larger dataset may not include all data acquired during operation. Further, compared to a smaller dataset, the larger dataset may undergo additional processing and error correction in the wireless channel at the wireless ultrasound probe, which will be further described below (e.g., at 420). Error correction in the wireless channel (e.g., a second wireless connection) can ensure error-free transmission of the larger dataset, but may reduce transmission speed. For example, transmission with error correction may result in a slower transmission speed than transmission without error correction.
[0048] As mentioned above Figure 2The data transmitted via the second frequency band cannot be used to generate real-time images displayed to the operator during an ultrasound examination. Therefore, in at least some examples, transmitting a large dataset of acquired ultrasound data from the wireless ultrasound probe to the hub via the second frequency band may involve transmitting the large dataset to the hub at a slower rate than in real-time (e.g., lower than the image data acquisition rate). Furthermore, if the second frequency band does not have sufficient bandwidth to transmit all available data from the large dataset, the remaining data that has not yet been transmitted can be stored in the probe's buffer memory (e.g., Figure 2 It is queued in the memory 206) and transmitted via the second frequency band when bandwidth becomes available.
[0049] At 410, method 400 includes generating a higher-resolution image from a larger dataset via a hub. For example, a processor may process ultrasound signals from the larger dataset to generate slices or frames of ultrasound information (e.g., ultrasound images). In one example, generating a higher-resolution image may include determining the intensity value of each pixel to be displayed based on the received image data (e.g., 2D or 3D ultrasound data). Because the larger dataset contains more image data compared to the smaller dataset, more information is available for generating the pixels of the resulting image. For example, a higher-resolution image may have more pixels per inch compared to a lower-resolution image that can be generated from a smaller dataset (e.g., at 422), as described further below. Due to the increased detail in the higher-resolution image, it may include a diagnostic-quality image.
[0050] In some examples, higher-resolution images can be generated at a slower rate than real-time, which may also be referred to herein as sub-real-time. As one example, higher-resolution images can be generated during an ultrasound examination, but at a frame rate lower than the frame rate of ultrasound data acquisition. As another example, at least a portion of a higher-resolution image can be generated after all data has been acquired for an ultrasound examination. In yet another example, some or all of a higher-resolution image can be generated in response to a user request for diagnostic images.
[0051] At 412, method 400 includes transmitting a higher resolution image from the hub to a second display device. For example, the second display device could be a display device for a diagnostic clinician. In some embodiments, the second display device can be located remotely from the wireless ultrasound probe. For example, the second display device could be located in a different room from the wireless ultrasound probe and / or in a different room from the hub. Further, as described above regarding... Figure 2In at least some of the examples discussed, higher-resolution images can be transmitted to a second display device non-real-time. Once transmitted to the second display device, the higher-resolution image can be displayed on the second display device. As an example, a diagnostic clinician can select one or more high-resolution images from a set of high-resolution images via a user interface to display on the second display device.
[0052] At 420, method 400 includes transmitting a smaller dataset of acquired ultrasound data from a wireless ultrasound probe to a hub non-real-time via a first frequency band. The smaller dataset comprises a subset of the larger dataset. For example, the smaller dataset may include a portion of a transmission line, a tunable field of view, and / or a portion of an acquired frame. For example, the smaller dataset may include every other transmission line, such as... Figure 6A and Figure 6B As shown and described below. Further, a reduction-level preprocessing can be performed on the smaller dataset at the probe. In some examples, the amount of data in the smaller dataset can be limited based on the known bandwidth of the first frequency band, such that it does not exceed the known bandwidth. While ultrasound data has been acquired, the smaller dataset can be transmitted in real-time from the probe to the hub via the first wireless connection. Furthermore, at least in some embodiments, error correction may not be performed during the transmission of the smaller dataset via the first frequency band to improve transmission speed.
[0053] At 422, method 400 includes generating a lower-resolution image in real time from a smaller dataset via a hub. The lower-resolution image can be generated in a manner similar to that described above for the higher-resolution image at 410. However, because the smaller dataset contains less image information compared to the larger dataset, the lower-resolution image may have fewer pixels per inch, resulting in less image detail. Furthermore, the lower-resolution image can be generated substantially in real time as the data is acquired and transmitted to the hub.
[0054] At 424, method 400 includes transmitting a lower-resolution image from the hub to a first display device in real time via a first frequency band. For example, transmitting the lower-resolution image to the first display device may include transmitting it to the first display device as each lower-resolution image is generated. Method 400 may then terminate. In this way, the lower-resolution image can be displayed to the operator in real time via data transmission using a faster but smaller-capacity first frequency band. Therefore, real-time guidance feedback can be provided for ultrasound examinations, which may not include sufficient detail for making a diagnosis. Furthermore, by transmitting a larger dataset via a slower but larger-capacity second frequency band, higher-resolution images can be generated and displayed to the diagnostic clinician without delay in providing real-time feedback to the operator during the ultrasound examination.
[0055] Returning to 404, if the second frequency band is unavailable (e.g., there is no active connection via the second frequency band between the wireless ultrasound probe and the hub), method 400 proceeds to 414 and includes operating the wireless ultrasound probe in a second acquisition mode to acquire ultrasound data. The second acquisition mode used when the second frequency band is unavailable can be a lower power consumption mode compared to the first acquisition mode described above at 406. Operating the wireless ultrasound probe in the second acquisition mode can include: acquiring fewer transmit lines; acquiring data at a lower pulse repetition frequency; acquiring data at a lower frame rate; acquiring data from a smaller ROI; and / or performing less data processing on the acquired ultrasound data at the probe. Therefore, operating in the second acquisition mode can include performing a less comprehensive or detailed acquisition at the wireless ultrasound probe. In some embodiments, the second acquisition mode may differ depending on the type of ultrasound examination being performed. For example, cardiac ultrasound imaging may prioritize pulse repetition frequency, while abdominal ultrasound imaging may prioritize resolution. Therefore, for example, when performing cardiac ultrasound imaging, the pulse repetition frequency can be higher in the second acquisition mode compared to when performing abdominal ultrasound imaging.
[0056] In some implementations, the amount and quality of data acquired by the wireless ultrasound probe in the second acquisition mode may remain unchanged from that in the first acquisition mode. However, power consumption can be reduced by performing less data processing at the probe. In other implementations, the amount and quality of data acquired by the wireless ultrasound probe may be reduced when operating in the second acquisition mode, but the amount and quality of the acquired data may allow for the generation of diagnostic quality (e.g., high-resolution) images based on a larger dataset. Therefore, at least in some implementations, the larger dataset may be similar to or the same as the ultrasound data acquired when operating in the first acquisition mode.
[0057] Furthermore, in some embodiments, operation in the second acquisition mode may include, for example, outputting a notification to the operator via a first display device. For instance, the notification may state that the wireless ultrasound probe is not connected to the hub via the second frequency band. Additionally or alternatively, the notification may include a visual icon or sound cue (e.g., a beep) associated with the disconnection of the second frequency band. Thus, the operator may have an opportunity to correct the connectivity problem if needed.
[0058] At 416, method 400 includes storing a larger dataset of acquired ultrasound data in the probe buffer memory. Because the second frequency band is unavailable, and the first frequency band may not have the bandwidth to transmit the larger dataset from the wireless ultrasound probe to the hub, the larger dataset is stored locally on the probe until the second frequency band becomes available. Furthermore, by reducing the processing of the acquired ultrasound data at the probe, more probe memory can be used to store the larger dataset.
[0059] Additionally, in some embodiments, operation in the second acquisition mode may include erasing a larger dataset from the probe memory after a predetermined non-zero duration (e.g., minutes or hours) has elapsed, in response to the operator selecting subsequent images or videos and / or in response to the end of the ultrasound examination. In this way, the probe memory may not be used for long-term storage of the larger dataset, but may be used for temporary storage of the larger dataset when the second frequency band is unavailable for transmission.
[0060] At 418, method 400 includes again determining whether the second frequency band is available, as described above at 404. If the second frequency band is still unavailable, method 400 may proceed to 420 to transmit a smaller dataset of the acquired ultrasound data from the wireless ultrasound probe to the hub in real time via the first frequency band, as described above. Thus, the larger dataset can remain stored in the probe's buffer memory. In response to the second frequency band becoming available, method 400 proceeds to 408 to transmit the larger dataset of the acquired ultrasound data (including data stored in the probe's memory) to the hub. Therefore, operation in the second acquisition mode may include transmitting the larger dataset to the hub in response to the second frequency band becoming available. In some embodiments, the wireless ultrasound probe may be adjusted to operate in the first acquisition mode in response to the second frequency band becoming available. It is understood that if the second frequency band becomes unavailable at any time while operating in the first acquisition mode, the wireless ultrasound probe may switch to operation in the second acquisition mode.
[0061] Figure 5 A flowchart is shown illustrating an exemplary method 500 for transmitting ultrasound image data via a hubless system through a virtual network during an ultrasound examination. (About...) Figure 1 and Figure 3 The system and components described herein constitute method 500; however, it is understood that method 500 may be implemented with other systems and components without departing from the scope of this disclosure. Method 500 may be implemented by one or more processors (e.g., Figure 3 The processors 207, 330, and / or 334) are based on storage in at least one non-transitory memory (such as... Figure 3The method 500 is executed by instructions stored in the memory 332 of the first electronic device, the memory 336 of the second electronic device, and / or the memory 206 of the ultrasonic probe 204. For example, the first part of method 500 can be executed by the ultrasonic probe 204, the second part of method 500 can be executed by the first electronic device 326, and the third part of method 500 can be executed by the second electronic device 328, such that method 500 is executed in combination. Further, method 500 is similar to... Figure 4 Method 400. Therefore, for the sake of brevity, the differences between the two methods will be highlighted below.
[0062] At point 502, method 500 includes establishing a wireless network between a wireless ultrasound probe, a first electronic device, and a second electronic device. The wireless network may include a first frequency band with lower bandwidth (e.g., ...). Figure 2 The first frequency band 210) and the second frequency band (e.g., Figure 2 The second frequency band 214), as described above at 402. Wireless ultrasound probes (e.g., Figure 2 The ultrasound probe 204 can be configured to be connected to a first electronic device (e.g., via a first frequency band) Figure 3 The first electronic device 326), and connected to the second electronic device (e.g., via the second frequency band) Figure 3 The second electronic device 328). The first electronic device is located locally to the wireless ultrasound probe (e.g., in the same room) and includes a display for a technician to perform an ultrasound examination. In contrast, in at least some embodiments, at least a portion of the second electronic device may be located remotely from the wireless ultrasound probe. Thus, establishing a wireless network may include: establishing a first lower bandwidth wireless connection between the wireless ultrasound probe and the first electronic device via a first frequency band; and establishing a second higher bandwidth wireless connection between the wireless ultrasound probe and the second electronic device via a second frequency band.
[0063] An ultrasound examination can be performed in response to establishing a first wireless connection between the wireless ultrasound probe and the first electronic device. As described above with respect to method 400, in some embodiments, the operation of the wireless ultrasound probe can be adjusted in response to a second frequency band being unavailable for establishing a second wireless connection, in order to reduce the power consumption of the wireless ultrasound probe.
[0064] Therefore, at 504, method 500 includes determining whether a second frequency band is available. For example, a wireless ultrasound probe may attempt to establish a second wireless connection with a second electronic device on the second frequency band (or vice versa), and may determine that the second frequency band is unavailable in response to the failure to establish a second wireless connection for a predetermined non-zero threshold duration. Additionally or alternatively, the wireless ultrasound probe may repeatedly attempt to establish a second wireless connection to the second electronic device, and determine that the second frequency band is unavailable in response to the number of consecutive attempts without establishing a second wireless connection reaching a predetermined non-zero threshold. Additionally or alternatively, in some embodiments, in response to a user interface (e.g., Figure 1 The user interface 115 receives a request, and the second frequency band may be selectively available, as described above at 404.
[0065] If the second frequency band is available (e.g., there is an active connection via the second frequency band between the wireless ultrasound probe and the second electronic device), method 500 proceeds to 506 and includes operating the wireless ultrasound probe in a first acquisition mode to acquire ultrasound data. The first acquisition mode, used when both the first and second wireless connections are active, can be a higher power consumption mode, as described above at 406, compared to a second acquisition mode that can be used when the second frequency band is unavailable.
[0066] At 508, method 500 includes transmitting a larger dataset of acquired ultrasound data from a wireless ultrasound probe to a second electronic device via a second frequency band. In at least some embodiments, the larger dataset may include substantially all the data acquired while operating the probe in a first acquisition mode, including a larger field of view and each acquired transmission line. Further, compared to a smaller dataset, the larger dataset may undergo additional processing and error correction in the wireless channel at the wireless ultrasound probe, which will be further described below (e.g., at 520). Additional details regarding the transmission of the larger dataset via a second wireless connection with a larger bandwidth have been described above at 408.
[0067] At 510, method 500 includes generating a higher-resolution image at a second electronic device based on a larger dataset. For example, a processor of the second electronic device may process ultrasound signals from the larger dataset to generate slices or frames of ultrasound information (e.g., ultrasound images). Additionally or alternatively, the larger dataset may include beamformed ultrasound images generated at a wireless ultrasound probe and transmitted to the second electronic device for further processing, display, and / or storage. As described above at 410, in some examples, at least a portion of the higher-resolution image may be generated after all data has been acquired for an ultrasound examination. In another example, some or all of the higher-resolution image may be generated in response to a user request for diagnostic images.
[0068] At 512, method 500 optionally includes displaying a higher resolution image in response to a user request. As an example, during or after an ultrasound examination, a diagnostic clinician may select one or more high-resolution images from a set of high-resolution images for display on a display device located remotely from the wireless ultrasound probe. Thus, the higher resolution image can be processed, displayed, and / or saved, but is not displayed in real-time to the operator of the wireless ultrasound probe during the ultrasound examination.
[0069] At 520, method 500 includes transmitting a smaller dataset of acquired ultrasound data from a wireless ultrasound probe to a first electronic device via a first frequency band, without real-time transmission. The smaller dataset comprises a subset of the larger dataset, as described above at 420. While ultrasound data has been acquired, the smaller dataset can be transmitted in real-time from the probe to the first electronic device via a first wireless connection. For example, the smaller dataset may include beamformed ultrasound images generated at the wireless ultrasound probe based on a smaller amount of acquired data compared to the larger dataset.
[0070] At 522, method 500 includes generating a lower-resolution image in real time at the first electronic device based on a smaller dataset. The lower-resolution image can be generated in a manner similar to that described above for the higher-resolution image at 410. However, because the smaller dataset contains less image information compared to the larger dataset, the lower-resolution image may have fewer pixels per inch, resulting in less image detail. Furthermore, the lower-resolution image can be generated in real time, essentially during data acquisition and transmission to the first electronic device.
[0071] At 524, method 500 includes displaying the lower-resolution images in real time at a first electronic device. For example, each lower-resolution image can be displayed at the first electronic device as it is generated. The first electronic device may include a built-in display, such as a touchscreen of a tablet computer or smartphone. Method 500 can then terminate. In this way, the lower-resolution images can be displayed to the operator in real time via data transmission using a faster but smaller capacity first frequency band. Thus, real-time guidance feedback can be provided for the ultrasound examination, which may not include sufficient detail for making a diagnosis. Furthermore, by transmitting a larger dataset via a slower but larger capacity second frequency band, higher-resolution images can be generated and displayed to the diagnostic clinician without delay in providing real-time feedback to the operator during the ultrasound examination.
[0072] Returning to 504, if the second frequency band is unavailable (e.g., there is no active connection via the second frequency band between the wireless ultrasound probe and the second electronic device), method 500 proceeds to 514, and includes operating the wireless ultrasound probe in a second acquisition mode to acquire ultrasound data. The second acquisition mode used when the second frequency band is unavailable can be a lower power consumption mode compared to the first acquisition mode described above at 506. The operation of the wireless ultrasound probe in the second acquisition mode was described above with respect to 414.
[0073] At 516, method 500 includes storing a larger dataset of acquired ultrasound data in the probe buffer memory. Because the second frequency band is unavailable and the wireless ultrasound probe is disconnected from the second electronics, the larger dataset is stored locally on the probe until the second frequency band becomes available. Furthermore, by reducing the processing of the acquired ultrasound data at the probe, more probe memory can be used to store the larger dataset.
[0074] At 518, method 500 includes again determining whether the second frequency band is available, as described above at 504. If the second frequency band is still unavailable, method 500 may proceed to 520 to transmit a smaller dataset of the acquired ultrasound data from the wireless ultrasound probe to the first electronic device in real time via the first frequency band, as described above. Thus, the larger dataset can remain stored in the probe's buffer memory. In response to the second frequency band becoming available, method 500 proceeds to 508 to transmit the larger dataset of the acquired ultrasound data (including data stored in the probe's memory) to the second electronic device. Thus, operation in the second acquisition mode may include transmitting the larger dataset to the second electronic device in response to the second frequency band becoming available. Further, at least in some embodiments, the probe may switch to operation in the first acquisition mode. It is understood that if the second frequency band becomes unavailable at any time while operating in the first acquisition mode, the wireless ultrasound probe may switch to operation in the second acquisition mode.
[0075] In this way, even if the second frequency band is unavailable, lower-resolution images can still be displayed to the operator in real time. Therefore, ultrasound examinations can continue uninterrupted. Furthermore, regardless of whether operating in the first or second acquisition mode, a large dataset of ultrasound data can be acquired, sufficient to generate ultrasound images with high-resolution diagnostic quality. By reducing power consumption when the second frequency band is unavailable for transmitting large datasets and large, deeply processed data, the battery life of the wireless ultrasound probe can be extended. Therefore, downtime due to charging can be reduced, and probe switching due to battery depletion during ultrasound examinations can be minimized.
[0076] Figure 6A and Figure 6BIt shows, for example, according to Figure 3 or Figure 4 The method is used to form exemplary emission patterns of ultrasound images with different image qualities. Specifically, Figure 6A A larger full dataset 600 of transmitter lines 602 is shown, which correspond to wireless handheld probe assemblies (e.g., Figure 2 The ultrasound probe 204) targets all transmission lines for image frame acquisition. The entire dataset 600 can be transmitted from the wireless handheld probe assembly to a hub (e.g., via a high-bandwidth wireless connection). Figure 2 (hub 218) or another image processing device (e.g., Figure 3 The second electronic device 328. A hub or image processing device can process the entire dataset 600 to generate a higher resolution image 606. The higher resolution image 606 can be output to a display 608, which can be a display viewed by a diagnostic clinician.
[0077] In comparison, Figure 6B A smaller subset of dataset 601 is shown, which includes... Figure 6A This is a portion of the transmission line 602 of the full dataset 600. The dashed transmission line 604 represents a skipped line not included in the partial dataset 601. The partial dataset 601 can be transmitted in real-time via a low-bandwidth wireless connection to a hub or electronic equipment used by the operator of the wireless ultrasound probe (e.g., [missing information]). Figure 3 The first electronic device 326, and the hub or electronic device, can process a portion of the dataset 601 in real time to generate a lower resolution image 610. The lower resolution image 610 can be output to a display 612 in real time. The display 612 can be a display viewed by the operator of the wireless ultrasound probe.
[0078] As mentioned above Figure 2 and Figure 3 As explained, a higher bandwidth wireless connection can transmit a larger amount of data in the entire dataset 600. However, a higher bandwidth wireless connection has a longer latency compared to a lower bandwidth wireless connection. Therefore, by transmitting a smaller portion of the dataset 601 via a lower bandwidth but shorter latency wireless connection, a lower resolution image 610 can be generated and displayed to the operator in real time.
[0079] In this way, an operator performing an ultrasound examination using a wireless probe can receive real-time guidance feedback via lower-quality real-time images while simultaneously acquiring sufficient data to generate higher-quality diagnostic images. Because the diagnostic images are not used for real-time guidance, the conflicting needs for rapid wireless data transmission of real-time images and high-bandwidth wireless data transmission of diagnostic images can be addressed via two virtual networks in different frequency bands with varying capacities and latency. Furthermore, a single dataset can be acquired, with a portion of it used to generate real-time images and all (or a larger portion thereof) of the dataset used to generate diagnostic images. Furthermore, the ultrasound examination can continue uninterrupted when the higher-bandwidth wireless connection used to transmit all the single datasets is unavailable. Furthermore, probe power consumption can be reduced when the higher-bandwidth wireless connection is unavailable, thereby increasing the wireless probe's battery life. Therefore, wireless probe downtime can be reduced and ultrasound examination throughput increased.
[0080] When a higher bandwidth wireless connection is unavailable, the technical effect of reducing the amount of data acquired, processed, and / or transmitted by a wireless ultrasound probe configured to connect to one or more electronic devices via both a lower bandwidth wireless connection and a higher bandwidth wireless connection is that it can reduce the power consumption of the wireless ultrasound probe.
[0081] This disclosure also provides support for a method comprising: receiving an ultrasound signal of a region of interest using a wireless handheld probe assembly; generating a plurality of received digital signals based on the received ultrasound signals within the wireless handheld probe assembly; generating a larger dataset and each of a smaller dataset based on the plurality of received digital signals; transmitting the smaller dataset from the wireless handheld probe assembly to a hub via a low-bandwidth wireless connection; transmitting the larger dataset from the wireless handheld probe assembly to the hub via a higher-bandwidth wireless connection; generating a low-resolution image based on the smaller dataset and a high-resolution image based on the larger dataset at the hub; and transmitting the low-resolution image from the hub to a first display and the high-resolution image from the hub to an electronic device. In a first embodiment of the method, one or both of the larger dataset and the smaller dataset include a beamformed ultrasound image generated at the wireless handheld probe assembly before being transmitted to the hub. In a second embodiment of the method, which optionally includes the first embodiment, the first display is viewable by an operator of the wireless handheld probe assembly, and the transmission of the low-resolution image from the hub to the first display occurs in real time when the ultrasound signal is received via the wireless handheld probe assembly. In a third embodiment of the method, which optionally includes one or both of the first and second embodiments, the electronic device includes one or more of the following: a second display device viewable by a diagnostic clinician, an image archiving and communication system, and a computing device, and each of the following is slower than real time: transmitting a large dataset from the wireless handheld probe assembly to the hub via the higher bandwidth wireless connection, generating the high-resolution image at the hub based on the large dataset, and transmitting the high-resolution image from the hub to the electronic device. In a fourth embodiment of the method, which optionally includes one or both of the first to third embodiments or each of the embodiments, the method further includes: operating the wireless handheld probe assembly to receive the ultrasound signal in a first acquisition mode in response to an active connection between the wireless handheld probe assembly and the hub via the higher bandwidth wireless connection; and operating the wireless handheld probe assembly to receive the ultrasound signal in a second acquisition mode in response to an active connection between the wireless handheld probe assembly and the hub without an active connection via the higher bandwidth wireless connection.In a fifth embodiment of the method, which optionally includes one or both of the first to fourth embodiments, or each of the embodiments, operating the wireless handheld probe assembly in the first acquisition mode includes at least one of the following, compared to operating the wireless handheld probe assembly in the second acquisition mode: acquiring more transmit lines, acquiring the ultrasound signal at a higher pulse repetition frequency, acquiring the ultrasound signal at a higher frame rate, acquiring the ultrasound signal from a larger region of interest, and performing more data processing on the plurality of received digital signals via the processor of the wireless handheld probe assembly. In a sixth embodiment of the method, which optionally includes one or both of the first to fifth embodiments, or each of the embodiments, operating the wireless handheld probe assembly in the second acquisition mode includes storing the larger dataset in the memory of the wireless handheld probe assembly. In a seventh embodiment of the method, which optionally includes one or both of the first to sixth embodiments, or each of the embodiments, the method further includes: selectively establishing the higher bandwidth wireless connection in response to a user request, and wherein the larger dataset is transmitted from the wireless handheld probe assembly to the hub via the higher bandwidth wireless connection in response to establishing the higher bandwidth wireless connection. In an eighth embodiment of the method, which optionally includes one or both of the first to seventh embodiments, or each of the eighth embodiments, the first display is located in the same location as the wireless handheld probe assembly, and the electronic device is located in the same location as or away from the wireless handheld probe assembly. In a ninth embodiment of the method, which optionally includes one or both of the first to eighth embodiments, or each of the ninth embodiments, the first display is included in an augmented reality headset worn by the operator of the wireless handheld probe assembly. In a tenth embodiment of the method, which optionally includes one or both of the first to ninth embodiments, or each of the ninth embodiments, the lower bandwidth wireless connection uses a first frequency band of 7 GHz or lower; and the higher bandwidth wireless connection uses a second frequency band of 60 GHz or higher.
[0082] This disclosure also provides support for a method comprising: establishing a first wireless connection between a wireless handheld probe assembly and an image processing hub; transmitting in real time a first dataset of data acquired by the wireless handheld probe assembly to the image processing hub via the first wireless connection; generating a lower-resolution image in real time at the image processing hub based on the first dataset; transmitting the lower-resolution image in real time from the image processing hub to a display device of an operator of the wireless handheld probe assembly; establishing a second wireless connection between the wireless handheld probe assembly and the image processing hub, the second wireless connection using a different bandwidth than the first wireless connection; transmitting a second dataset of the data acquired by the wireless handheld probe assembly to the image processing hub via the second wireless connection; and generating a higher-resolution image at the image processing hub based on the second dataset, wherein the second dataset includes some or all of the first dataset and additional data acquired by the wireless handheld probe assembly that is not included in the first dataset. In a first embodiment of the method, the first wireless connection uses a first frequency band that has at least one of the following characteristics compared to a second frequency band used for the second wireless connection: lower frequency, lower bandwidth, and less latency. In a second embodiment of the method, optionally including the first embodiment, the first wireless connection is established in response to data acquisition via a wireless handheld probe assembly, and the second wireless connection is established in response to a user request. In a third embodiment of the method, optionally including one or both of the first and second embodiments, a second dataset is transmitted in response to the establishment of the second wireless connection. In a fourth embodiment of the method, optionally including one or both of the first to third embodiments, or each of the embodiments, the method further includes: outputting the higher resolution image to one or more of the following: a second display device, a picture archiving and communication system, a telecomputing device, and a remote display device.
[0083] This disclosure also provides support for a system comprising: one or more memories storing instructions; and at least one processor communicatively coupled to the one or more memories and configured, when executing the instructions, to: establish a first wireless connection between an ultrasound probe and a first electronic device via a low-bandwidth connection in response to initiating an ultrasound examination; transmit a smaller dataset of ultrasound data acquired by the ultrasound probe from the ultrasound probe to the first electronic device via the first wireless connection when ultrasound data has been acquired; establish a second wireless connection between the ultrasound probe and one of the first electronic device and a second electronic device via a higher-bandwidth connection; transmit a larger dataset of ultrasound data from the ultrasound probe to one of the first electronic device and the second electronic device via the second wireless connection; generate a lower-resolution image at the first electronic device based on the smaller dataset and output the lower-resolution image to a first display device in real time; and generate a higher-resolution image at one of the first electronic device and the second electronic device based on the larger dataset. In a first embodiment of the system, the first electronic device is an image processing hub, and the at least one processor, when executing these instructions, is further configured to: establish a second wireless connection between the ultrasound probe and the first electronic device via the higher bandwidth connection; transmit the larger dataset of ultrasound data from the ultrasound probe to the first electronic device via the second wireless connection; generate the higher resolution image at the first electronic device based on the larger dataset; and establish a third wireless connection between the first electronic device and the first display device, located locally at the ultrasound probe, via the lower bandwidth connection. In a second embodiment of the system, optionally including the first embodiment, the first display device is included in the first electronic device, located locally at the ultrasound probe, and the at least one processor, when executing these instructions, is further configured to: transmit the larger dataset of ultrasound data from the ultrasound probe to the second electronic device via the second wireless connection; generate the higher resolution image at the second electronic device based on the larger dataset; store the higher resolution image at the second electronic device; and, in response to a user request to view the higher resolution image, output the higher resolution image from the second electronic device to a second display device remote from the ultrasound probe. In a third embodiment of the system, which optionally includes one or both of the first and second embodiments, in response to receiving a user request, the instruction causes the at least one processor to establish a second wireless connection between the ultrasound probe and one of the first and second electronic devices via the higher bandwidth connection, wherein the lower bandwidth connection uses a lower frequency band, and wherein the higher bandwidth connection uses a higher frequency band.
[0084] In another representation, a method includes: receiving ultrasound signals of a region of interest using a handheld probe assembly; generating a plurality of received digital signals based on the ultrasound signals within the handheld probe assembly; generating a larger dataset and a smaller dataset, respectively, based on the plurality of received digital signals; transmitting the smaller dataset of acquired data to a first electronic device via a low-bandwidth wireless connection; transmitting the larger dataset of acquired data to a second electronic device via a higher-bandwidth wireless connection; generating a low-resolution image based on the smaller dataset at the first electronic device; generating a high-resolution image based on the larger dataset at the second electronic device; and displaying the low-resolution image in real time. In a first embodiment of the method, the first electronic device is one of a personal digital assistant, a smartphone, a tablet computer, and a laptop computer. In a second embodiment of the method, optionally including the first embodiment, the second electronic device stores the generated high-resolution image and, in response to a user request, outputs the generated high-resolution image to a display device.
[0085] When describing elements of various embodiments of this disclosure, the terms “an,” “a,” and “the” are intended to refer to one or more of these elements. The terms “first,” “second,” etc., do not indicate any order, quantity, or importance, but are used to distinguish one element from another. The terms “comprising,” “including,” and “having” are intended to be inclusive and mean that additional elements may exist in addition to the listed elements. As used herein, the terms “connected to,” “linked to,” etc., indicate that an object (e.g., a material, element, structure, component, etc.) may be connected to or linked to another object, regardless of whether the object is directly connected to or linked to the other object, or whether one or more intervening objects exist between the object and the other. Furthermore, it should be understood that references to “an embodiment” or “an embodiment” of this disclosure are not intended to be construed as excluding the existence of additional embodiments that also include the referenced features.
[0086] In addition to any modifications previously indicated, those skilled in the art can devise many other variations and alternative arrangements without departing from the spirit and scope of this description, and the appended claims are intended to cover such modifications and arrangements. Therefore, although the information has been described above in a specific and detailed manner in conjunction with what is currently considered to be the most practical and preferred aspects, it will be apparent to those skilled in the art that many modifications can be made without departing from the principles and concepts set forth herein, including but not limited to changes in form, function, mode of operation, and use. Likewise, as used herein, in all respects, examples and embodiments are intended to be illustrative only and should not be construed as restrictive in any way.
Claims
1. A method for transmitting data acquired via ultrasound, the method comprising: The ultrasonic signal of the region of interest is received using a wireless handheld probe assembly; Within the wireless handheld probe assembly, multiple received digital signals are generated based on the received ultrasound signals; Each of a first dataset and a second dataset is generated based on the plurality of received digital signals, wherein the first dataset is smaller than the second dataset; The first dataset is transmitted from the wireless handheld probe assembly to the hub via a wireless connection with a first bandwidth. The second dataset is transmitted from the wireless handheld probe assembly to the hub via a wireless connection with a second bandwidth, wherein the first bandwidth is lower than the second bandwidth; At the hub, a low-resolution image is generated based on the first dataset and a high-resolution image is generated based on the second dataset; as well as The low-resolution image is transmitted from the hub to the first display and the high-resolution image is transmitted from the hub to the electronic device.
2. The method of claim 1, wherein one or both of the first dataset and the second dataset include beamformed ultrasound images generated at the wireless handheld probe assembly before being transmitted to the hub.
3. The method of claim 1, wherein the first display is viewable by an operator of the wireless handheld probe assembly, and wherein the transmission of the low-resolution image from the hub to the first display occurs in real time when the ultrasound signal is received via the wireless handheld probe assembly.
4. The method of claim 1, wherein the electronic device comprises one or more of the following: a second display device capable of being viewed by a diagnostic clinician, an image archiving and communication system, and a computing device, and wherein each of the following is slower than real-time: transmitting the second dataset from the wireless handheld probe assembly to the hub via a wireless connection of the second bandwidth, generating the high-resolution image at the hub based on the second dataset, and transmitting the high-resolution image from the hub to the electronic device.
5. The method according to claim 1, further comprising: In response to the active connection between the wireless handheld probe assembly and the hub via the second bandwidth wireless connection, the wireless handheld probe assembly is operated in a first acquisition mode to receive the ultrasound signal; as well as In response to the wireless handheld probe assembly and the hub not being actively connected via the second bandwidth wireless connection, the wireless handheld probe assembly is operated in the second acquisition mode to receive the ultrasound signal.
6. The method of claim 5, wherein operating the wireless handheld probe assembly in the first acquisition mode, compared to when the wireless handheld probe assembly is operating in the second acquisition mode, includes at least one of the following: acquiring more transmit lines, acquiring the ultrasound signal at a higher pulse repetition frequency, acquiring the ultrasound signal at a higher frame rate, acquiring the ultrasound signal from a larger region of interest, and performing more data processing on the plurality of received digital signals via a processor of the wireless handheld probe assembly.
7. The method of claim 5, wherein operating the wireless handheld probe assembly in the second acquisition mode includes storing the second dataset in the memory of the wireless handheld probe assembly.
8. The method according to claim 1, further comprising: In response to a user request, a second bandwidth wireless connection is selectively established, and the second dataset is transmitted from the wireless handheld probe assembly to the hub via the second bandwidth wireless connection in response to the establishment of the second bandwidth wireless connection.
9. The method of claim 1, wherein the first display is located at the same location as the wireless handheld probe assembly, and wherein the electronic device is located at the same location as or away from the wireless handheld probe assembly.
10. The method of claim 1, wherein the first display is included in an augmented reality headset worn by an operator of the wireless handheld probe assembly.
11. The method according to claim 1, wherein: The first bandwidth wireless connection uses a first frequency band of 7 GHz or lower; and The second bandwidth wireless connection uses a second frequency band of 60 GHz or higher.
12. A method for transmitting data for ultrasound acquisition, the method comprising: Establish the first wireless connection between the wireless handheld probe assembly and the image processing hub; The first dataset of data collected by the wireless handheld probe assembly is transmitted in real time to the image processing hub via the first wireless connection; A low-resolution image is generated in real time at the image processing hub based on the first dataset. The low-resolution image is transmitted in real time from the image processing hub to the operator's display device of the wireless handheld probe assembly; Establish a second wireless connection between the wireless handheld probe assembly and the image processing hub, wherein the second wireless connection uses a different bandwidth than the first wireless connection; A second dataset of the data acquired by the wireless handheld probe assembly is transmitted to the image processing hub via the second wireless connection; as well as A high-resolution image is generated at the image processing hub based on the second dataset, wherein the second dataset includes some or all of the first dataset and additional data acquired by the wireless handheld probe assembly that is not included in the first dataset.
13. The method of claim 12, wherein the first wireless connection uses a first frequency band, the first frequency band having at least one of the following characteristics compared to a second frequency band used for the second wireless connection: lower frequency, lower bandwidth, and less latency.
14. The method of claim 12, wherein the first wireless connection is established in response to data acquisition via the wireless handheld probe assembly, and wherein the second wireless connection is established in response to a user request.
15. The method of claim 14, wherein the second dataset is transmitted in response to establishing the second wireless connection.
16. The method according to claim 12, further comprising: The high-resolution image is output to one or more of the following: a second display device, a picture archiving and communication system, a remote computing device, and a remote display device.
17. A system for transmitting data from ultrasonic acquisition, the system comprising: One or more memories, wherein the one or more memories store instructions; and At least one processor, communicatively connected to the one or more memories, and configured to, when executing the instructions: In response to the start of an ultrasound examination, a first wireless connection is established between the ultrasound probe and the first electronic device via a first bandwidth connection; When the ultrasound data is acquired, a first dataset of the ultrasound data acquired by the ultrasound probe is transmitted from the ultrasound probe to the first electronic device via the first wireless connection; A second wireless connection is established between the ultrasound probe and one of the first and second electronic devices via a connection with a second bandwidth, wherein the first bandwidth is lower than the second bandwidth. A second dataset of ultrasound data is transmitted from the ultrasound probe to one of the first electronic device and the second electronic device via the second wireless connection, wherein the first dataset is smaller than the second dataset. A low-resolution image is generated at the first electronic device based on the first dataset and the low-resolution image is output to the first display device in real time. as well as A high-resolution image is generated at one of the first electronic device and the second electronic device based on the second dataset.
18. The system of claim 17, wherein the first electronic device is an image processing hub, and the at least one processor is further configured to: A second wireless connection is established between the ultrasound probe and the first electronic device via a connection with the second bandwidth. The second dataset of the ultrasound data is transmitted from the ultrasound probe to the first electronic device via the second wireless connection; The high-resolution image is generated at the first electronic device based on the second dataset; as well as A third wireless connection is established between the first electronic device and the first display device via the first bandwidth connection, wherein the first display device is located locally on the ultrasound probe.
19. The system of claim 17, wherein the first display device is included in the first electronic device, the first electronic device being local to the ultrasound probe, and the at least one processor is further configured to: The second dataset of ultrasound data is transmitted from the ultrasound probe to the second electronic device via the second wireless connection; The high-resolution image is generated at the second electronic device based on the second dataset; The high-resolution image is stored at the second electronic device; as well as In response to a user request to view the high-resolution image, the high-resolution image is output from the second electronic device to a second display device located away from the ultrasound probe.
20. The system of claim 17, wherein in response to receiving a user request, the instruction causes the at least one processor to establish a second wireless connection between the ultrasound probe and one of the first electronic device and the second electronic device via a second bandwidth connection, wherein the first bandwidth connection uses a lower frequency band than the second bandwidth connection uses.