Ultrasonic imaging method, system and computer-readable storage medium
By determining the relationship between the emission condition parameters of the region of interest and the global region in ultrasound imaging technology, the switching of optimized imaging modes is achieved, solving the problems of frame rate reduction and dynamic display in existing technologies, and improving imaging efficiency and user experience.
Patent Information
- Application Number
- CN202310557954.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-09-24
- Publication Date
- 2025-09-12
- Estimated Expiration
- 2041-09-24
AI Technical Summary
While existing ultrasound imaging technology improves the image quality of the region of interest, it easily leads to a decrease in frame rate, making it difficult to achieve dynamic display and adjustment of the region of interest and the global area, and cannot meet various imaging needs.
By determining the region of interest on the initial imaging image, and judging and triggering the corresponding optimized imaging mode based on the relationship between the emission condition parameters of the region of interest and the global region, including the synchronous operation of global region emission parameter adjustment and region of interest enhanced imaging, an optimized imaging image is generated.
It improves imaging efficiency, meets various imaging needs, supports dynamic display and adjustment of regions of interest and global areas, and enhances user experience.
Smart Images

Figure CN116491986B_ABST
Abstract
Description
[0001] Description of the case
[0002] This application is a divisional application based on the Chinese application with the application date of September 24, 2021, application number 202111124331.2, and the invention name of "An ultrasonic imaging method, system and computer-readable storage medium". Technical Field
[0003] This specification relates to the field of ultrasonic diagnostic technology, and in particular to an ultrasonic imaging method, system, and computer-readable storage medium. Background Art
[0004] Ultrasonic diagnosis is a diagnostic method that applies ultrasound technology to the human body. By measuring physiological or tissue structure data and morphology, it can provide clues or guidance for disease detection. Ultrasound diagnosis is a non-invasive, painless, convenient, and intuitive diagnostic method, especially B-ultrasound, which is widely used.
[0005] In practical diagnosis, the imaging quality of ultrasound images (including imaging performance parameters such as image quality and frame rate) is extremely important. Image quality, in particular, can directly impact doctors' diagnostic results and efficiency in many cases. Therefore, improving ultrasound imaging quality has long been a key research topic. Furthermore, in many ultrasound applications, doctors often focus on a specific region of interest (ROI) within the ultrasound image. For example, when imaging a tumor, doctors are particularly interested in the imaging quality of the tumor itself. Therefore, it is necessary to improve the image quality of this region of interest. Summary of the Invention
[0006] One of the embodiments of the present specification provides an ultrasound imaging method, the method comprising: determining a region of interest on an initial imaging image, the initial imaging image including a global imaging region; determining imaging condition data based on the region of interest, the imaging condition data including relationship data between a first emission condition parameter of an effective imaging region of the region of interest and a second emission condition parameter of the global imaging region; determining which optimized imaging mode the imaging condition data conforms to, and triggering an imaging operation under the corresponding optimized imaging mode to generate an optimized imaging image, the optimized imaging mode comprising at least a first optimized imaging mode and a second optimized imaging mode, wherein the first optimized imaging mode refers to an emission parameter adjustment operation covering the global imaging region, and the second optimized imaging mode refers to a synchronous operation of enhanced imaging covering the region of interest and non-enhanced imaging covering the global imaging region.
[0007] One of the embodiments of the present specification provides an ultrasound imaging system, which includes: a region of interest determination module, used to determine a region of interest on an initial imaging image, wherein the initial imaging image includes a global imaging region; an imaging condition data determination module, used to determine imaging condition data based on the region of interest, wherein the imaging condition data includes relationship data between a first emission condition parameter of an effective imaging area of the region of interest and a second emission condition parameter of the global imaging area; an optimized imaging image generation module, used to determine which optimized imaging mode the imaging condition data conforms to, and trigger an imaging operation under the corresponding optimized imaging mode to generate an optimized imaging image; the optimized imaging mode includes at least a first optimized imaging mode and a second optimized imaging mode, wherein the first optimized imaging mode refers to an emission parameter adjustment operation covering the global imaging area, and the second optimized imaging mode refers to a synchronous operation of enhanced imaging covering the region of interest and non-enhanced imaging covering the global imaging area.
[0008] One of the embodiments of this specification provides a computer-readable storage medium, which stores computer instructions. When a computer reads the computer instructions in the storage medium, the computer executes the method described in any embodiment of this specification.
[0009] The ultrasound imaging method, system and computer-readable storage medium provided in the embodiments of this specification have at least the following beneficial effects: (1) comprehensively considering the relationship between image quality and factors affecting the overall imaging efficiency such as frame rate and emission time, analyzing and judging the corresponding imaging condition data of the selected ROI for imaging requirements or diagnostic requirements of different imaging conditions, determining which optimized imaging mode it meets, and triggering the applicable corresponding optimized imaging mode, thereby providing a corresponding imaging solution with high adaptability, which not only improves the imaging efficiency but also meets a variety of different imaging requirements, thereby providing the best imaging solution while overcoming the defects of previous technical solutions; (2) supporting The adaptive enhancement of the imaging mode of the global area in which the region of interest (hereinafter referred to as ROI) and other areas outside the region can be dynamically displayed and adjusted at the same time makes it easier for users to view and adjust the imaging images during detection or diagnosis, thereby greatly improving the user experience; (3) Since the calculations involved in the ultrasound imaging process such as the selection of the region of interest or the calculation of the imaging condition data can be calculated and stored in a pre-set manner, and an interactive method (such as an interactive interface, etc.) can be provided only when the user needs it for the user to dynamically adjust and then calculate, it not only ensures a small amount of calculation, but also meets the user's real-time interaction and dynamic adjustment needs during imaging, further improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0010] This specification will be further described in the form of exemplary embodiments, which will be described in detail with reference to the accompanying drawings. These embodiments are not limiting, and in these embodiments, like numbers represent like structures, wherein:
[0011] Figure 1 is a schematic diagram of an application scenario of an ultrasound imaging system according to some embodiments of this specification;
[0012] Figure 2 is an exemplary flow chart of an ultrasound imaging method according to some embodiments of the present specification;
[0013] Figure 3 is an exemplary flow chart of an ultrasound imaging method according to some embodiments of the present specification;
[0014] Figures 4a to 4c This is an example diagram of determining ROI through touch screen and / or non-touch screen operation instructions according to some embodiments of this specification;
[0015] Figure 5 is an exemplary flow chart of determining imaging condition data according to a region of interest according to some embodiments of this specification;
[0016] Figures 6a to 6b is an example of the desired focus for emission in the global imaging region according to some embodiments of this specification;
[0017] Figures 7a and 7b is an example of the desired focus for emission in the global imaging region according to some embodiments of this specification;
[0018] Figure 8 This is an exemplary flow chart for determining which optimized imaging mode imaging condition data conforms to and triggering an imaging operation in the corresponding optimized imaging mode according to some embodiments of this specification;
[0019] Figures 9a to 9b is an example diagram of transmission parameter adjustment according to some embodiments of this specification;
[0020] Figures 10a to 10c is an example diagram of transmission parameter adjustment according to some embodiments of this specification;
[0021] Figures 11a to 11d is an example diagram of transmission parameter adjustment according to some embodiments of this specification;
[0022] Figure 12 is an example diagram of enhanced imaging operations covering a region of interest according to some embodiments of this specification;
[0023] Figure 13is an example diagram of an image composite operation of an enhanced image and a global image according to some embodiments of this specification;
[0024] Figures 14a to 14c is an example diagram of an operation node for an image composite operation of an enhanced image and a global image according to some embodiments of this specification;
[0025] Figure 15 is an example diagram of an optimized imaging setting interface according to some embodiments of this specification;
[0026] Figure 16 This is an example diagram of the composition of an ultrasound imaging system according to some embodiments of this specification. DETAILED DESCRIPTION
[0027] To more clearly illustrate the technical solutions of the embodiments of this specification, the following briefly describes the drawings required for describing the embodiments. Obviously, the drawings described below are merely examples or embodiments of this specification. Those skilled in the art can apply this specification to other similar scenarios based on these drawings without inventive effort. Unless otherwise apparent from the context or otherwise noted, the same reference numerals in the figures represent the same structure or operation.
[0028] It should be understood that the terms "system," "device," "unit," and / or "module" used herein are a method for distinguishing different components, elements, parts, portions, or assemblies at different levels. However, if other terms can achieve the same purpose, the terms may be replaced by other expressions.
[0029] As used in this specification and claims, unless the context clearly indicates otherwise, the words "a," "an," "an," and / or "the" do not refer to the singular but also include the plural. Generally speaking, the terms "comprises" and "include" only indicate the inclusion of the steps and elements specifically identified, and these steps and elements do not constitute an exclusive list. A method or apparatus may also include other steps or elements.
[0030] Flowcharts are used throughout this specification to illustrate the operations performed by systems according to embodiments of this specification. It should be understood that preceding or following operations do not necessarily need to be performed in exact order. Instead, the steps may be processed in reverse order or simultaneously. Furthermore, other operations may be added to these processes, or one or more operations may be removed from these processes.
[0031] In the past, although there were schemes for local enhancement or independent imaging of the region of interest by increasing the number of transmissions, transmission time, etc., on the one hand, they only focused on the transmission enhancement of the local area of the image, especially the use of focused transmission. Blindly increasing the transmission line density or the number of transmission focal points may lead to problems such as a large number of transmissions, long time consumption and reduced frame rate. On the other hand, whether freezing other image areas outside the region of interest and only enhancing the imaging of the region of interest, or displaying only part of the image of the region of interest through front-end scaling, it is not conducive to viewing the relationship between the region of interest and other areas during ultrasonic detection or ultrasonic diagnosis, and it is even more difficult to achieve the high demand for dynamic adjustment and dynamic display of global regional images including the region of interest in ultrasonic diagnosis.
[0032] In general, traditional solutions have not comprehensively considered the mutual influence between image quality and frame rate, emission time, etc., which ultimately affect the overall imaging efficiency, so as to provide corresponding imaging solutions with high adaptability for different imaging conditions or diagnostic needs, which can not only improve imaging efficiency but also meet a variety of different imaging needs. In this way, while overcoming the defects of previous technical solutions, the best imaging solution is provided to meet the needs of various ultrasound imaging and / or ultrasound diagnosis scenarios.
[0033] The embodiments of this specification can perform corresponding analysis and judgment according to different imaging conditions or real-time imaging requirements, and perform optimized imaging operations adapted thereto based on the analysis and judgment results. This not only improves image quality without losing frame rate and with less computational effort, but also improves overall imaging efficiency. It also supports adaptive enhancement of the region of interest (hereinafter referred to as ROI) and other areas thereof for simultaneous dynamic display, and supports dynamic adjustment imaging of the global area. Therefore, it has broad application prospects in the field of ultrasonic diagnosis.
[0034] Figure 1 Shown is a schematic diagram of an application scenario of the ultrasound imaging system 100 according to some embodiments of this specification.
[0035] like Figure 1 As shown, the application scenario may include an ultrasound device 110 , a processor 120 , a storage device 130 , a terminal 140 and a network 150 .
[0036] The ultrasound device 110 can be used to scan an object for diagnostic imaging. The ultrasound device 110 can be used to view image information of the object's internal body tissue to assist doctors in diagnosing diseases. The ultrasound device 110 can send higher frequency sound waves (e.g., ultrasound waves) to the object through a probe to produce an ultrasound image. In some embodiments, the object may include a biological object and / or a non-biological object. For example, the object may include a specific part of the human body, such as the neck, chest, abdomen, etc., or a combination thereof. For another example, the object may be a patient to be scanned by the ultrasound device 110. In some embodiments, the ultrasound image may include at least one of a brightness mode (B-mode) image, a color mode (C-mode) image, a motion mode (M-mode) image, a Doppler mode (D-mode) image, and an elastic imaging mode (E-mode) image. In some embodiments, the ultrasound image may include a two-dimensional (2D) image or a three-dimensional (3D) image.
[0037] The ultrasound device 110 can be used for data acquisition, processing and / or output, positioning and other functions. The ultrasound device 110 may include one or more sub-functional devices (for example, a single sensor device or a sensor system device composed of multiple sensor devices). In some embodiments, the ultrasound device 110 may include but is not limited to an ultrasound transmitting unit (for example, including an ultrasound transducer, etc.), an ultrasound imaging unit, a radio frequency sensing unit, an NFC communication unit, an image acquisition unit, an image display unit, an audio output unit, etc. or any combination thereof. Exemplarily, the ultrasound imaging unit can be used for processing received signals, including filtering, demodulation, beamforming and other data processing that may be involved in the ultrasound imaging process. Exemplarily, the image display unit can be used to optimize the display of the imaging image. Exemplarily, the ultrasound device 110 can be controlled by its information input module ( Figure 1 (not shown) to collect imaging object information and receive imaging operation instruction information. For example, the ultrasound device 110 may also receive imaging object information and / or imaging operation instruction information sent from the terminal 140 or the processor 120 via the network 150, and may send intermediate imaging result data or optimized imaging images to the processor, storage device 130, or terminal 140.
[0038] The processor 120 can process data and / or information obtained from other devices or system components. The processor 120 can execute program instructions based on this data, information and / or processing results to perform one or more functions described in this application, such as filtering, demodulation, beamforming, and other data processing that may be involved in the ultrasound imaging process. In some embodiments, the processor 120 can receive intermediate imaging result data or optimized imaging images from the ultrasound device 110, for example, receive intermediate imaging result data after filtering, and for example receive the final optimized imaging image completed by the ultrasound device 110, and perform corresponding ultrasound diagnostic analysis operations based on the optimized imaging image and a preset ultrasound diagnostic analysis program.
[0039] In some embodiments, the processor 120 may include one or more sub-processing devices (e.g., a single-core processing device or a multi-core multi-core processing device). By way of example only, the processor 120 may include a central processing unit (CPU), an application-specific integrated circuit (ASIC), an application-specific instruction set processor (ASIP), a graphics processing unit (GPU), a physical processing unit (PPU), a digital signal processor (DSP), a field programmable gate array (FPGA), a programmable logic device (PLD), a controller, a microcontroller unit, a reduced instruction set computer (RISC), a microprocessor, or any combination thereof.
[0040] In some embodiments, the ultrasound device 110, the terminal 140 and other possible system components may include a processor 120. For example, the processor 120 or a functional module that can realize the functions of the processor 120 can be integrated into the ultrasound device 110, the terminal 140 and other possible system components.
[0041] In some embodiments, one or more components of the ultrasound imaging system 100 may transmit data to other components of the ultrasound imaging system 100 via the network 150. For example, the processor 120 may obtain information and / or data from the terminal 140, the ultrasound device 110, and the storage device 130 via the network 150, or may send information and / or data to the terminal 140, the ultrasound device 110, and the storage device 130 via the network 150.
[0042] The storage device 130 can be used to store data and / or instructions. Data refers to a digital representation of information and can include various types, such as binary data, text data, image data, and video data. Instructions refer to programs that control a device or component to perform specific functions. For example, the storage device 130 can store various possible data and / or programs involved in the ultrasound imaging process, such as initial imaging image data, imaging condition data, optimized imaging data, touchscreen operation instructions, and / or preset machine learning algorithms.
[0043] The storage device 130 may include one or more storage components, each of which may be a standalone device or part of another device. In some embodiments, the storage device 130 may include random access memory (RAM), read-only memory (ROM), mass storage, removable memory, volatile read-write memory, or the like, or any combination thereof. Exemplarily, the mass storage may include a magnetic disk, an optical disk, a solid-state disk, or the like. In some embodiments, the storage device 130 may be implemented on a cloud platform. By way of example only, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an internal cloud, a multi-layer cloud, or the like, or any combination thereof.
[0044] Terminal 140 refers to one or more terminal devices or software used by a user. Terminal 140 may include a processing unit, a display unit, an input / output unit, a sensing unit, a storage unit, etc. The sensing unit may include, but is not limited to, a light sensor, a distance sensor, an acceleration sensor, a gyroscope sensor, a sound detector, etc., or any combination thereof.
[0045] In some embodiments, terminal 140 may be any one of a mobile device 140-1, a tablet computer 140-2, a laptop computer 140-3, a desktop computer 140-4, or any combination thereof. In some embodiments, terminal 140 may be used by one or more users, including users who directly use the service or other related users.
[0046] The above examples are only used to illustrate the wide range of the terminal 140 device and are not intended to limit its scope.
[0047] The network 150 can connect the various components of the system and / or connect the system with external resources. The network 150 enables communication between the various components and with other components outside the system, facilitating the exchange of data and / or information. In some embodiments, the network 150 can be any one or more of a wired network or a wireless network. For example, the network 150 can include a cable network, a fiber optic network, a telecommunications network, the Internet, a local area network (LAN), a wide area network (WAN), a wireless local area network (WLAN), a metropolitan area network (MAN), a public switched telephone network (PSTN), a Bluetooth network, a ZigBee network, near-field communication (NFC), an in-device bus, an in-device line, a cable connection, or any combination thereof. The network connection between the various components can adopt one of the above methods or multiple methods. In some embodiments, the network can be a point-to-point, shared, centralized, or other topological structure, or a combination of multiple topological structures. In some embodiments, the network 150 can include one or more network access points. For example, the network 150 may include wired or wireless network access points, such as base stations and / or network switching points, through which one or more components entering and exiting the ultrasound imaging system 100 may connect to the network 150 to exchange data and / or information.
[0048] It should be noted that the above description of the ultrasound imaging system 100 is for convenience only and does not limit the present specification to the scope of the embodiments described. It is understood that those skilled in the art, after understanding the principles of the system, may arbitrarily combine the modules or form subsystems connected to other modules without departing from the principles. In some embodiments, Figure 16 The region of interest determination module 410, imaging condition data determination module 420 and optimized imaging image generation module 430 disclosed in the can be implemented in the ultrasound device 110 and / or the processor 120. In some embodiments, Figure 16 The region of interest determination module 410, imaging condition data determination module 420, and optimized imaging image generation module 430 disclosed herein may be separate modules within a system, or a single module may implement the functions of two or more of the aforementioned modules. For example, the modules may share a storage module, or each module may have its own storage module. Such variations are within the scope of protection of this specification.
[0049] Figure 2 is an exemplary flow chart of an ultrasound imaging method according to some embodiments of the present specification. Figure 3 FIG. 1 is an exemplary flow chart of an ultrasound imaging method according to some embodiments of the present specification. Figure 2 and Figure 3As shown, the process 200 may include the following steps. In some embodiments, the process 200 may be executed by the ultrasound device 110 or the processor 120.
[0050] Step 210 : Determine a region of interest on the initial imaging image, where the initial imaging image includes the global imaging area. In some embodiments, step 210 may be performed by the region of interest determination module 410 .
[0051] Step 220 , determining imaging condition data based on the region of interest. In some embodiments, step 220 may be performed by the imaging condition data determining module 420 .
[0052] Step 230 determines which optimized imaging mode the imaging condition data corresponds to, triggers imaging operations in the corresponding optimized imaging mode, and generates an optimized imaging image. The optimized imaging modes include at least a first optimized imaging mode and a second optimized imaging mode. The first optimized imaging mode involves adjusting emission parameters over the entire imaging area, while the second optimized imaging mode involves simultaneous enhanced imaging over the region of interest and non-enhanced imaging over the entire imaging area. In some embodiments, step 230 may be performed by the optimized imaging image generation module 430.
[0053] In some embodiments, step 230 may include the following sub-steps:
[0054] Sub-step 231 , determining which optimized imaging mode the imaging condition data matches, and then determining whether to trigger the first optimized imaging mode or the second optimized imaging mode based on the determination result;
[0055] When it is determined that the first optimization mode is triggered, enter sub-step 232a: perform emission parameter adjustment operations covering the global imaging area to generate a corresponding optimized imaging image; when it is determined that the second optimization mode is triggered, enter sub-step 232b: perform synchronous operations of enhanced imaging covering the area of interest and non-enhanced imaging covering the global imaging area to generate a corresponding optimized imaging image.
[0056] By comprehensively considering the relationship between image quality and factors that affect the overall imaging efficiency, such as frame rate and emission time, and targeting imaging requirements or diagnostic requirements of different imaging conditions, the corresponding imaging condition data of the selected ROI is analyzed and judged to determine which optimized imaging mode it meets, and the applicable corresponding optimized imaging mode is triggered, thereby providing corresponding imaging solutions with high adaptability, which not only improves imaging efficiency but also meets a variety of different imaging requirements, thereby providing the best imaging solution while overcoming the defects of previous technical solutions.
[0057] An initial imaging image refers to a preliminary imaging image before optimized imaging is performed. The initial imaging image may include a global imaging region, which refers to a relatively wide ultrasound imaging area within the initial imaging image. This allows ultrasound testing or diagnosis to view a wider range of imaging regions, including possible ROIs and their surrounding areas. For example, when performing initial ultrasound imaging of a diseased tissue or organ, the initial imaging image obtained includes not only all possible ROIs for ultrasound testing or diagnosis, but also relevant surrounding areas outside of these ROIs.
[0058] In some embodiments, the region of interest determination module 410 may acquire an initial imaging image.
[0059] In some embodiments, the initial imaging image can be generated by the ultrasound device 110. In some embodiments, the ultrasound device 110 transmits an ultrasonic pulse to the target to be detected, receives the ultrasonic echo signal reflected by the target to be detected, and performs imaging processing on the received ultrasonic echo signal and then outputs the initial imaging image. In some embodiments, the aforementioned imaging processing may include at least one or more of filtering processing, demodulation processing, beam synthesis processing, composite imaging processing (such as line compounding, frequency compounding, spatial compounding, etc.), envelope processing, logarithmic imaging processing, and image post-processing (such as grayscale processing, speckle noise suppression, edge refinement, etc.). In some embodiments, the initial imaging submodule ( Figure 16 (not shown) to generate an initial imaging image.
[0060] In some embodiments, the initial imaging image can be obtained from the processor 120, the storage device 130 or the terminal 140. For example, the pre-generated initial imaging image can be stored by the storage device 130. For another example, the corresponding initial ultrasound image can be obtained from a patient user terminal, an ultrasound detection or diagnosis user terminal (for example, a user terminal of a patient that stores historical ultrasound detection results, a user terminal of an ultrasound detection personnel, or a user terminal of a diagnostic doctor).
[0061] In some embodiments, the initial imaging image may be obtained from the ultrasound imaging system 100 ( Figure 1 The initial image may be obtained from any possible system component (shown or not shown), such as a cloud server or backend system. In some embodiments, the initial image may be obtained from a system other than the ultrasound imaging system 100, such as from one or more hospital medical systems that have business or data connections with the ultrasound imaging system 100. It should be noted that the above methods for obtaining the initial image are merely examples and are not particularly limited in the embodiments of this specification.
[0062] In some embodiments, the ROI can be determined using at least one of an artificial intelligence automatic recognition algorithm, an automatic tracking algorithm, and touchscreen and / or non-touchscreen operation instructions. The artificial intelligence automatic recognition algorithm or automatic tracking algorithm has the advantages of fast and efficient ROI determination; while the touchscreen and / or non-touchscreen operation instructions can meet the dynamic adjustment of ROI determination and the user's personalized needs for ROI determination, thereby improving interactivity. In some embodiments, the ROI can be determined using a combination of artificial intelligence automatic recognition algorithms, automatic tracking algorithms, and touchscreen and / or non-touchscreen operation instructions. Specifically, various combinations can be configured based on actual needs, thereby combining the advantages of each method to improve ROI efficiency while meeting the ROI selection needs of users in various scenarios.
[0063] In some embodiments, the ROI can be any area within the global imaging area. In some embodiments, the ROI can be composed of multiple local ROIs. In some embodiments, the ROI can be a closed shape (such as a rectangle) or a non-closed shape (such as a line segment). In some embodiments, the closed shape can be a regular shape (such as a square) or an irregular shape.
[0064] In some embodiments, a preset machine learning algorithm (e.g., a deep learning algorithm) can be used to automatically identify the ROI to determine the ROI. In some embodiments, a preset target detection model can be used to track and record the initially selected or drawn ROI. Even if the probe changes, the ROI can still be automatically tracked, thereby improving the efficiency of ROI determination. In some embodiments, the aforementioned preset target detection model can be SSD (Single Shot MultiBox Detector), Faster R-CNN (Faster Region-Convolutional Neural Network), YOLO (You Only Look Once) or any other feasible target detection model.
[0065] In some embodiments, a preset feature detection method and a preset feature matching method can be used to detect and match image features (e.g., feature points, feature lines, feature regions, etc.) to determine the ROI. In some embodiments, the preset feature detection method can be a SIFT (Scale Invariant Feature Transform) operator, a SURF (Speeded Up Robust Feature) operator, a FAST (Features from Accelerated Segment Test), an LBP (Local Binary Pattern) operator, a HOG (Histogram of Oriented Gradient) operator, or any other feasible feature detection method, and the preset feature matching method can be a RANSAC (RANdom SAmple Consensus) algorithm, an ORB (Oriented FAST and Rotated BRIEF) algorithm, or any other feasible feature detection method.
[0066] In some embodiments, a preset template matching method can be directly used to find an area matching the ROI in the initial image, and the ROI can be determined by tracking the ROI. In some embodiments, the preset template matching method can be a contour-based template matching algorithm, an edge gradient-based template matching algorithm, or any other feasible template matching algorithm.
[0067] In some embodiments, the ROI can be determined by touch screen and / or non-touch screen operation instructions. In some embodiments, the touch screen and / or non-touch screen operation instructions can include touch screen drawing control instructions, trackball control instructions, air gesture drawing control instructions, and / or any other feasible input operation instructions.
[0068] Figures 4a to 4c This is an example diagram of determining ROI through touch screen and / or non-touch screen operation instructions according to some embodiments of this specification, wherein the area enclosed by the outermost boundary line of each image (i.e., the entire image area displayed by the initial imaging image) can be regarded as the global imaging area of the initial imaging image.
[0069] For example, Figure 4aAs shown, when the ROI of the ultrasound user or doctor is a single area, the ROI determination module 410 receives a touchscreen operation instruction (e.g., manual drawing) input by the ultrasound user or doctor, and draws a line connecting the end and the end within the effective imaging area (shown as a solid line in the figure) according to the touchscreen operation instruction, thus forming a closed shape. The drawn trajectory line (shown as a dotted line in the figure) is the boundary of the ROI. Here, the closed shape of the ROI can be any regular or irregular shape.
[0070] Wherein, the effective imaging area refers to the actual imaging area including the ROI, so as to ensure the imaging effect within the ROI. In some embodiments, the area of the effective imaging area is equal to the area of the ROI. In some embodiments, the area of the effective imaging area is greater than the area of the ROI. In some embodiments, the ratio of the area of the effective imaging area to the area of the ROI is in the range of 1.5 to 2.0, preferably 1.8, to avoid incomplete imaging of the edge of the ROI, while reducing the imaging of the non-ROI area, preventing redundant calculations, and reducing the amount of calculation. In some embodiments, the effective imaging area can be a closed shape (such as an ellipse) or a non-closed shape (such as a curved line segment). In some embodiments, the aforementioned closed shape can be a regular shape (such as a rhombus) or an irregular shape. In some embodiments, the closed shape or non-closed shape of the effective imaging area can be similar to or consistent with the closed shape or non-closed shape of the ROI.
[0071] For example, Figure 4b As shown, when the region of interest of the ultrasound user or doctor is an elongated area, the region of interest determination module 410 receives a non-touchscreen operation instruction (such as a trackball or air gesture drawing instruction) input by the ultrasound user or doctor, and draws a curved line segment covering the ROI within the effective imaging area (as shown by the solid line in the figure) based on the non-touchscreen operation instruction (when drawing a closed shape is inconvenient). In some embodiments, a trackball can be used to mark ROI key points or directly draw the corresponding shape of the ROI.
[0072] For example, Figure 4cAs shown, when the ultrasound detection user or doctor user implements random or dynamic adjustment to the selected ROI, the region of interest determination module 410 can receive touch screen and / or non-touch screen operation instructions input by the ultrasound detection user or doctor user (such as manual touch screen click, trackball click or non-touch screen default option instruction selection, etc.), and the image display and control interface will default to a regular shape (such as a rectangle, circle or ellipse and other regular shapes) as shown in the solid line frame in the figure, and then adjust along the illustrated arrow to the area shown in the dotted box in the figure according to the received touch screen swiping instruction or air swiping instruction, so as to adjust the ROI area size according to the user's (for the sake of simplicity, the following may include any possible imaging requirement user group such as ultrasound detection users, patient users, diagnostic users or doctor users, referred to as users) needs through corresponding operation instructions. For example, when using a trackball to select an ROI, you can first press the OK key to determine the starting point. A default rectangular area centered on the starting point will appear on the image display and control interface. Then, roll the trackball based on this rectangular area. The drawn area will expand or shrink as the trackball rolls. Finally, press the OK key to determine the end point, and the ROI selection is complete.
[0073] In some embodiments, the effective imaging area is determined in a manner similar to the ROI in the image display and control interface. For details, please refer to the aforementioned specific ROI selection method and process, which will not be repeated here.
[0074] It should be noted that the aforementioned method of determining the ROI or effective imaging area is merely exemplary and should not be construed as limiting the present application. Without departing from the inventive concept of the present application, any feasible method may be used to determine the ROI or effective imaging area.
[0075] In step 220 , imaging condition data may be determined based on the region of interest.
[0076] Imaging condition data refers to imaging condition parameters used to determine which optimized imaging mode is applicable to the currently selected ROI. In some embodiments, the imaging condition data may include corresponding parameter data that can reflect the characteristics of the currently selected ROI (such as the size of the ROI region). In some embodiments, the imaging condition data may include the ROI area value. In some embodiments, the imaging condition data may include the ratio of the ROI area to the global imaging region area.
[0077] In some embodiments, the imaging condition data may include emission condition parameters for the ROI. In some embodiments, the imaging condition data may include emission condition parameters for the ROI and emission condition parameters for the effective imaging area. Emission condition parameters refer to corresponding condition parameters that meet the requirements of a specific optimized imaging mode. In some embodiments, the emission condition parameters may include the number of focal points, number of transmissions, or transmission interval (i.e., the time interval from the last transmission to the start of the next transmission) required for the currently selected ROI transmission, etc. For example, the number of focal points, number of transmissions, transmission time, etc. required for different ROIs in a conventional focus transmission mode can be determined based on historical record data.
[0078] In some embodiments, the imaging condition data may include relationship data between the emission condition data of the ROI and the emission condition data of the global imaging area. In some embodiments, the relationship data between the emission condition data of the ROI and the emission condition data of the global imaging area may include a difference, a ratio, or any other possible relationship data between the emission condition data of the ROI and the emission condition data of the global imaging area, such as the ratio of the number of focal points required for conventional emission of the current ROI to the number of focal points required for conventional emission of the global imaging area, calculated according to a preset imaging condition calculation program. Conventional emission may be an emission mode of focused emission, diverging wave emission, wide beam emission, or any other possible waveform, or a hybrid emission mode of the aforementioned emission modes.
[0079] In some embodiments, the imaging condition data may include relationship data between the emission condition data of the effective imaging area of the ROI and the emission condition data of the global imaging area. In some embodiments, the relationship data between the emission condition data of the effective imaging area of the ROI and the emission condition data of the global imaging area may include a difference, a ratio, or any other possible relationship data between the emission condition data of the effective imaging area of the ROI and the emission condition data of the global imaging area.
[0080] In some embodiments, the imaging condition data may be pre-calculated by a preset imaging condition calculation program based on historically selected ROI region feature data and stored in the imaging condition data determination module 420, the storage device 130, or the ultrasound device 110. In some embodiments, the imaging condition data may trigger the preset imaging condition calculation program to perform real-time calculations based on the currently selected ROI region.
[0081] Figure 5 This is an exemplary flow chart of determining imaging condition data according to a region of interest according to some embodiments of this specification.
[0082] like Figure 5 As shown, the above step 220 can be implemented as the following sub-steps:
[0083] Step 2201: Calculate the effective imaging area of the region of interest according to the region of interest;
[0084] Step 2202: Calculate first emission condition parameters covering the effective imaging area according to the effective imaging area;
[0085] Step 2203: Determine the relationship data between the first emission condition parameter of the effective imaging area and the second emission condition parameter of the global imaging area.
[0086] The first and second emission condition parameters each include at least the number of focal points or the number of shots. Since these are the data parameters that best reflect the emission conditions during imaging, selecting at least the number of focal points or the number of shots as the first emission condition parameter for the effective imaging area and the second emission condition parameter for the global imaging area, and then acquiring the relationship data between the two, allows for accurate and efficient determination of imaging condition data, ensuring the reliability of data acquisition. In some embodiments, the first and second emission condition parameters may also each include, for example, the shot interval.
[0087] Refer again Figure 4a In some embodiments, step 2201 may be implemented in the following exemplary manner: after the ROI is selected, the effective imaging area is calculated based on a preset ratio range (e.g., 1.5 to 1.8) between the effective imaging area and the ROI area, and then the effective imaging area is determined based on the effective imaging area through touch screen and / or non-touch screen operation instructions, such as Figure 4a Regular shapes that meet the area requirements, such as the solid rectangle shown in .
[0088] Refer again Figure 4b In some embodiments, step 2201 may be implemented as follows: when the selected ROI is a non-closed shape, such as a non-closed line segment, the non-closed shape is thickened within a preset area multiple threshold range (such as 1.8 to 2.0, or greater than 2.0) through touch screen and / or non-touch screen operation instructions, thereby determining the effective imaging area, such as Figure 4b Irregular shapes such as the solid line strip shown in the figure that meet the area requirements.
[0089] Therefore, the effective imaging area determined by the selected ROI can be selected as long as the shape area of its outward expansion meets the preset area requirement. The specific shape, whether closed or non-closed, or regular or irregular, can be selected according to the specific needs of the ultrasound detection user or doctor user.
[0090] In some embodiments, step 2202 may be implemented in the following manner:
[0091] The number of focal points required to cover the effective imaging area is calculated by formula (1), which is expressed as Sroi.
[0092]
[0093] Where Worg is the width of the global imaging area, Wroi is the width of the effective imaging area, Sorg is the number of emissions required for the global imaging area, and ts is the proportional coefficient.
[0094] Figure 6a is an example of the desired focus for emission in the global imaging area according to some embodiments of the present specification. Figure 6b is an example of the focal point required for emission of the effective imaging area according to some embodiments of the present specification.
[0095] Here we take the focused emission mode as an example. Figure 6b The solid-lined area shown is the effective imaging area of the ROI. The focal points are distributed within the effective imaging area, and line scanning imaging is used. The width of the effective imaging area, Wroi, can be calculated using the effective imaging area calculation method described above. Furthermore, the width of the global imaging area, Worg, and the number of required global imaging area emissions, Sorg, can be equal to the width and number of emissions of the initial image.
[0096] Figure 7a is an example of the desired focus for emission in the global imaging area according to some embodiments of the present specification. Figure 7b is an example of the focal point required for emission of the effective imaging area according to some embodiments of the present specification.
[0097] and Figure 6a 、 Figure 6b The focal points shown are distributed differently within the effective imaging area. Figure 7a 、 Figure 7b The focal points shown are distributed outside the effective imaging area, and an appropriate transmission aperture is selected so that more of the acoustic wave energy is covered in the effective imaging area. This requires fewer transmissions than if the focal points are distributed within the effective imaging area. Figure 7a As shown by the middle focus F1, fewer focal points are required at this time.
[0098] First, determining the focus position can be implemented as follows:
[0099] The center of the effective imaging area (i.e. Figure 7aAn ellipse is constructed (centered on the rectangular area). The major and minor axes of the ellipse can be 1.5-2 times the width and height of the rectangular area, respectively. The focal points are located below the effective imaging area and evenly distributed on the ellipse. The distance between the two outermost focal points can be greater than the width of the effective imaging area. The array directly above the effective imaging area is selected as the transmit aperture, which achieves the best directivity of the transducer elements. In this example, the transmit aperture size is slightly larger than the width of the effective imaging area. The actual transmit aperture size can be determined and set based on the desired effect.
[0100] Each emission can cover part of the effective imaging area, such as Figure 7b As shown, assuming that the white shadow area AF is the effective emission area of the focus F, the effective imaging area can be expressed as Aroi, then the intersection of the two areas is the area where the emission of the focus F can be imaged (hereinafter referred to as the actual imaging area of the focus F), such as the area AF1 surrounded by the black line segment in 7b. The actual imaging areas of other focuses are calculated in the same way. When the union of the actual imaging areas of all focuses is Aroi, it means that the emission at this time can cover the effective imaging area. The number of focuses required to meet the above conditions is calculated as follows: calculate the minimum length that the middle focus can cover in the effective imaging area, that is, the line segment mn obtained by the intersection of the two irradiation boundaries of the focus and the boundary of the effective imaging area. Specifically, mn is calculated using the following calculation formula (2):
[0101]
[0102] Wherein, Ls is the distance from the focus F1 to the nearest boundary of the effective imaging area, Lt is the distance from the focus F1 to the transducer, and the size of the transmitting aperture is St.
[0103] Furthermore, the number of transmissions required for the effective imaging area can be calculated using the following formula (3):
[0104]
[0105] Where Wroi is the width of the effective imaging area, and ts is the same as in the calculation formula (1) and is also the proportional coefficient.
[0106] In some embodiments, the above step 2203 may be implemented as follows:
[0107] Since the main parameters affecting the frame rate in the ultrasound system are the detection depth and the number of transmissions required for imaging a frame of image, the maximum frame rate of the system (maximum frame rate is expressed as forg) can be calculated using the following formula (4):
[0108]
[0109] Where d is the detection depth, Sorg is the number of transmissions required for an initial imaging frame covering the global imaging area, and c is the speed of sound.
[0110] When the number of transmissions required for the effective imaging area Sroi is calculated by formula (1) or formula (3), if imaging of the effective imaging area is performed, the minimum frame rate of the system (the minimum frame rate is expressed as froi) can be calculated by the following formula (5):
[0111]
[0112] Furthermore, the ratio of the frame rate after quality optimization imaging of the effective imaging area to the frame rate of the global imaging area (the ratio is represented by r), that is, the relationship data between the first emission condition parameter of the effective imaging area and the second emission condition parameter of the global imaging area, can be calculated by the following calculation formula (6):
[0113]
[0114] Figure 8 This is an exemplary flowchart for determining which optimized imaging mode imaging condition data conforms to and triggering imaging operations under the corresponding optimized imaging mode according to some embodiments of this specification.
[0115] like Figure 8 As shown, the above step 230 may include the following sub-steps:
[0116] Sub-step 2301, determining whether the relationship data between the first emission condition parameter of the effective imaging area and the second emission condition parameter of the global imaging area is less than a threshold;
[0117] Sub-step 2302a, in response to the relationship data being less than a threshold, triggering an imaging operation in a first optimized imaging mode, including: adjusting transmission parameters under a condition that a frame rate requirement is met, so that the acoustic wave energy of the region of interest is enhanced;
[0118] Sub-step 2302b, in response to the relationship data being not less than a threshold, triggering an imaging operation in a second optimized imaging mode, including: synchronous operation of enhanced imaging covering the region of interest and non-enhanced imaging covering the global imaging region, so as to respectively obtain an enhanced image of the region of interest and a global image of the global imaging region; and performing an image composite operation on the enhanced image and the global image.
[0119] In some embodiments, the above-mentioned sub-step 2302a can be implemented in the following example manner: in response to the relationship data being less than a threshold, triggering the imaging operation in the first optimized imaging mode, including: adjusting the emission parameters while meeting the frame rate requirements, maintaining the original acoustic wave energy of the global imaging area while enhancing the acoustic wave energy of the area of interest.
[0120] In some embodiments, the above-mentioned sub-step 2302a can be implemented in the following example manner: in response to the relationship data being less than a threshold, triggering the imaging operation in the first optimized imaging mode, including: adjusting the emission parameters while meeting the frame rate requirements so that the acoustic wave energy of the global imaging area including the area of interest is enhanced.
[0121] Due to the relationship between the relationship data of the emission condition parameters between the effective imaging area and the global imaging area and the size of the threshold, it is possible to determine whether the effective imaging area of the currently selected ROI belongs to a larger area or a smaller area, and trigger the corresponding optimized imaging mode according to its area characteristics.
[0122] For example, when the relationship data is less than a threshold, it indicates that the current effective imaging area is relatively large. If the effective imaging area covering the region of interest is enhanced, the number of transmissions may be increased or the transmission time may be prolonged, thereby affecting the frame rate. Therefore, on the basis of covering the global imaging area through the first optimized imaging mode, the corresponding transmission parameters can be adjusted in the region of interest. Without losing the required acoustic wave energy of other areas outside the region of interest in the global imaging area, the acoustic wave energy of the region of interest or the acoustic wave energy of the global imaging area can be increased as much as possible. This can not only improve the image quality without reducing the frame rate, but also achieve global imaging and dynamic adjustment of the global imaging area, thereby improving the imaging efficiency. On the contrary, when the relationship data is greater than the threshold, it indicates that the current effective imaging area is relatively small. The enhanced imaging covering the region of interest will not result in an excessive number of transmissions or an excessively long transmission time. When performing the enhanced imaging operation covering the region of interest, a non-enhanced imaging operation covering the global imaging area can be performed simultaneously. Alternatively, the number of transmissions or the transmission time can be controlled within a reasonable range. Ultimately, while improving the image quality, the frame rate can also be guaranteed, so that the final imaging efficiency is greatly improved. In some embodiments, sub-step 2301 can be implemented in the following example manner:
[0123] It is determined whether r calculated by the above calculation formula (6) is less than the threshold value t.
[0124] In some embodiments, the threshold t can be set based on specific imaging requirements. In some embodiments, the aforementioned imaging requirement can be a frame rate requirement, such as a minimum frame rate requirement, which serves as a key parameter for determining the threshold t. This is because frame rate requirements vary in different imaging scenarios. For example, carotid artery examinations have lower frame rate requirements, with a minimum frame rate of no less than 20 fps (frames per second), while cardiac examinations have higher frame rate requirements, with a minimum frame rate of no less than 50 fps.
[0125] For example, assuming that the global imaging area is imaged with a detection depth of 10 cm and focused emission is used, each frame needs to be emitted 128 times. At this time, the maximum frame rate that the ultrasound system can achieve is 60 fps. After local imaging optimization, if the imaging frame rate is required to be no less than 40 fps, the threshold Theoretically, the maximum number of achievable effective imaging area emissions is 63.
[0126] According to the above calculation formula (6):
[0127]
[0128] The calculated Sroi=63, which means that the number of emissions in the effective imaging area cannot exceed 63.
[0129] In some embodiments, the balance between image quality and frame rate can be achieved by adjusting the scaling factor ts. That is, ts is a variable that can be set and adjusted in real time based on different needs. In some embodiments, when the user is more concerned about image quality, the scaling factor ts can be appropriately increased. In some embodiments, when the user has higher requirements for frame rate, the scaling factor ts can be appropriately decreased.
[0130] For example, the initial ts is set to 1. At this time, the number of transmissions can just cover the entire effective imaging area. If the imaging quality is higher, ts can be appropriately increased to 1.2 to 1.5, but the frame rate will be reduced. If there is a high requirement for the frame rate, this parameter can also be appropriately lowered to about 0.8. For example, assuming that a linear array is used to image the global imaging area, the width of the global imaging area is 5 cm, and the calculated width of the effective imaging area is 1.5 cm, then according to the calculation formula (1), the minimum number of transmissions required to cover the effective imaging area is:
[0131]
[0132] Assuming the same conditions as those used to calculate the threshold t, increasing the number of transmissions can improve imaging quality without affecting the frame rate, and ts can be raised to 1.2 to 1.6. If ts is further increased, the system will warn that the current state will reduce the minimum frame rate, requiring the physician to decide whether to continue increasing the scaling factor.
[0133] In some embodiments, when executing the above sub-step 2302a, in response to the relationship data being less than a threshold, the imaging operation in the first optimized imaging mode is triggered, and the transmission parameters are adjusted while meeting the frame rate requirements. One transmission parameter can be adjusted individually or several transmission parameters can be adjusted in combination.
[0134] Transmission parameters refer to corresponding parameters that can affect the transmission process or imaging effect during ultrasound imaging. In some embodiments, the transmission parameters may include at least one of a transmission mode, a transmission aperture parameter, a transmission focus parameter, a transmission deflection angle, a transmission frequency, a transmission waveform, and a gain (i.e., gain adjustment). In some embodiments, the transmission mode may include at least one of focused transmission, diverging wave transmission, wide beam transmission, plane wave transmission, and single element transmission, or a mixed transmission of two or more transmission modes, or any other feasible transmission mode. In some embodiments, the transmission aperture parameter may be a transmission aperture position or a combination of transmission elements, a transmission aperture spacing, a receiving aperture spacing, or any other feasible transmission aperture parameter. In some embodiments, the transmission focus parameter may include the number of transmission focal points, the transmission focus position, the transmission focus depth, or any other feasible transmission focus parameter. In some embodiments, the transmission waveform may be a sine waveform, an impulse waveform, a waveform of arbitrary shape with multiple frequencies superimposed, or any other feasible transmission waveform.
[0135] For example, in a scenario with high frame rate requirements (such as cardiac examination), the frame rate cannot be sacrificed significantly, which means that the number of transmissions that can be increased when imaging the effective imaging area is limited. At this time, the focus is set outside the effective imaging area for imaging. If the effective imaging area is wide at this time, the effective transmission area can be expanded by expanding the transmission aperture and increasing the transmission deflection angle; if the effective imaging area is in the near field area (the area close to the probe), the transmission frequency of the effective imaging area can be increased so that the high-frequency sound waves produce the expected imaging effect on the near field.
[0136] Figure 9a and Figure 9b This is an example diagram of transmission parameter adjustment according to some embodiments of this specification.
[0137] like Figure 9a As shown, a non-biased focusing emission method is adopted, and the focus is horizontally distributed within the effective imaging area width W. In order to ensure the imaging effect of the edge, the focus distribution range can be appropriately expanded, such as 1.2 to 1.5 times the width W. The longitudinal position of the focus is at a position that is L times the depth of the effective imaging area, that is, The value of L is 2 to 3. The number of focal points can be calculated by one or more of the above-mentioned formulas (1), (2), (3), (4), (5), and (6).
[0138] like Figure 9b As shown, you can also Figure 9a The effective imaging area ( Figure 9aThe focal position below the image (shown in the rectangular area) is adjusted to above the effective imaging area so that the focal position is closer to the transmitting array element of the transducer to adjust the energy distribution of the sound wave in each area covering the global transmission area.
[0139] Refer again Figure 7a 、 Figure 7b , it is also possible to achieve multi-dimensional focus adjustment through a streaming control program, controlling and adjusting the focus position in multiple dimensional spaces (such as two-dimensional space, etc.), so that the focus position can be adjusted in the horizontal or vertical dimensions, for example, by Figure 7a 、 Figure 7b The focus position distribution shown is adjusted to Figure 9a or Figure 9b The focus position distribution shown can meet the focus adjustment requirements of various imaging scenarios and ultimately improve imaging efficiency.
[0140] By adjusting one parameter dimension or a mixed adjustment of multiple parameter dimensions including emission mode, emission aperture parameters, emission focus parameters, emission deflection angle, emission frequency, emission waveform, and gain, the expected imaging requirements of the global imaging area can be better achieved. While realizing dynamic display and adjustment of the global imaging area, the overall imaging efficiency can also be improved to meet the diverse imaging needs of users.
[0141] In some embodiments, adjusting the transmission parameters may also be implemented in the following example manner:
[0142] The focus distribution in the area outside the area of interest is analyzed to determine the area to be compensated that meets the preset focus distribution conditions; the emission is increased to compensate the acoustic wave energy in the area to be compensated.
[0143] Since in traditional ultrasound imaging, the focus distribution and imaging effect of the entire global imaging area are rarely paid attention to from a global perspective, especially the lack of attention to the areas outside the region of interest, the focus distribution in the areas outside the region of interest is relatively sparse. Therefore, in some embodiments, a focus sparse analysis can be performed on the focus distribution in the areas outside the region of interest, so that for the area to be compensated that meets the preset focus sparse distribution conditions, the corresponding emission parameters are adjusted to increase the emission to compensate the acoustic wave energy of the area to be compensated, so that the optimized imaging image covering the global imaging area generated in the first optimized imaging mode can enhance the acoustic wave energy of the area of interest as much as possible without sacrificing the reasonable demand for acoustic wave energy in other areas, thereby achieving a relative balance between parameters such as image quality and frame rate, improving imaging efficiency, and achieving the corresponding imaging effect, thereby meeting the expected imaging needs.
[0144] In some embodiments, when performing compensation for acoustic wave energy in the area to be compensated, corresponding emission parameters can be adjusted according to different acoustic wave energy compensation requirements, including adjusting one emission parameter alone or adjusting multiple emission parameters in combination, such as adjusting the emission mode, or adjusting the emission mode and emission angle at the same time, etc.
[0145] Figures 10a to 10c This is an example diagram of transmission parameter adjustment according to some embodiments of this specification.
[0146] For example, when adjusting the emission parameters for acoustic wave energy compensation, based on the initial emission mode covering the global imaging area, in addition to using the focused emission mode, the divergent wave emission mode shown in 10a, the divergent wave emission mode shown in 10b, the divergent wave emission mode shown in 10c, the divergent wave emission mode shown in 10d, the divergent wave emission mode shown in 10e, the divergent wave emission mode shown in 10f ... Figure 10b The wide beam transmission mode shown, Figure 10c The plane wave launch mode shown or any other feasible launch mode.
[0147] It should be noted that the initial emission mode covering the global imaging area is not limited to a single emission mode of focused emission. In some embodiments, based on different imaging requirements, the initial emission mode can be at least one of focused emission, diverging wave emission, wide beam emission, plane wave emission, single element emission, or a mixture of two or more emission modes, or any other feasible emission mode. In some embodiments, based on different imaging requirements, the emission mode for performing acoustic wave energy compensation can be at least one of focused emission, diverging wave emission, wide beam emission, plane wave emission, single element emission, or a mixture of two or more emission modes, or any other feasible emission mode.
[0148] Since various emission modes have their own emission advantages, for example, focused emission has the characteristic of strong focused sound wave energy, and wide beam, divergent wave, plane wave, etc. have the characteristics of wide emission coverage area, when performing sound wave compensation, one emission mode can be compensated or a mixture of multiple emission modes can be selected according to the imaging requirements of the specific scene, thereby improving imaging efficiency and achieving the expected imaging effect to meet the user's personalized imaging needs.
[0149] Figures 11a to 11d This is an example diagram of transmission parameter adjustment according to some embodiments of this specification.
[0150] like Figure 11a and Figure 11b As shown in the figure, when the selected ROI area is too large or spans a wide area, if the second optimized imaging mode of synchronous operation of enhanced imaging covering the region of interest and non-enhanced imaging covering the global imaging area is adopted, the number of transmissions required to be increased is large, which will affect the frame rate. The first optimized imaging mode of adjusting the transmission parameters under the condition of meeting the frame rate requirements can be adopted.
[0151] Figure 11a The focus distribution of the initial imaging image is shown, where the focus is evenly distributed on the same horizontal line. Assuming that the doctor selects Figure 11b The solid long strip area located at the top of the global imaging area is the ROI area, which almost spans the entire horizontal range. According to the characteristics of the ROI area, the focus within the original span can be moved into the ROI area, and the focus outside the ROI area is also evenly distributed between the positions before and after the move.
[0152] like Figure 11c As shown in the figure, for the sparsely distributed lower focus area outside the ROI, the transmission can be appropriately increased, and the acoustic wave energy compensation operation can be performed by adding a wide beam transmission mode. Based on the initial transmission mode after adjusting the focus position, multiple focus points are added outside the global imaging area, so that the energy compensation through the additional transmission mode can be concentrated in the lower area of the global imaging area, thereby compensating for the energy loss in the lower area caused by the upward shift of the focus, and achieving the expected optimized imaging effect of this global imaging area.
[0153] like Figure 11d As shown in FIG, when the selected ROI is located at the lower part of the global imaging area, it means that more focus is concentrated on the far field during emission, and the energy of the near field can be compensated by adding a divergent wave emission mode to achieve the expected optimized imaging effect of this global imaging area.
[0154] In some embodiments, when executing the above-mentioned sub-step 2302b, in response to the relationship data being not less than a threshold value, the imaging operation in the second optimized imaging mode is triggered, and the synchronous operation of the enhanced imaging covering the region of interest and the non-enhanced imaging covering the global imaging area can be specifically implemented in the following example manner: the region of interest is enhanced imaged by alternating emission modes, and the global imaging area is non-enhanced imaging is performed, so as to obtain an enhanced image of the region of interest and a global image of the global imaging area, respectively.
[0155] In some embodiments, the alternating transmission mode may be to transmit the same array transmitting elements at preset time intervals to obtain an enhanced image of the region of interest and a global image of the global imaging region.
[0156] In some embodiments, the enhanced imaging operation of the ROI can use a conventional imaging method, for example, similar to the imaging process of the initial imaging image. For details, please refer to the description of the initial imaging image, which is not repeated here. In some embodiments, the enhanced imaging operation of the ROI can use a focused emission mode to achieve acoustic wave energy enhancement within the ROI region. In some embodiments, the enhanced imaging operation of the ROI can use an imaging operation similar to the adjustment of emission parameters for the global imaging region or the region of interest in the first optimized imaging mode described above in sub-step 2302a. For details, please refer to the description of the adjustment of emission parameters for the global imaging region or the region of interest in the first optimized imaging mode, which is not repeated here. In some embodiments, the non-enhanced imaging operation of the global imaging region can use a conventional imaging method, for example, similar to the imaging process of the initial imaging image. For details, please refer to the description of the initial imaging image, which is not repeated here. In some embodiments, the non-enhanced imaging operation of the global imaging region can use an imaging operation similar to the adjustment of emission parameters for the global imaging region or the region of interest in the first optimized imaging mode described above in sub-step 2302a. For details, please refer to the description of the adjustment of emission parameters for the global imaging region or the region of interest in the first optimized imaging mode, which is not repeated here.
[0157] Figure 12 2 is an example diagram of an enhanced imaging operation covering a region of interest according to some embodiments of this specification.
[0158] In some embodiments, the enhanced imaging operation covering the region of interest may include the following steps:
[0159] Step 310: Calculate the emission boundary and effective emission area of the focus F according to the emission aperture and the position of the focus F;
[0160] Step 320: Select the coordinates (x, y) of the target point in the effective imaging area;
[0161] Step 330: determine whether the target point is within the effective emission area of the focus F;
[0162] Step 340: If it is, perform beam synthesis; if not, traverse to the next target point and repeat the operations from step 320 to step 340 until all target points are traversed;
[0163] Step 350: Obtain the beamforming result in the effective imaging area at the focus F;
[0164] The same operation is performed on all the focuses, and finally the beamforming results at all the focuses F are compounded to obtain the beamforming results covering the region of interest, thereby obtaining an enhanced image of the region of interest.
[0165] In some embodiments, after obtaining an enhanced image of the region of interest and a global image of the global imaging area, the enhanced image of the ROI can be directly used to replace the ROI area on the global image, and only edge transition processing, such as weighted composite transition processing, is performed on the overlapping edge portions of the two to ensure that there is no obvious dividing line between the two, and finally an optimized imaging image under the second optimized imaging mode is obtained.
[0166] In some embodiments, the image compounding operation performed on the enhanced image and the global image may be specifically implemented in the following exemplary manner: performing one or more operations of weighted compounding, frequency domain compounding, and edge enhancement on the enhanced image and the global image.
[0167] Figure 13 This is an example diagram of the image composite operation of the enhanced image and the global image according to some embodiments of this specification.
[0168] like Figure 13 As shown, in some embodiments, the image composite operation may include performing a weighted composite operation on the enhanced image and the global image. For example, the weight parameters may be set as Gaussian weights with the ROI region as the origin, ultimately composited to obtain an optimized image in the second optimized imaging mode. Multiple weighted composite operations have been performed in practice to verify that the image quality of the image details in the optimized image is significantly improved compared to the initial image.
[0169] In some embodiments, the image compounding operation may include performing a frequency domain compounding operation on the enhanced image and the global image. For example, the high-frequency information of the enhanced image and the low-frequency information of the global image are mixed. A two-dimensional Fourier transform (or other transforms such as wavelet transform) is performed on the global image and the enhanced image containing the effective imaging area to obtain the frequency domain information of the two images, and the image with high low-frequency energy is low-pass filtered, and the image with strong high-frequency signal is high-pass filtered. Then, an inverse Fourier transform is performed to obtain the filtered image, and the two images are linearly or nonlinearly compounded. In this way, the compounded image retains both strong low-frequency and high-frequency signals, contains richer color and texture information, and can obtain an optimized imaging image with better imaging effect.
[0170] In some implementations, the image composite operation may include performing an edge enhancement operation on the enhanced image and the global image. For example, an edge extraction operator (Roberts operator, Sobel operator, Prewitt operator, Kirsch operator, Robinson operator, etc.) or other edge extraction method is used to extract texture information from the enhanced image (or the effective imaging area of the global image). This texture information is then composited onto the effective imaging area of the global image (or the enhanced image), thereby obtaining more detailed information and improving image quality, thereby also ensuring a good imaging effect of the optimized image.
[0171] By performing enhanced imaging of the region of interest and non-enhanced imaging of the global imaging region in an alternating emission manner, an enhanced image of the region of interest and a global image of the global imaging region are obtained respectively, and then the enhanced image and the global image are subjected to image composite operations of one or more operations including weighted composite, frequency domain composite, and edge enhancement, thereby achieving synchronous operation of enhanced imaging covering the region of interest and non-enhanced imaging covering the global imaging region. This not only improves the imaging efficiency, but also ensures the dynamic display and dynamic adjustment functions of the global region of the final optimized imaging image, facilitates viewing the relationship between the ROI and other regions during ultrasonic detection or ultrasonic diagnosis, and meets the user's personalized and diversified imaging image viewing and adjustment needs.
[0172] Figures 14a to 14c This is an example diagram of an operation node for an image composite operation of an enhanced image and a global image according to some embodiments of this specification.
[0173] In some embodiments, the operation node where the image composite operation of the enhanced image and the global image is performed can be set as follows: Figure 14a The enhanced image is beamformed and compounded after the operation and before the envelope operation. In some embodiments, the compounding operation in the beamformation and compounding may include compound imaging processing, such as line compounding, frequency compounding, spatial compounding, etc. In some embodiments, the operation node where the image compounding operation of the enhanced image and the global image is located can be set to Figure 14b In some embodiments, the operation node where the image composite operation of the enhanced image and the global image is located can be set to Figure 14c After the two images shown are individually imaged and before the final imaging, since the enhanced image and the global image have both been imaged as images with relatively complete details at this operation node, performing a composite operation on the two images at this time can obtain a better image composite effect, ultimately improving imaging efficiency and optimizing the results.
[0174] In some embodiments, the above-mentioned ultrasound imaging method 200 may include: adjusting the imaging condition data and / or transmission parameters according to the optimized imaging image, frame rate requirements, and / or received instructions, so that the user can optimize the actual effect of the imaging image, dynamic frame rate requirements or other received operation instructions, thereby achieving further improvements in optimizing the imaging image, meeting the user's higher imaging needs, and improving the user experience.
[0175] Figure 15 This is an example diagram of an optimized imaging setting interface according to some embodiments of this specification.
[0176] like Figure 15As shown, for example, after executing steps 210 to 230, the user views the optimized imaging image and wishes to make further improvements and adjustments to a more interesting local image area (e.g., a local area within the previously selected ROI or a local area outside the previously selected ROI). In this case, the user can select "Emission Condition Parameter Settings" ( Figure 15 (not shown), the imaging condition data is reset, or the ROI area is reselected, and the above steps 210 to 230 are repeated.
[0177] For example, when the frame rate requirement changes in real time during the ultrasound imaging process, the user can also make real-time adjustments by optimizing the imaging condition data setting menu option and / or the transmission parameter setting menu option in the imaging setting interface, so as to ultimately optimize the imaging image to meet the user's frame rate requirements.
[0178] For example, when the ultrasound probe moves or the user reselects the ROI area during the detection or diagnosis process, the user will receive corresponding operation instructions for changes in the probe detection signal or drawing the ROI area. These operation instructions can also trigger the pop-up of the optimization imaging setting interface to facilitate the user to adjust the corresponding imaging condition data parameters or transmission parameters according to the new imaging requirements.
[0179] For example, during the imaging process, the user can input additional instructions according to the current optimized imaging mode requirements and perform the optimized imaging mode switching function operation through the optimized imaging mode switching menu option on the optimized imaging setting interface, such as switching from the first optimized imaging mode to the second optimized imaging mode.
[0180] It should be noted that the above description of process 200 is for illustration and purpose only and does not limit the scope of application of this specification. Those skilled in the art may make various modifications and variations to process 200 under the guidance of this specification. However, such modifications and variations are still within the scope of this specification.
[0181] Figure 16 This is an example diagram of the composition of an ultrasound imaging system according to some embodiments of this specification.
[0182] like Figure 16 As shown, the ultrasound imaging system 400 may include a region of interest determination module 410 , an imaging condition data determination module 420 , and an optimized imaging image generation module 430 .
[0183] In some embodiments, the region of interest determination module 410 may be configured to determine a region of interest on an initial image, where the initial image includes a global imaging region. The specific process and further technical details of the region of interest determination module 410 determining the region of interest on the initial image can be found in the description of the ultrasound imaging method described in any of the aforementioned embodiments and are not further elaborated here.
[0184] In some embodiments, the imaging condition data determination module 420 may be configured to determine imaging condition data based on the region of interest. The specific process and further technical details of the imaging condition data determination module 420 determining imaging condition data based on the region of interest can be found in the description of the ultrasound imaging method described in any of the aforementioned embodiments and are not further elaborated here.
[0185] In some embodiments, the optimized imaging image generation module 430 can be used to determine which optimized imaging mode the imaging condition data conforms to, and trigger imaging operations in the corresponding optimized imaging mode to generate an optimized imaging image. The optimized imaging mode can include at least a first optimized imaging mode and a second optimized imaging mode, wherein the first optimized imaging mode refers to an operation to adjust emission parameters covering the global imaging area, and the second optimized imaging mode refers to a simultaneous operation of enhanced imaging covering the region of interest and non-enhanced imaging covering the global imaging area. As for the specific process and further technical details of the optimized imaging image generation module 430 performing the judgment and ultimately generating the optimized imaging image, please refer to the description of the ultrasonic imaging method 200 described in any of the aforementioned embodiments, and will not be repeated here.
[0186] In addition, some embodiments of the present application further provide a computer-readable storage medium. When a computer reads the computer instructions in the storage medium, the computer executes the corresponding process of the ultrasound imaging method 200 described in any of the aforementioned embodiments.
[0187] The ultrasound imaging method, system and computer-readable storage medium provided in the embodiments of this specification have at least the following beneficial effects: (1) comprehensively considering the relationship between image quality and factors affecting the overall imaging efficiency such as frame rate and emission time, analyzing and judging the corresponding imaging condition data of the selected ROI for imaging requirements or diagnostic requirements of different imaging conditions, determining which optimized imaging mode it meets, and triggering the applicable corresponding optimized imaging mode, thereby providing a corresponding imaging solution with high adaptability, which not only improves the imaging efficiency but also meets a variety of different imaging requirements, thereby providing the best imaging solution while overcoming the defects of previous technical solutions; (2) supporting The adaptive enhancement of the imaging mode of the global area in which the region of interest (hereinafter referred to as ROI) and other areas outside the region can be dynamically displayed and adjusted at the same time makes it easier for users to view and adjust the imaging images during detection or diagnosis, thereby greatly improving the user experience; (3) Since the calculations involved in the ultrasound imaging process such as the selection of the region of interest or the calculation of the imaging condition data can be calculated and stored in a pre-set manner, and an interactive method (such as an interactive interface, etc.) can be provided only when the user needs it for the user to dynamically adjust and then calculate, it not only ensures a small amount of calculation, but also meets the user's real-time interaction and dynamic adjustment needs during imaging, further improving the user experience.
[0188] While the basic concepts have been described above, it will be apparent to those skilled in the art that the detailed disclosure is merely illustrative and does not limit this specification. Although not explicitly stated herein, various modifications, improvements, and revisions to this specification may be made by those skilled in the art. Such modifications, improvements, and revisions are suggested in this specification and remain within the spirit and scope of the exemplary embodiments of this specification.
[0189] This specification also uses specific terms to describe the embodiments of this specification. For example, "one embodiment," "an embodiment," and / or "some embodiments" refer to a feature, structure, or characteristic associated with at least one embodiment of this specification. Therefore, it should be emphasized and noted that references to "one embodiment," "an embodiment," or "an alternative embodiment" two or more times in different locations in this specification do not necessarily refer to the same embodiment. Furthermore, certain features, structures, or characteristics of one or more embodiments of this specification may be appropriately combined.
[0190] In addition, unless expressly stated in the claims, the order of the processing elements and sequences, the use of alphanumeric characters, or the use of other names described in this specification are not intended to limit the order of the processes and methods of this specification. Although the above disclosure discusses some of the invention embodiments currently considered useful through various examples, it should be understood that such details are for illustrative purposes only, and the appended claims are not limited to the disclosed embodiments. On the contrary, the claims are intended to cover all modifications and equivalent combinations that are consistent with the spirit and scope of the embodiments of this specification. For example, although the system components described above can be implemented by hardware devices, they can also be implemented only by software solutions, such as installing the described system on an existing server or mobile device.
[0191] Similarly, it should be noted that, in order to simplify the presentation of this specification and thus facilitate understanding of one or more embodiments of the invention, the foregoing descriptions of the embodiments of this specification sometimes combine multiple features into a single embodiment, figure, or description thereof. However, this disclosure method does not imply that the subject matter of this specification requires more features than those recited in the claims. In fact, an embodiment may have fewer features than all of the features of a single disclosed embodiment.
[0192] In some embodiments, the numerical parameters used in the specification and claims are approximate values, which may vary depending on the desired features of individual embodiments. In some embodiments, numerical parameters should take into account the specified number of significant digits and adopt a general method of retaining digits. Although the numerical domains and parameters used to confirm the breadth of their range in some embodiments of this specification are approximate values, in specific embodiments, the setting of such numerical values is as accurate as possible within the feasible range.
[0193] Finally, it should be understood that the embodiments described in this specification are intended only to illustrate the principles of the embodiments of this specification. Other variations may also fall within the scope of this specification. Therefore, by way of example and not limitation, alternative configurations of the embodiments of this specification may be considered consistent with the teachings of this specification. Accordingly, the embodiments of this specification are not limited to the embodiments explicitly described and illustrated in this specification.
Claims
1. An ultrasonic imaging method, characterized in that: The method comprises: determining a region of interest on an initial imaging image, wherein the initial imaging image includes a global imaging region; Determining imaging condition data based on the region of interest, the imaging condition data including relationship data between a first emission condition parameter of an effective imaging area of the region of interest and a second emission condition parameter of the global imaging area, the first emission condition parameter and the second emission condition parameter each including at least one of the number of focal spots, the number of emissions, or a frame rate; Determine which optimized imaging mode the imaging condition data conforms to, and trigger the imaging operation under the corresponding optimized imaging mode to generate an optimized imaging image, wherein the optimized imaging mode includes at least a first optimized imaging mode and a second optimized imaging mode, wherein the first optimized imaging mode refers to the emission parameter adjustment operation covering the global imaging area, and the second optimized imaging mode refers to the synchronous operation of enhanced imaging covering the region of interest and non-enhanced imaging covering the global imaging area.
2. The method according to claim 1, characterized in that The relationship data between the first emission condition parameter of the effective imaging area and the second emission condition parameter of the global imaging area includes a ratio of the first emission condition parameter to the second emission condition parameter.
3. The method according to claim 1, characterized in that The relationship data between the first emission condition parameter of the effective imaging area and the second emission condition parameter of the global imaging area includes a ratio of the second emission condition parameter to a sum of the first emission condition parameter and the second emission condition parameter.
4. The method according to claim 1, wherein The relationship data between the first emission condition parameter of the effective imaging area and the second emission condition parameter of the global imaging area includes a ratio of the first emission condition parameter required for conventional emission of the effective imaging area to the second emission condition parameter required for conventional emission of the global imaging area.
5. The method according to any one of claims 2 to 4, characterized in that: The determining which optimized imaging mode the imaging condition data conforms to and triggering an imaging operation under the corresponding optimized imaging mode includes: Determining whether the relationship data is less than a threshold; In response to the relationship data being less than the threshold, triggering an imaging operation in the first optimized imaging mode, including: adjusting the transmission parameters under the condition that a frame rate requirement is met, so that the acoustic wave energy of the region of interest is enhanced; In response to the relationship data being not less than the threshold, triggering an imaging operation in the second optimized imaging mode, comprising: Synchronous operation of enhanced imaging covering the region of interest and non-enhanced imaging covering the global imaging region to obtain an enhanced image of the region of interest and a global image of the global imaging region, respectively; An image composite operation is performed on the enhanced image and the global image.
6. The method according to claim 5, characterized in that The adjusting of the transmission parameters includes: Analyzing the focus distribution in the area outside the region of interest to determine an area to be compensated that meets a preset focus distribution condition; The emission is increased to compensate the acoustic wave energy in the area to be compensated.
7. The method according to claim 5, characterized in that The synchronous operation of the enhanced imaging covering the region of interest and the non-enhanced imaging covering the global imaging area includes: Performing enhanced imaging on the region of interest by alternating emission, and performing non-enhanced imaging on the global imaging region; The performing an image composite operation on the enhanced image and the global image includes performing one or more operations of weighted composite, frequency domain composite, and edge enhancement on the enhanced image and the global image.
8. The method according to any one of claims 6 to 7, characterized in that The method comprises: The imaging condition data and / or transmission parameters are adjusted according to the optimized imaging image, the frame rate requirement, and / or the received instruction.
9. An ultrasonic imaging system, characterized in that: The system comprises: A region of interest determination module, configured to determine a region of interest on an initial imaging image, wherein the initial imaging image includes a global imaging area; an imaging condition data determination module, configured to determine imaging condition data based on the region of interest, the imaging condition data including relationship data between a first emission condition parameter of an effective imaging area of the region of interest and a second emission condition parameter of the global imaging area, the first emission condition parameter and the second emission condition parameter each including at least one of the number of focal spots, the number of emissions, or a frame rate; An optimized imaging image generation module is used to determine which optimized imaging mode the imaging condition data conforms to, and trigger the imaging operation under the corresponding optimized imaging mode to generate an optimized imaging image; the optimized imaging mode includes at least a first optimized imaging mode and a second optimized imaging mode, wherein the first optimized imaging mode refers to the emission parameter adjustment operation covering the global imaging area, and the second optimized imaging mode refers to the synchronous operation of enhanced imaging covering the region of interest and non-enhanced imaging covering the global imaging area.
10. A computer-readable storage medium, characterized in that The storage medium stores computer instructions. When a computer reads the computer instructions in the storage medium, the computer executes the method according to any one of claims 1 to 8.
Citation Information
Patent Citations
An ultrasound imaging method, system, and computer-readable storage medium
CN114027872B