Method for performing ultrasonic scanning on breast and ultrasonic imaging system

Abstract

The embodiment of the invention provides a method for performing ultrasonic scanning on breasts and an ultrasonic imaging system. The ultrasonic scanning is at least partially carried out through a scanning assembly, the scanning assembly comprises a frame, a scanning probe and a driving device are contained in the frame, and the driving device drives the scanning probe to move in the frame to carry out the ultrasonic scanning. The method comprises the following steps: pre-scanning a breast to generate a pre-scanning ultrasonic image of the breast; performing image recognition on the pre-scanning ultrasonic image to obtain the breast size of the breast; and performing scanning planning on the scanning assembly based on the breast size, and performing scanning imaging on the breast by using the scanning assembly based on the scanning planning. According to the embodiment of the invention, the scanning time can be saved, and the scanning success rate is improved.

Description

Technical Field

[0001] This application relates to the field of medical imaging, and particularly to a method for ultrasonic scanning of breasts and an ultrasonic imaging system. Background Art

[0002] Ultrasonic imaging is one of the important means for imaging the interior of the body of a person to be scanned. Generally, an ultrasonic imaging system uses an ultrasonic transducer to convert electrical energy into ultrasonic pulses. The ultrasonic pulses are sent into the interior of the body of the person to be scanned and then generate echo signals. The echo signals are received by the transducer elements and converted into electrical signals. The above electrical signals are processed by a dedicated processing device to form the required ultrasonic image.

[0003] Ultrasonic imaging systems have important applications in the scanning of many body organs. For example, a full-field breast ultrasonic scanning device can be used to image breast tissue in one or more planes. During the full-field breast ultrasonic scanning process, it is usually necessary to perform multiple scans on a single breast, and then determine whether the breast area is completely covered. If not, the scanning area needs to be increased, and the above process will consume a lot of time.

[0004] It should be noted that the above introduction to the technical background is only for the convenience of clearly and completely explaining the technical solutions of this application and facilitating the understanding of those skilled in the art. It cannot be considered that the above technical solutions are well-known to those skilled in the art just because these solutions are described in the background art part of this application. Summary of the Invention

[0005] The inventors found that in actual operation, the standardized process of full-field breast ultrasonic scanning may cause redundancy in the scanning workflow when facing different individual objects. For example, the coverage rate of the scanning component of the full-field breast ultrasonic scanning device for mammary glands of different sizes is different. For example, mammary glands of medium size may be covered by most of the area of the scanning component, while mammary glands of small size can be completely covered by the scanning component. However, the size of the mammary gland hidden under the skin is difficult to directly estimate. Following the standard scanning process is still the mainstream of current full-field breast ultrasonic scanning.

[0006] To solve at least one of the above problems or other similar problems, embodiments of this application provide a method for ultrasonic scanning of breasts and an ultrasonic imaging system. By performing a pre-scan on the breast before the formal scan to determine the mammary gland size, performing a scanning plan for the scanning component based on the mammary gland size, and performing scanning imaging on the breast based on the scanning plan. Thus, the scanning time can be saved and the scanning success rate can be improved.

[0007] According to one aspect of the embodiments of the present application, a method for performing an ultrasound scan on a breast is provided. The ultrasound scan is at least partially performed by a scanning assembly, which includes a frame. A scanning probe and a driving device are accommodated in the frame. The driving device drives the scanning probe to move within the frame to perform the ultrasound scan. The method for the ultrasound scan includes:

[0008] Performing a pre-scan on the breast to generate a pre-scan ultrasound image of the breast;

[0009] Performing image recognition on the pre-scan ultrasound image to obtain the breast gland size of the breast;

[0010] Performing a scan plan for the scanning assembly based on the breast gland size, and using the scanning assembly to perform scan imaging on the breast based on the scan plan.

[0011] In some embodiments, performing a pre-scan on the breast includes:

[0012] Obtaining ultrasound data about the breast in at least one angular direction, where the ultrasound data at least includes ultrasound data of the nipple edge of the breast and ultrasound data extending outward from the nipple edge to the edge of the breast gland.

[0013] In some embodiments, the probe used for the pre-scan is an additional probe or the scanning probe, where the additional probe includes at least one of a 2D probe and a volume ultrasound probe.

[0014] In some embodiments, the at least one angular direction includes a plurality of angular directions, and the plurality of angular directions are evenly distributed in the circumferential direction.

[0015] In some embodiments, performing image recognition on the pre-scan ultrasound image to obtain the breast gland size of the breast includes:

[0016] Identifying the breast gland in the pre-scan ultrasound image, determining the outer edge of the breast gland, and obtaining the breast gland size of the breast based on the outer edge of the breast gland.

[0017] In some embodiments, the method further includes:

[0018] Performing image recognition on the pre-scan ultrasound image to obtain the chest wall in the pre-scan ultrasound image, and determining the depth of the scan imaging based on the chest wall.

[0019] In some embodiments, the depth of the scan imaging is the maximum value of the chest wall depth in the pre-scan ultrasound image.

[0020] In some embodiments, the scan plan includes at least one of the number of scans, scan positions, and scan strokes of the scanning component.

[0021] In some embodiments, the method further includes:

[0022] Displaying the scan plan on a display.

[0023] In some embodiments, the method further includes:

[0024] During the scan imaging process, real-time monitoring of the scanning process of the scanning component;

[0025] Matching the scanning process with the scan plan; and

[0026] Displaying the matching result.

[0027] In some embodiments, the scan plan includes:

[0028] In a single scan imaging, planning that the driving device does not drive the scanning probe to move outside the breast range; and / or

[0029] In multiple scan imaging, planning that the driving device does not drive the scanning probe to scan the overlapping area between multiple scans.

[0030] According to another aspect of the embodiments of the present application, there is provided an ultrasonic imaging system, the system includes:

[0031] A scanning component that moves on the breast surface to obtain ultrasonic echo signals; and

[0032] A processor configured to execute the method described in any of the foregoing embodiments.

[0033] According to still another aspect of the embodiments of the present application, there is provided a non-transitory computer-readable medium storing a computer program having at least one code segment, and the at least one code segment can be executed by a machine to cause the machine to execute the steps of the method described in any of the foregoing embodiments.

[0034] One of the beneficial effects of the embodiments of the present application is that by pre-scanning the breast before formal scanning to determine the breast size, performing a scan plan for the scanning component based on the breast size, and performing scan imaging on the breast based on the scan plan. Thus, scanning time can be saved and the scanning success rate can be improved.

[0035] Embodiments of the present application are disclosed in detail with reference to the following descriptions and drawings. It should be understood that the embodiments of the present application are not limited in scope thereby. Within the spirit and terms of the appended claims, the embodiments of the present application include many changes, modifications, and equivalents.

[0036] Features described and / or illustrated for one embodiment can be used in the same or similar manner in one or more other embodiments, combined with features in other embodiments, or substituted for features in other embodiments.

[0037] It should be emphasized that the term "comprising / including / having" as used herein refers to the presence of features, whole things, or components, but does not exclude the presence or addition of one or more other features, whole things, or components. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] From the following detailed description in conjunction with the drawings, the above and other objects, features, and advantages of the embodiments of the present application will become more apparent, in the drawings:

[0039] Figure 1 is a perspective view of an ultrasonic imaging system according to an embodiment of the present application;

[0040] Figure 2 is a block diagram of an ultrasonic imaging system according to an embodiment of the present application;

[0041] Figure 3 is a perspective view of a scanning component of an ultrasonic imaging system according to an embodiment of the present application;

[0042] Figure 4 is a schematic diagram of a method for performing an ultrasonic scan on a breast according to an embodiment of the present application;

[0043] Figure 5 is a schematic diagram of pre-scanning a breast according to the method of an embodiment of the present application;

[0044] Figure 6 is according to Figure 5 a schematic diagram of a pre-scanned ultrasonic image obtained after pre-scanning according to the method;

[0045] Figure 7 is a schematic diagram of breast dimensions;

[0046] Figure 8 is a schematic diagram of the chest wall on a pre-scanned ultrasonic image;

[0047] Figure 9 is a schematic diagram of scan plans corresponding to different breast dimensions;

[0048] Figure 10 is a schematic diagram of matching the scan process and the scan plan;

[0049] Figure 11 It is a schematic diagram for displaying a scanning plan on a display. Detailed implementation manners

[0050] Referring to the accompanying drawings, through the following description, the foregoing and other features of the present application will become apparent. In the description and drawings, specific embodiments of the present application are specifically disclosed, which show some embodiments in which the principles of the present application can be adopted. It should be understood that the present application is not limited to the described embodiments, but includes all modifications, variations and equivalents falling within the scope of the appended claims.

[0051] In the embodiments of the present application, terms such as "first", "second", "upper", "lower", etc. are used to distinguish different elements in terms of name, but do not indicate the spatial arrangement or time sequence of these elements, and these elements should not be limited by these terms. The term "and / or" includes any one and all combinations of one or more of the associated listed terms. Terms such as "comprising", "including", "having", etc. mean the presence of the stated features, elements, components or assemblies, but do not exclude the presence or addition of one or more other features, elements, components or assemblies.

[0052] In the embodiments of the present application, the singular forms "a", "the", etc. include the plural forms and should be broadly understood as "a kind" or "a class" rather than being limited to the meaning of "one"; in addition, the term "the" should be understood to include both the singular form and the plural form unless the context clearly indicates otherwise. In addition, the term "according to" should be understood as "at least partially according to...", and the term "based on" should be understood as "at least partially based on...", unless the context clearly indicates otherwise.

[0053] Features described and / or illustrated for one embodiment can be used in the same or similar manner in one or more other embodiments, combined with the features in other embodiments, or replace the features in other embodiments.

[0054] Figure 1 A perspective view of an ultrasonic imaging system 102 according to some embodiments is shown. The body of the ultrasonic imaging system 102 may include a main unit, a display 110, an adjustable arm 106, and a scanning component 108. The main unit may include a body frame 104, an ultrasonic processor housing 105, and an ultrasonic processor inside the housing 105. The specific structures of each component will be described in detail below.

[0055] The body frame 104, an ultrasonic processor housing 105 including an ultrasonic processor, a movable and adjustable support arm (e.g., an adjustable arm) 106 including a hinge joint 114, a scanning assembly 108 connected to a first end 120 of the adjustable arm 106 through a ball-and-socket connector (e.g., a spherical joint) 112, and a display 110 connected to the body frame 104. The display 110 is connected to the body frame 104 at an interface where the adjustable arm 106 enters the body frame 104. Since it is directly connected to the body frame 104 rather than the adjustable arm 106, the display 110 does not affect the weight of the adjustable arm 106 and the balance mechanism of the adjustable arm 106. In one example, the display 110 can be rotated in the horizontal and lateral directions (e.g., can rotate around the central axis of the body frame 104), but cannot be vertically moved. In an alternative example, the display 110 can also be vertically movable. Although Figure 1 a display 110 connected to the body frame 104 is depicted, in other examples, the display 110 can be connected to different components of the imaging system 102, such as connected to the ultrasonic processor housing 105, or located away from the imaging system 102.

[0056] In one embodiment, the adjustable arm 106 is configured and adapted such that the compression / scanning assembly 108 (i) is neutrally buoyant in space, or (ii) has a light net downward weight (e.g., 1 - 2 kg) for breast compression while allowing easy user operation. In an alternative embodiment, the adjustable arm 106 is configured such that the scanning assembly 108 is neutrally buoyant in space during positioning the scanner on the patient tissue. Then, after positioning the scanning assembly 108, the internal components of the imaging system 102 can be adjusted to apply a desired downward weight for breast compression and improved image quality. In one example, the downward weight (e.g., force) can be in the range of 2 - 11 kg.

[0057] As described above, the adjustable arm 106 includes a hinge joint 114. The hinge joint 114 divides the adjustable arm 106 into a first arm portion and a second arm portion. The first arm portion is connected to the scanning assembly 108 and the second arm portion is connected to the body frame 104. The hinge joint 114 allows the second arm portion to rotate relative to the second arm portion and the body frame 104. For example, the hinge joint 114 allows the scanning assembly 108 to translate laterally and horizontally but not vertically relative to the second arm portion and the body frame 104. In this way, the scanning assembly 108 can rotate towards the body frame 104 or away from the body frame 104. However, the hinge joint 114 is configured to allow the entire adjustable arm 106 (e.g., the first arm portion and the second arm portion) to move vertically together as a unit (e.g., translate up and down together with the body frame 104).

[0058] The scanning assembly 108 may include a membrane assembly 118 having at least a partially conforming membrane in a substantially taut state for compressing the breast, the membrane assembly 118 having a bottom surface that contacts the breast while the transducer sweeps across its top surface to scan the breast. In one example, the membrane is a taut fabric sheet.

[0059] The membrane assembly 118 may further include an outer frame and a membrane. The membrane is fixedly disposed within the outer frame, and the outer frame is detachably connected to the scanning assembly. During the ultrasound imaging process of the ultrasound imaging system, one side surface of the membrane can at least partially contact the ultrasound transducer, and the other side surface of the membrane at least partially contacts the tissue to be scanned. Such an arrangement can ensure that the ultrasound transducer transmits and receives signals with less attenuation and can fix the breast to be scanned for easy scanning.

[0060] Optionally, the adjustable arm may include a potentiometer (not shown) to allow sensing of the position and orientation of the compression / scanning assembly 108, or other types of position and orientation sensing (e.g., gyroscopic, magnetic, optical, radio frequency (RF)) may be used. A full-featured ultrasound engine may be provided within the ultrasound processor housing 105 for driving the ultrasound transducer and generating volumetric breast ultrasound data from the scan in combination with the associated position and orientation information. In some examples, the volumetric scan data may be transmitted to another computer system for further processing using any of the various data transmission methods known in the art, or the volumetric scan data may be processed by the ultrasound engine. A general-purpose computer / processor integrated with the ultrasound engine may also be provided for general user interface and system control. The general-purpose computer may be a self-contained stand-alone unit or may be remotely controlled, configured, and / or monitored by a remote station connected across a network.

[0061] Figure 2 FIG. 200 is a block diagram schematically showing various system components of the ultrasound imaging system 102, including a scanning assembly 108, a display 110, and a scan processor 210. In one example, the scan processor 210 may be included within the ultrasound processor housing 105 of the imaging system 102. As Figure 2 shown in the embodiments of, the scanning assembly 108, the display 110, and the scan processor 210 are separate components that communicate with each other; however, in some embodiments, one or more of these components may be integrated (e.g., the display and the scan processor may be included in a single component).

[0062] In Figure 2 the example of, the scanning assembly 108 includes at least an ultrasound transducer 220 and a driving device 240. Among them, the ultrasound transducer 220 includes a transducer array of transducer elements, such as piezoelectric elements, which convert electrical energy into ultrasonic waves and then detect the reflected ultrasonic waves.

[0063] The scanning assembly 108 may communicate with a scanning processor 210 to send raw scan data to an image processor. The scanning assembly 108 may optionally communicate with a display 110 to notify the user to reposition the scanning assembly as described above, or to receive information from the user (via user input 244).

[0064] In Figure 2 an example, the scanning processor 210 includes an image processor 212, a memory 214, a display output 216, and an ultrasound engine 218. The ultrasound engine 218 may drive the activation of transducer elements of a transducer 220 and, in some embodiments, may activate a drive device 240. Additionally, the ultrasound engine 218 may receive raw image data (e.g., ultrasound echoes) from the scanning assembly 108. The raw image data may be sent to the image processor 212 and / or a remote processor (e.g., via a network) and processed to form a displayable image of a tissue sample. It should be understood that, in some embodiments, the image processor 212 may be included within the ultrasound engine 218.

[0065] Information may be communicated from the ultrasound engine 218 and / or the image processor 212 to a user of the imaging system 102 via the display output 216 of the scanning processor 210. In one example, users of the ultrasound imaging system may include an ultrasound technician, a nurse, or a doctor such as a radiologist. For example, a processed image of the scanned tissue may be sent to the display 110 via the display output 216. In another example, information related to the parameters of the scan (such as the progress of the scan) may be sent to the display 110 via the display output 216. The display 110 may include a user interface 242 configured to display an image or other information to the user. Additionally, the user interface 242 may be configured to receive input from the user (such as via a user input unit 244) and send the input to the scanning processor 210. In one example, the user input unit 244 may be a touch screen of the display 110. However, other types of user input mechanisms are possible, such as a mouse, a keyboard, etc.

[0066] The scanning processor 210 may further include a memory 214. The storage 214 may include removable and / or permanent devices and may include optical memory, semiconductor memory, and / or magnetic memory, etc. The storage 214 may include volatile, non-volatile, dynamic, static, read / write, read-only, random access, sequential access, and / or additional memory. The storage 214 may store non-transitory instructions executable by a controller or processor (such as controller 218 or image processor 212) to perform one or more methods or routines as described below. The storage 214 may store raw image data received from the scanning assembly 108, processed image data received from the image processor 212 or a remote processor, and / or additional information.

[0067] Figure 3 Schematic diagram 300 shows an isometric view of a scanning assembly 108 connected to an adjustable arm 106. Schematic diagram 300 includes a coordinate system 302 that includes a vertical axis 304, a horizontal axis 306, and a transverse axis 308.

[0068] The scanning assembly 108 includes a housing 310, a transducer module 220, and a module receiver 230. The housing 310 includes a frame 322 and a handle portion 324 that includes two handles 312. The two handles 312 are opposite each other across a transverse axis of the scanning assembly 108 that is centered on the adjustable arm 106 and defined relative to the transverse axis 308. The frame 322 is rectangular, and an inner perimeter of the frame 322 defines an opening 314. The opening 314 provides space (e.g., a void volume) for translating the module receiver 230 and the transducer module 220 during scanning. In another example, the frame 322 can be another shape, such as square with a square opening 314. Additionally, the frame 322 has a thickness defined between an inner perimeter and an outer perimeter of the frame 322.

[0069] The frame 322 includes four sets of sidewalls (e.g., sets including inner and outer sidewalls, with the inner sidewalls defining the opening 314). Specifically, the frame 322 includes a front sidewall 326 and a rear sidewall 328 that is directly connected to the handle portion 324 of the housing 310, and the front sidewall 326 is opposite the rear sidewall 328 relative to the horizontal axis 306. The frame 322 also includes a right sidewall and a left sidewall, with the respective sidewalls being opposite each other and all in a plane defined by the vertical axis 304 and the transverse axis 308.

[0070] The frame 322 of the housing 310 also includes a top side and a bottom side that are defined relative to the vertical axis 304. The top side faces the adjustable arm 106. A membrane 118 is disposed across the opening 314. More specifically, the membrane 118 is connected to the bottom side of the frame 322. In an example, the membrane 118 is a diaphragm that is held taut across the opening 314. The membrane 118 can be a flexible but non-stretchable material that is thin, waterproof, durable, highly acoustically transparent, chemically resistant, and / or biocompatible. As described above, the bottom surface of the membrane 118 can contact tissue (e.g., a breast) during scanning, and the top surface of the membrane 118 can at least partially contact the transducer module 220 during scanning. As Figure 3As shown, the membrane 118 is permanently connected to a rigid housing clamping portion 119 that surrounds the perimeter of the membrane 118. The clamping portion 119 is connected to the bottom side of the frame 322. In one example, the clamping portion 119 can snap onto a lip on the bottom side of the frame 322 of the housing 310 such that the membrane 118 does not become disconnected during scanning, but is still removably connected to the frame 322. The membrane 118 can be not permanently connected to the rigid housing clamping portion 119, so the membrane 118 can be not connected to the frame 322 via the rigid housing clamping portion 119. Instead, the membrane 118 can be directly and removably connected to the frame 322.

[0071] The handle portion 324 of the housing 310 includes two handles 312 for moving the scanning assembly 108 in space and positioning the scanning assembly 108 on tissue (e.g., on a patient). In an alternative embodiment, the housing 310 can not include the handles 312. In an example, the handles 312 can be formed integrally with the frame 322 of the housing 310. In another example, the handles 312 and the frame 322 can be formed separately and then mechanically connected together to form the entire housing 310 of the scanning assembly 108.

[0072] As Figure 3 shown, the scanning assembly 108 is connected to the adjustable arm 106 via a ball joint 112 (e.g., a ball and socket connector). Specifically, the top dome portion of the handle portion 324 is connected to the ball joint 112. The top of the handle portion 324 includes a recess that forms a socket in which the ball of the ball joint 112 fits. The ball joint 112 can move in multiple directions. For example, the ball joint 112 provides rotational movement of the scanning assembly relative to the adjustable arm 106. The ball joint 112 includes a locking mechanism for locking the ball joint 112 in place and thereby holding the scanning assembly 108 stationary relative to the adjustable arm 106. Additionally, the ball joint 112 can also be configured to only rotate and not move in multiple directions such as wobbling.

[0073] Additionally, as Figure 3As shown, the handle 312 of the handle portion 324 includes buttons for controlling the scanning and adjusting the scanning assembly 108. Specifically, the first handle of the handle 312 includes a first weight adjustment button 316 and a second weight adjustment button 318. The first weight adjustment button 316 can reduce the load applied from the adjustable arm 106 to the scanning assembly 108. The second weight adjustment button 318 can increase the load applied from the adjustable arm 106 to the scanning assembly 108. Increasing the load applied to the scanning assembly 108 can increase the pressure and amount of compression applied to the tissue on which the scanning assembly 108 is placed. In addition, increasing the load applied to the scanning assembly increases the effective weight of the scanning assembly on the tissue to be scanned. In one example, increasing the load can compress the tissue of the patient, such as the breast. In this way, a variable amount of pressure (e.g., load) can be applied consistently with the scanning assembly 108 during scanning in order to obtain high-quality images using the transducer module 220.

[0074] Before the scanning process, a user (e.g., an ultrasound technician or a physician) can position the scanning assembly 108 on the patient or tissue. Once the scanning assembly 108 is properly positioned, the user can adjust the weight (e.g., the amount of compression) of the scanning assembly 108 on the patient by using the first weight adjustment button 316 and / or the second weight adjustment button 318. Then, the user can initiate the scanning process through additional controls on the handle portion 324 of the housing 310. For example, as Figure 3 shown, the second handle of the handle 312 includes two additional buttons 330 (not shown separately). The two additional buttons 330 can include a first button for initiating the scanning (e.g., once the scanning assembly has been placed on the tissue / patient and the amount of compression has been selected) and a second button for stopping the scanning. In one example, once the first button is selected, the ball joint 112 can be locked, thereby stopping the lateral and horizontal movement of the scanning assembly 108.

[0075] The module receiver 230 is positioned within the housing 310. Specifically, the module receiver 230 is mechanically connected to the first end of the housing 310 at the rear sidewall 328 of the frame 322, and the first end is closer to the adjustable arm 106 than the second end of the housing 310. The second end of the housing 310 is located at the front sidewall 326 of the frame 322. In one example, the module receiver 230 is connected to the first end via a protrusion of the module receiver 230, and the protrusion is connected to the motor 230, and the protrusion is connected to the motor of the module receiver 230.

[0076] As described above, the housing 310 is configured to remain stationary during scanning. In other words, once the weight applied to the scanning assembly 108 is adjusted by the adjustable arm 106 and then the ball joint 112 is locked, the housing 310 can be held in a stationary position without translating in the horizontal or lateral directions. However, the housing 310 can still translate vertically as the adjustable arm 106 moves vertically.

[0077] In contrast, the module receiver 230 is configured to translate relative to the housing 310 during scanning. As Figure 3 shown, the module receiver 230 translates horizontally along the horizontal axis 306 relative to the housing 310. The motor of the module receiver 230 can slide the module receiver 230 along the upper surface of the first end of the housing 310.

[0078] The transducer module 220 is removably connected to the module receiver 230. Thus, during scanning, the transducer module 220 translates horizontally with the module receiver 230. During scanning, the transducer module 220 sweeps horizontally across the breast under the control of the motor of the module receiver 230 while the contact surface of the transducer module 220 contacts the membrane 118. The transducer module 220 and the module receiver 230 are connected together at the module interface 320. The module receiver 230 has a width 332 that is the same as the width of the transducer module 220. In an alternative embodiment, the width 332 of the module receiver can be different from the width of the transducer module 220. In some embodiments, the module interface 320 includes a connector between the transducer module 220 and the module receiver 230, and the connector includes mechanical and electrical connections.

[0079] An embodiment of the present application provides a method for performing an ultrasound scan of a breast. The ultrasound scan is at least partially performed by a scanning assembly, such as Figure 1 the scanning assembly 108 of the ultrasound imaging system 102 shown, which includes a frame 104 that houses a scanning probe and a driving device. The driving device drives the scanning probe to move within the frame to perform an ultrasound scan.

[0080] Figure 4 is a schematic diagram of the method for performing an ultrasound scan of a breast according to an embodiment of the present application. As Figure 4 shown, the method includes:

[0081] 401: Perform a pre-scan of the breast to generate a pre-scan ultrasound image of the breast;

[0082] 402: Perform image recognition on the above pre-scan ultrasound image to obtain the breast gland size of the breast;

[0083] 403: Perform a scanning plan for the scanning component based on the above-mentioned breast size, and use the scanning component to perform a scanning imaging of the breast based on the scanning plan.

[0084] It should be noted that the above appendix Figure 4 only schematically illustrates the embodiments of the present application, but the present application is not limited thereto. For example, the execution order between various operations can be appropriately adjusted. In addition, some other operations can be added or some of the operations can be reduced. Those skilled in the art can make appropriate modifications according to the above content, not limited to the records in the above appendix Figure 4 only.

[0085] According to the above embodiments, a pre-scan is performed before the formal scan to determine the breast size of the breast, a scanning plan is performed according to the breast size of the breast, and the formal scan is performed based on the scanning plan. Thus, by performing a targeted scanning plan instead of using a fixed number and fixed position scan without discrimination, the scanning time can be saved and the scanning success rate can be improved.

[0086] In operation 401, a pre-scan is performed on the breast. For example, ultrasonic data about the breast can be obtained in at least one angular direction. The ultrasonic data at least includes ultrasonic data of the nipple edge of the breast and ultrasonic data extending from the nipple edge outward to the edge of the breast gland. Thus, a pre-scan ultrasonic image including the complete breast gland can be obtained, and then the breast size of the breast can be determined based on the pre-scan ultrasonic image.

[0087] In the above embodiments, the probe used for the pre-scan can be an additional probe or the scanning probe (i.e., the probe accommodated in the scanning component). Among them, the additional probe can be, for example, a two-dimensional (2D) probe, a volume ultrasonic probe, or other probes. Among them, the volume ultrasonic probe can be, for example, a three-dimensional (3D) probe, or a four-dimensional (4D) probe, etc.

[0088] In one example, the additional probe is another one different from the scanning probe of the ultrasonic imaging system, and is attached to the ultrasonic imaging system by a fixed connection or a pluggable (for example, through a probe connector) connection method. Compared with the scanning probe arranged in the scanning component and automatically driven, the above additional probe can provide higher flexibility for the user and is suitable for quickly evaluating the breast gland. Of course, in other examples, the additional probe can also be a probe different from the ultrasonic imaging system, for example, a hand-held probe or a probe on other ultrasonic devices. The evaluation result can be displayed to the user or transmitted to the above ultrasonic imaging system at the same time.

[0089] In other examples, the probe for pre-scanning can also be the scanning probe itself. The user can operate the ultrasound imaging system (such as the ultrasound imaging system 102) to control the positioning of the scanning probe on the breast surface. At this time, the operator can refrain from driving the movement of the scanning probe and only perform imaging through the ordinary imaging mode to quickly evaluate the breast. Since no additional equipment (such as an additional probe) is required, this example provides a lower-cost option for the operator.

[0090] In the above embodiment, at least one angular direction includes a plurality of angular directions, and the plurality of angular directions can be evenly distributed in the circumferential direction.

[0091] Taking the example that the at least one angular direction includes four angular directions, the four angular directions can be the four directions of 0 degrees, 90 degrees, 180 degrees, and 270 degrees centered on the nipple.

[0092] Figure 5 is a schematic diagram of pre-scanning the breast 30 in the above four angular directions, showing four positions of the scanning probe in the above four angular directions, namely 13(a), 13(b), 13(c), and 13(d); Figure 6 is in Figure 5 a schematic diagram of a pre-scanned ultrasound image obtained after pre-scanning the breast 30 in any of the directions shown.

[0093] As Figure 5 shown, the operator can align the edge of the scanning probe with the nipple, and then place the scanning probe in the above four positions in sequence, and perform a scan at each position to obtain four pre-scanned ultrasound images, as Figure 6 shown.

[0094] For example, the scanning probe performs a scan at position 13(a) to obtain a pre-scanned ultrasound image; then, it performs a scan at position 13(b) to obtain a pre-scanned ultrasound image; then, it performs a scan at position 13(c) to obtain a pre-scanned ultrasound image; and finally, it performs a scan at position 13(d) to obtain a pre-scanned ultrasound image. Thus, it is possible to ensure that on the basis of as few pre-scans as possible, representative pre-scanned ultrasound images are obtained, providing a basis for subsequent determination of the breast size.

[0095] The above has been described by taking four angular directions as an example. The present application does not limit this. In some embodiments, pre-scanning may also be performed in other numbers of angular directions to obtain corresponding pre-scanned ultrasound images. For example, pre-scanning may also be respectively performed in three angular directions, with an included angle of 120 degrees between each angular direction, to obtain three pre-scanned ultrasound images, and the breast size is determined based on these three pre-scanned ultrasound images; pre-scanning may also be respectively performed in two angular directions, with an included angle of 180 degrees between each angular direction, to obtain two pre-scanned ultrasound images, and the breast size is determined based on these two pre-scanned ultrasound images; in an extreme example, pre-scanning may also be performed only in one angular direction to obtain one pre-scanned ultrasound image. For example, the pre-scanned ultrasound images of other angles are inferred according to the characteristics of breast symmetry, and the breast size is determined based on the obtained pre-scanned ultrasound image and the inferred pre-scanned ultrasound images.

[0096] In operation 402, image recognition is performed on the pre-scanned ultrasound image. For example, it may be to recognize the breast in the pre-scanned ultrasound image, determine the outer edge of the breast, and obtain the breast size of the breast based on the outer edge of the breast.

[0097] In the above embodiments, the specific method of image recognition is not limited.

[0098] In a possible example, the image recognition method may be defined by one or more algorithms to identify a section of an object to be scanned (such as a breast) of interest based on one or more anatomical features (such as boundaries, thicknesses, pixel value changes, edges, or inner layers, etc.) within the pre-scanned ultrasound image, the modality or mode of the pre-scanned ultrasound image (such as color blood flow), etc. The one or more anatomical features may represent the features of the pixels and / or voxels of the pre-scanned ultrasound image, such as histogram of oriented gradients, point features, covariance features, binary pattern features, etc. For example, one or more deep neural networks may be used to define the image recognition method using the prediction of object recognition within the pre-scanned ultrasound image.

[0099] In another possible example, the image recognition method may correspond to an artificial neural network formed by a controller circuit and / or a remote server. The image recognition method may be divided into two or more than two layers, such as an input layer that receives an input image (e.g., a pre-scanned ultrasound image), an output layer that outputs an output image, and / or one or more intermediate layers. The layers of the neural network represent different groups or sets of artificial neurons, which may represent different functions that the controller circuit performs on the input image (e.g., a pre-scanned ultrasound image) to identify the objects in the input image and determine the cross-section of the anatomical structure of interest shown in the input image. The artificial neurons in the layers of the neural network may examine each pixel in the input image. The artificial neurons apply different weights in the function applied to the input image to attempt to identify the objects in the input image. The neural network generates an output image by assigning or correlating different pixels in the output image with different anatomical features based on the analysis of the pixel characteristics.

[0100] In yet another possible example, the image recognition method is defined by a plurality of training images, and the plurality of training images may be grouped into different anatomical planes of interest of the anatomical structure of interest. The training images may represent different orientations and / or cross-sections of the anatomical structure of interest corresponding to different fields of view. Additionally or alternatively, the image recognition method may be defined by the controller circuit based on a classification model. The classification model may correspond to a machine learning algorithm based on a classifier (e.g., a random forest classifier, principal component analysis, etc.), and the classifier is configured to identify and / or assign anatomical features to multiple classes or categories based on the overall shape, spatial position relative to the anatomical structure of interest, intensity, etc.

[0101] In the above embodiments, still taking the pre-scanning at four angular directions shown in Figure 5 as an example, according to the embodiments of the present application, by using any of the image recognition methods exemplified above for the obtained Figure 6 shown pre-scanned ultrasound image for image recognition, the outer edge 70 of the breast shown in Figure 7 is obtained, and the size of the breast is obtained based on the outer edge 70 of the breast. In the example of Figure 7 , the position 71 of the nipple and the four positions 72 of the scanning probe are also shown.

[0102] In the above embodiments, by performing image recognition on the pre-scanned ultrasound image, the chest wall in the pre-scanned ultrasound image can also be obtained, and the depth of the scanning imaging can be determined based on the chest wall.

[0103] Still taking the pre-scanning at four angular directions shown in Figure 5 as an example, after obtaining the four pre-scanned ultrasound images, by performing image recognition on the four pre-scanned ultrasound images, not only Figure 7The outer edge 70 of the breast shown is also obtained Figure 8 The chest wall 80 shown, based on Figure 7 The outer edge 70 of the breast shown can be used to obtain the breast size, based on Figure 8 The chest wall 80 shown can be used to obtain the depth of the scan image.

[0104] In the above embodiment, as Figure 8 shown, the depth of the scan image can be the maximum value 81 of the depth of the chest wall 80 in the pre-scan ultrasound image. Thus, the integrity of the scan image can be ensured, enabling the breast and the deepest part of the chest wall to be completely presented in the image, while not introducing excessive images below the chest wall, resulting in a better display effect of the image. Specifically, in conventional automatic breast ultrasound scans, the depth value needs to be set in advance. If the depth value is too high, the clinically significant images (such as the images above the chest wall) have too low a proportion and too small a size in the entire image, which is not conducive to the doctor's observation of the image. If the depth value is too low, valuable anatomical features in the image may be lost. Comparing the two, users tend to ensure the integrity of the anatomical features, so a larger depth value is selected. This will result in a loss of image quality. In the above embodiment of the present application, by simultaneously identifying the anatomical features of the breast and the chest wall, valuable anatomical feature size information in the depth direction and circumferential direction can be accurately provided without additional ultrasound scan steps. In this way, while ensuring integrity, the image quality can be improved without additional scan steps.

[0105] In the above embodiment, as Figure 8 shown, image recognition of the anatomical features of the pre-scan ultrasound image is performed to obtain the anatomical features of the nipple 82, breast 83, and chest wall 80, which can accurately determine the optimal depth of the scan image, i.e., the maximum value 81 of the depth of the chest wall 80, and the optimal circumferential range of the scan image, i.e., the outer edge 84 of the breast 83. Thus, without additional ultrasound scan steps and pre-setting of the depth value, valuable anatomical feature size information in the depth direction and circumferential direction can be determined. Scanning based on the obtained anatomical feature size information can ensure the integrity of the scan image while improving the image quality without additional scan steps.

[0106] In operation 403, the scan plan may include at least one of the number of scans, scan positions, and scan paths of the scan component. Among them, the number of scans, for example, refers to the number of times required for the scan component to complete the scan of the breast; the scan position, for example, refers to the placement position of the scan component during each scan; the scan path, for example, refers to the path that the scan component moves during each scan.

[0107] Therefore, by performing a scan plan according to the breast size and scanning the breast a reasonable number of times in a targeted manner, the scan time can be saved and the success rate of the scan can be improved.

[0108] In a possible example, in single-scan imaging, the scan plan can be: the planning drive device does not drive the scan probe to move outside the range of the breast. Thus, it is possible to avoid scanning areas outside the breast, save the scan time, and improve the scan efficiency.

[0109] In another possible example, in multi-scan imaging, the scan plan can be: the planning drive device does not drive the scan probe to scan the overlapping area between multiple scans. Thus, it is possible to avoid repeated scanning, save the scan time, and improve the scan efficiency.

[0110] Figure 9 is a schematic diagram of scan plans corresponding to different breast sizes. As Figure 9 shown, in (a), the breast size 910 is relatively small, and the scan plan is a single scan, that is, only one scan is performed within the range of the frame 920; in (b), compared with (a), the breast size 930 is relatively large, and the scan plan is two scans, that is, one scan is performed in the frames 940 and 950 respectively. Optionally, for the overlapping area of the frames 940 and 950, according to the scan plan, the drive device can drive the scan probe not to scan in this overlapping area; in (c), compared with (a) and (b), the breast size 960 is the largest, and the scan plan is three scans, that is, one scan is performed in the frames 970, 980, and 990 respectively. Optionally, for the overlapping area of the frames 970, 980, and 990, according to the scan plan, the drive device can drive the scan probe not to scan in this overlapping area.

[0111] According to the above embodiments, by performing a scan imaging of the breast according to the scan plan, the scan time is shortened and the success rate of the scan is improved.

[0112] In some embodiments, it is also possible to match the scan process and the scan plan during the scan imaging process and display the matching result, so that the operator can refer to the matching situation of the scan process and the scan plan for scanning.

[0113] Figure 10 is a schematic diagram of matching the scan process and the scan plan. As Figure 10 shown, the method includes:

[0114] 1001: During the scan imaging process, real-time monitor the scan process of the scan component;

[0115] 1002: Match the scan process and the scan plan;

[0116] 1003: Display the matching results.

[0117] In the above example, there is no limitation on the monitoring method. For example, sensors can be installed on the scanning component for real-time monitoring to determine orientation information such as its position and tilt angle. The orientation information of the scanning component can also be generally judged based on the results of image recognition, or the above two methods can be combined. The real-time monitoring method depends on specific requirements and is not limited in this application.

[0118] According to the above embodiments, the matching degree between the scanning process of the scanning component and the scanning plan can be monitored in real time. When a deviation occurs in the scanning, it can be corrected in time, improving the scanning accuracy rate.

[0119] In some embodiments, the scanning plan can also be displayed on a display.

[0120] Figure 11 is a schematic diagram of displaying the scanning plan on a display. In this example, still taking the Figure 9 shown scanning plan as an example, as Figure 11 shown, a plurality of LED lights 110 are arranged on the scanning probe to indicate the nipple position. Corresponding to different nipple alignment positions, different LED lights 110 light up to prompt the operator to align the nipple at the position where the LED light 110 lights up and start scanning.

[0121] The above is only an example, and this application does not limit the number and implementation method of the LED lights.

[0122] According to the above embodiments, the scanning accuracy and the success rate of scanning are improved.

[0123] Each of the above embodiments only gives an exemplary illustration of the embodiments of this application, but this application is not limited thereto, and appropriate modifications can also be made on the basis of each of the above embodiments. For example, each of the above embodiments can be used alone, or one or more of the above embodiments can be combined.

[0124] As can be seen from the above embodiments, by pre-scanning the breast before formal scanning to determine the breast size, performing a scanning plan for the scanning component based on the breast size, and performing scanning imaging on the breast based on the scanning plan. Thus, scanning time can be saved and the scanning success rate can be improved.

[0125] The embodiments of this application also provide an ultrasonic imaging system. The ultrasonic imaging system includes a scanning component and a processor. The scanning component is used to move on the breast surface to obtain ultrasonic echo signals. The specific implementation method of this scanning component has been described above and will not be elaborated here.

[0126] In the above embodiments, the processor is configured to execute the methods of the foregoing embodiments. Since the specific implementation manners of the methods have been described in the previous embodiments, the content thereof is incorporated herein and will not be repeated here.

[0127] An embodiment of the present application further provides a non-transitory computer-readable medium. The non-transitory computer-readable medium stores a computer program. The computer program has at least one code segment. The at least one code segment can be executed by a machine to enable the machine to execute the steps of the method described in the foregoing embodiments. Since the specific implementation manners of the method have been described in the previous embodiments, the content thereof is incorporated herein and will not be repeated here.

[0128] The method of the present application above can be implemented by hardware or by a combination of hardware and software. The present application relates to such a computer-readable program that, when executed by a logic component, can enable the logic component to implement the components described above, or enable the logic component to implement the various methods or steps described above. The present application also relates to a storage medium for storing the above program, such as a hard disk, a magnetic disk, an optical disk, a DVD, a flash memory, etc.

[0129] The method described in combination with the embodiments of the present application can be directly embodied as hardware, a software module executed by a processor, or a combination of the two. For example, one or more of the functional block diagrams shown in the figure and / or a combination of one or more of the functional block diagrams can correspond to each software module of the computer program flow, and can also correspond to each hardware module. These software modules can respectively correspond to the respective steps shown in the figure. These hardware modules can be implemented by, for example, using a field-programmable gate array (FPGA) to solidify these software modules.

[0130] The software module can be located in a RAM memory, a flash memory, a ROM memory, an EPROM memory, an EEPROM memory, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. A storage medium can be coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium; or the storage medium can be a component of the processor. The processor and the storage medium can be located in an ASIC. The software module can be stored in the memory of the mobile terminal or in a memory card that can be inserted into the mobile terminal. For example, if the device (such as a mobile terminal) uses a larger-capacity MEGA-SIM card or a large-capacity flash device, the software module can be stored in the MEGA-SIM card or the large-capacity flash device.

[0131] One or more of the functional blocks described in the accompanying drawings and / or one or more combinations of functional blocks can be implemented as a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, or any suitable combination thereof for performing the functions described in this application. One or more of the functional blocks described in the accompanying drawings and / or one or more combinations of functional blocks can also be implemented as a combination of computing devices, for example, a combination of a DSP and a microprocessor, multiple microprocessors, one or more microprocessors in communication combination with a DSP, or any other such configuration.

[0132] The present application has been described in conjunction with specific embodiments, but those skilled in the art should understand that these descriptions are exemplary and not limitations on the scope of protection of the present application. Those skilled in the art can make various variations and modifications to the present application according to the spirit and principles of the present application, and these variations and modifications are also within the scope of the present application.

[0133] The preferred embodiments of the present application have been described above with reference to the accompanying drawings. Many features and advantages of these embodiments are apparent from this detailed description, and thus the appended claims are intended to cover all such features and advantages that fall within the true spirit and scope of these embodiments. In addition, since many modifications and variations are readily contemplated by those skilled in the art, the embodiments of the present application are not to be limited to the exact structures and operations illustrated and described, but may cover all suitable modifications, variations, and equivalents that fall within their scope.

Claims

1. A method for performing an ultrasound scan on the breast, characterized in that, The ultrasonic scanning is performed at least in part by a scanning assembly, the scanning assembly including a frame, a scanning probe and a driving device being accommodated in the frame, the driving device driving the scanning probe to move within the frame to perform the ultrasonic scanning, the method including: Performing a pre-scan on the breast to generate a pre-scan ultrasonic image of the breast; Performing image recognition on the pre-scan ultrasonic image to obtain the breast gland size of the breast; Performing a scanning plan on the scanning assembly based on the breast gland size, and using the scanning assembly to perform scanning imaging on the breast based on the scanning plan.

2. The method according to claim 1, wherein, Performing a pre-scan on the breast includes: Obtaining ultrasonic data on the breast in at least one angular direction, the ultrasonic data at least including ultrasonic data of the nipple edge of the breast and ultrasonic data extending outward from the nipple edge to the edge of the breast gland.

3. The method according to claim 1, wherein The probe used for performing the pre-scan is an additional probe or the scanning probe, wherein the additional probe includes at least one of a 2D probe and a volume ultrasonic probe.

4. The method according to claim 2, wherein, The at least one angular direction includes a plurality of angular directions, and the plurality of angular directions are evenly distributed in the circumferential direction.

5. The method according to claim 1, wherein Performing image recognition on the pre-scan ultrasonic image to obtain the breast gland size of the breast includes: Identifying the breast gland in the pre-scan ultrasonic image, determining the outer edge of the breast gland, and obtaining the breast gland size of the breast based on the outer edge of the breast gland.

6. The method according to claim 1, wherein The method further includes: Performing image recognition on the pre-scan ultrasonic image to obtain the chest wall in the pre-scan ultrasonic image, and determining the depth of the scanning imaging based on the chest wall.

7. The method according to claim 6, wherein The depth of the scanning imaging is the maximum value of the chest wall depth in the pre-scan ultrasonic image.

8. The method according to claim 1, wherein, The scanning plan includes at least one of the number of scans, scanning positions, and scanning strokes of the scanning assembly.

9. The method according to claim 1, wherein The method further includes: Displaying the scanning plan on a display.

10. The method according to claim 1, wherein The method further includes: During the scanning imaging process, monitoring the scanning process of the scanning assembly in real time; Matching the scanning process with the scanning plan; and Displaying the matching result.

11. The method according to claim 1, wherein, The scanning plan includes: In a single scanning imaging, planning that the driving device does not drive the scanning probe to move outside the breast gland range; and / or In multiple scanning imagings, planning that the driving device does not drive the scanning probe to scan the overlapping area between multiple scans.

12. An ultrasonic imaging system, characterized in that, The ultrasonic imaging system includes: A scanning assembly that moves on the breast surface to obtain ultrasonic echo signals; and A processor configured to execute the method according to any one of claims 1 to 11.

13. A non-transitory computer-readable medium storing a computer program having at least one code segment, the at least one code segment being executable by a machine to cause the machine to execute the steps of the method according to any one of claims 1 to 11.

Images