Ultrasonic image acquisition method, device, medical scanning equipment and storage medium
By acquiring and analyzing feature image information in the ultrasound image sequence, the problem of missing sweep in ultrasound image acquisition is solved and the acquisition efficiency is improved.
Patent Information
- Application Number
- CN202211326185.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-10-27
- Publication Date
- 2025-03-14
- Estimated Expiration
- 2042-10-27
AI Technical Summary
During ultrasonic image acquisition, scans are prone to occur, resulting in long-term and low-efficiency acquisition of ultrasonic image.
By acquiring the first ultrasonic image sequence and the second ultrasonic image sequence of the target object, using the image feature identification information and image information, the characteristic image information of the target object is obtained, and whether the second ultrasonic image sequence can completely cover the characteristic image information is determined to determine whether there is a missed scan.
It effectively avoids the occurrence of scan leakage and improves the efficiency of ultrasonic image acquisition.
Smart Images

Figure CN117994185B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of image processing technology, and in particular to an ultrasonic image acquisition method, device, medical scanning equipment, and computer-readable storage medium (storage medium for short). Background Art
[0002] At present, ultrasound imaging has become a common method for assisting disease diagnosis. Ultrasonic scanning equipment is used to scan target parts such as human organs or physiological tissues to obtain ultrasound images of the target parts so that medical staff can observe the lesions in the target parts. However, it is easy to miss scans during the scanning of the target parts. If the ultrasound image does not completely scan the target part or does not completely scan the part to be observed in the target part, the target part needs to be scanned again, resulting in a long and inefficient ultrasound image acquisition process. Summary of the invention
[0003] Based on this, it is necessary to provide an ultrasonic image acquisition method, device, medical scanning equipment and storage medium to improve the efficiency of ultrasonic image acquisition in response to the above technical problems.
[0004] In a first aspect, the present application provides an ultrasound image acquisition method, the method comprising:
[0005] Acquire a first ultrasound image sequence of the target object, and acquire image feature identification information corresponding to the first ultrasound image sequence;
[0006] Acquiring characteristic image information corresponding to the target object according to the image characteristic identification information and the image information in the first ultrasound image sequence;
[0007] A second ultrasound image sequence of the target object is acquired again, and if the image information in the second ultrasound image sequence includes all characteristic image information, the second ultrasound image sequence is output as the ultrasound image of the target object.
[0008] In some embodiments of the present application, after the step of acquiring a second ultrasound image sequence of the target object again, the method further includes:
[0009] If the image information in the second ultrasound image sequence does not include all the characteristic image information, continue to acquire the second ultrasound image sequence of the target object.
[0010] In some embodiments of the present application, the step of acquiring characteristic image information corresponding to the target object according to the image feature identification information and the image information in the first ultrasound image sequence includes:
[0011] splicing the ultrasound images in the first ultrasound image sequence to obtain a first spliced image corresponding to the target object;
[0012] Based on the image feature identification information, feature image information corresponding to the target object is acquired from the first spliced image.
[0013] In some embodiments of the present application, the second ultrasound image sequence includes a plurality of continuous ultrasound sub-images;
[0014] If the image information in the second ultrasound image sequence includes all characteristic image information, the step of outputting the second ultrasound image sequence as the ultrasound image of the target object comprises:
[0015] Acquire in real time the image coverage rate of the image information coverage characteristic image information of the ultrasound sub-images in the second ultrasound image sequence;
[0016] If the image coverage is greater than a preset coverage threshold, the second ultrasound image sequence is output as the ultrasound image of the target object.
[0017] In some embodiments of the present application, the second ultrasound image sequence includes a plurality of continuous ultrasound sub-images;
[0018] If the image information in the second ultrasound image sequence includes all characteristic image information, the step of outputting the second ultrasound image sequence as the ultrasound image of the target object comprises:
[0019] splicing the ultrasonic sub-images in the second ultrasonic image sequence to obtain a second spliced image;
[0020] Obtaining an image coverage ratio of image information covering characteristic image information of the second stitched image;
[0021] If the image coverage is greater than a preset coverage threshold, the second ultrasound image sequence is output as the ultrasound image of the target object.
[0022] In some embodiments of the present application, the step of obtaining the image coverage rate of the image information coverage characteristic image information of the second stitched image includes:
[0023] calculating mutual information between image information and feature image information of the second stitched image;
[0024] The image coverage ratio of the image information of the second stitched image covering the characteristic image information is determined according to the mutual information.
[0025] In some embodiments of the present application, the second ultrasound image sequence includes a plurality of non-continuous ultrasound image subsequences;
[0026] If the image information in the second ultrasound image sequence includes all characteristic image information, the step of outputting the second ultrasound image sequence as the ultrasound image of the target object comprises:
[0027] splicing ultrasound image subsequences to obtain a target image sequence;
[0028] Obtaining the image coverage rate of the image information coverage characteristic image information of each ultrasound sub-image in the target image sequence;
[0029] If the image coverage is greater than a preset coverage threshold, the second ultrasound image sequence is output as the ultrasound image of the target object.
[0030] In some embodiments of the present application, the feature image information includes boundary image information and / or biometric feature image information.
[0031] In some embodiments of the present application, the step of acquiring image feature identification information corresponding to the first ultrasound image sequence includes:
[0032] For any adjacent first ultrasonic sub-image and second ultrasonic sub-image in the first ultrasonic image sequence, obtaining a relative position relationship between the first ultrasonic sub-image and the second ultrasonic sub-image according to motion information between the first ultrasonic sub-image and the second ultrasonic sub-image;
[0033] Based on the relative position relationship between the first ultrasonic sub-image and the second ultrasonic sub-image, acquiring a scanning trajectory corresponding to the first ultrasonic image sequence;
[0034] Image feature identification information corresponding to the first ultrasound image sequence is determined based on the scanning trajectory.
[0035] In some embodiments of the present application, the step of reacquiring a second ultrasound image sequence of the target object includes:
[0036] identifying an object type of a target object based on feature image information;
[0037] determining scanning parameters according to the object type of the target object;
[0038] The scanning probe is controlled to scan the target object with the scanning parameters to obtain a second ultrasound image sequence.
[0039] In a second aspect, the present application provides an ultrasonic image acquisition device, the device comprising:
[0040] A first scanning module, used to obtain a first ultrasound image sequence of the target object, and obtain image feature identification information corresponding to the first ultrasound image sequence;
[0041] A feature acquisition module, used to acquire feature image information corresponding to the target object according to the image feature identification information and the image information in the first ultrasound image sequence;
[0042] The second scanning module is used to obtain a second ultrasound image sequence of the target object again, and when the image information in the second ultrasound image sequence includes all characteristic image information, output the second ultrasound image sequence as the ultrasound image of the target object.
[0043] In a third aspect, the present application further provides a medical scanning device, the medical scanning device comprising:
[0044] one or more processors;
[0045] Memory; and
[0046] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the ultrasound image acquisition method.
[0047] In a fourth aspect, the present application also provides a computer-readable storage medium on which a computer program is stored, and the computer program is loaded by a processor to execute the steps in the ultrasound image acquisition method.
[0048] The above-mentioned ultrasonic image acquisition method, device, medical scanning equipment and storage medium acquire a first ultrasonic image sequence of the target object, and acquire image feature identification information corresponding to the first ultrasonic image sequence of the ultrasonic image acquisition; acquire feature image information corresponding to the target object according to the image feature identification information and the image information in the first ultrasonic image sequence of the ultrasonic image acquisition; acquire a second ultrasonic image sequence of the target object again, and if the image information in the second ultrasonic image sequence of the ultrasonic image acquisition includes all the feature image information of the ultrasonic image acquisition, the second ultrasonic image sequence of the ultrasonic image acquisition is output as the ultrasonic image of the target object. By acquiring the feature image information corresponding to the target object from the first ultrasonic image sequence based on the image feature identification information, the feature image information corresponding to the target object is used as reference information, and when a formal ultrasonic scan is performed later, it is determined whether the second ultrasonic image sequence obtained by scanning can fully cover the feature image information, so as to determine whether there is a missed scan of the target object in the second ultrasonic image sequence, avoid the occurrence of missed scans, and improve the efficiency of ultrasonic image acquisition. BRIEF DESCRIPTION OF THE DRAWINGS
[0049] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0050] Figure 1 is a schematic diagram of a scene of an ultrasound image acquisition method in an embodiment of the present application;
[0051] Figure 2 is a schematic flow chart of an ultrasound image acquisition method in an embodiment of the present application;
[0052] Figure 3is a schematic flow chart of a scanning trajectory acquisition step of a first ultrasound image sequence in an embodiment of the present application;
[0053] Figure 4 is a schematic diagram of a first ultrasound image sequence in an embodiment of the present application;
[0054] Figure 5 is a schematic diagram of a scanning trajectory in an embodiment of the present application;
[0055] Figure 6 is a schematic diagram of another scanning trajectory in an embodiment of the present application;
[0056] Figure 7 is a schematic diagram of another scanning trajectory in an embodiment of the present application;
[0057] Figure 8 is a schematic diagram of the structure of an ultrasonic image acquisition device in an embodiment of the present application;
[0058] Fig. 9 It is a schematic diagram of the structure of a computer device in an embodiment of the present application. DETAILED DESCRIPTION
[0059] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.
[0060] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this application, "plurality" means two or more, unless otherwise clearly and specifically defined.
[0061] In the description of the present application, the word "for example" is used to mean "used as an example, illustration or explanation". Any embodiment described as "for example" in the present application is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is given to enable any technician in the field to implement and use the present invention. In the following description, details are listed for the purpose of explanation. It should be understood that a person of ordinary skill in the art can recognize that the present invention can be implemented without using these specific details. In other examples, well-known structures and processes will not be elaborated in detail to avoid obscuring the description of the present invention with unnecessary details. Therefore, the present invention is not intended to be limited to the embodiments shown, but is consistent with the widest scope consistent with the principles and features disclosed in the present application.
[0062] The ultrasonic image acquisition method provided in the embodiment of the present application can be applied to Figure 1 In the ultrasound image acquisition system shown in FIG. 1 , the ultrasound image acquisition system includes a terminal 110 and a server 120, wherein the terminal 110 may specifically be an electronic computer tomography device, an ultrasound scanning device, etc. The server 120 may be an independent server, or a server network or server cluster composed of servers, including but not limited to a computer, a network host, a single network server, a plurality of network server sets, or a cloud server composed of a plurality of servers. The cloud server is composed of a large number of computers or network servers based on cloud computing.
[0063] Those skilled in the art will understand that Figure 1 The application environment shown in the figure is only one application scenario of the present application solution and does not constitute a limitation on the application scenario of the present application solution. Other application environments may also include Figure 1 More or less computer equipment as shown in Figure 1 Only one server 120 is shown in FIG. 1 . It is understandable that the ultrasound image acquisition system may also include one or more other servers, which are not specifically limited here. Figure 1 As shown, the ultrasound image acquisition system may further include a memory for storing data, such as storing ultrasound image sequences.
[0064] It should also be noted that Figure 1 The scene diagram of the ultrasound image acquisition system shown is only an example. The ultrasound image acquisition system and scene described in the embodiment of the present invention are intended to more clearly illustrate the technical solution of the embodiment of the present invention, and do not constitute a limitation on the technical solution provided by the embodiment of the present invention. Ordinary technicians in this field can know that with the evolution of the ultrasound image acquisition system and the emergence of new business scenarios, the technical solution provided by the embodiment of the present invention is also applicable to similar technical problems.
[0065] See also Figure 2 The present application embodiment provides an ultrasonic image acquisition method, which is mainly applied to the above Figure 1 Taking the server 120 in the example, the method includes steps S210 to S230, which are as follows:
[0066] S210: Acquire a first ultrasound image sequence of a target object, and acquire image feature identification information corresponding to the first ultrasound image sequence.
[0067] The first ultrasound image sequence refers to a plurality of ultrasound images or ultrasound video frames acquired at different acquisition times by a medical scanning device such as an ultrasound scanner. The target object refers to the scanning object of the first ultrasound image sequence; in actual application scenarios, the target object may be, but is not limited to, an organ or physiological tissue of the body; for example, the target object may be the heart, liver, breast tissue, bone, etc., which are not limited here. Specifically, the physiological tissue or organ to be detected may be scanned by an ultrasound scanning device to obtain a plurality of ultrasound images to form the first ultrasound image sequence.
[0068] The image feature identification information is used to identify the type of the object feature of the target object in the first ultrasound image sequence, and the image feature identification information can be specifically used to instruct the server to extract the type of feature image information of the target object from the first ultrasound image sequence.
[0069] For example, the image feature identification information includes but is not limited to boundary type, biometric feature type, etc., wherein the boundary type includes an external contour boundary, an internal contour boundary, etc., and the biometric feature identification information includes a blood vessel bifurcation point, etc.; when the object feature of the target object identified by the image feature identification information is an external contour boundary, the server can extract image information of the external contour boundary of the target object from the first ultrasound image sequence; for another example, when the object feature of the target object identified by the image feature identification information is a blood vessel bifurcation point, the server can extract image information corresponding to the blood vessel bifurcation position in the target object from the first ultrasound image sequence.
[0070] Furthermore, the image feature identification information can specifically be input by the user into the medical scanning device through an input device (such as a touch screen, etc.) before the user uses the medical imaging device to scan and obtain the first ultrasound image sequence, and then sent to the server by the medical scanning device; it can also be determined by the server analyzing the relative position relationship between each ultrasound sub-image in the first ultrasound image sequence based on the analysis result of the relative position relationship.
[0071] Specifically, in one embodiment, Figure 3 As shown, the step of obtaining the image feature identification information corresponding to the first ultrasound image sequence includes:
[0072] S310, for any adjacent first ultrasonic sub-image and second ultrasonic sub-image in the first ultrasonic image sequence, obtaining a relative position relationship between the first ultrasonic sub-image and the second ultrasonic sub-image according to motion information between the first ultrasonic sub-image and the second ultrasonic sub-image;
[0073] S320, acquiring a scanning trajectory corresponding to the first ultrasonic image sequence based on a relative position relationship between the first ultrasonic sub-image and the second ultrasonic sub-image;
[0074] S330: Determine image feature identification information corresponding to the first ultrasound image sequence based on the scanning trajectory.
[0075] The first ultrasonic image sequence includes a plurality of continuous ultrasonic images acquired at different acquisition times, and the first ultrasonic sub-image and the second ultrasonic sub-image refer to two ultrasonic images of adjacent time sequences in the first ultrasonic image sequence; for example, the first ultrasonic sub-image is an ultrasonic image acquired at time t in the first ultrasonic image sequence, and the second ultrasonic sub-image is an ultrasonic image acquired at time (t+1) in the first ultrasonic image sequence.
[0076] The motion information between the first ultrasonic sub-image and the second ultrasonic sub-image refers to the motion speed and motion direction of the same pixel between the first ultrasonic sub-image and the second ultrasonic sub-image; it can be understood that in the first ultrasonic image sequence, the image information collected in the target object by any adjacent time sequence of ultrasonic images is continuous, therefore, the motion information between the first ultrasonic sub-image and the second ultrasonic sub-image can be calculated by using the correlation between each pixel point in the first ultrasonic sub-image and each pixel point in the second ultrasonic sub-image. Further, the motion information between the first ultrasonic sub-image and the second ultrasonic sub-image can be optical flow information, specifically, the optical flow information of the target object between the first ultrasonic sub-image and the second ultrasonic sub-image of any adjacent time sequence in the first ultrasonic image sequence can be obtained by an optical flow analysis algorithm, wherein the optical flow analysis algorithm can specifically be a sparse optical flow algorithm, a dense optical flow algorithm, etc., which is not limited here.
[0077] After acquiring the motion information between the first ultrasonic sub-image and the second ultrasonic sub-image, the relative position relationship between the position of the scanning probe when acquiring the first ultrasonic sub-image and the position of the scanning probe when acquiring the second ultrasonic sub-image can be determined based on the operation information, and then the operation trajectory of the scanning probe can be determined based on the relative position relationship to achieve the scanning trajectory of the scanning probe when acquiring the first ultrasonic image sequence.
[0078] For example, see Figure 4 , Figure 4A schematic diagram of a first ultrasound image sequence is shown, in which ultrasound sub-image 410 in the first ultrasound image sequence is an ultrasound image acquired at the start time (recorded as the first time), ultrasound sub-image 420 is an ultrasound image acquired at the second time, ultrasound sub-image 430 is an ultrasound image acquired at the third time, and so on in a clockwise direction, ultrasound sub-image 440 in the first ultrasound image sequence is an ultrasound image acquired at the end time. Taking ultrasound sub-image 410 as the first ultrasound sub-image and ultrasound sub-image 410 as the second ultrasound sub-image as an example, optical flow information of each pixel point between ultrasound sub-images 410 and 410 can be obtained by an optical flow analysis algorithm, and then the motion information of the target object between ultrasound sub-images 410 and 420 can be determined based on the optical flow information, and the relative position relationship between the acquisition position of ultrasound sub-image 410 acquired by the scanning probe and the acquisition position of ultrasound sub-image 420 acquired can be determined according to the motion direction and motion distance between ultrasound sub-images 410 and 420 in the motion information, and then the scanning trajectory of the scanning probe can be determined based on the relative position relationship. Similarly, for the ultrasonic sub-image 420 and the ultrasonic sub-image 430, the relative positional relationship between the acquisition position of the ultrasonic sub-image 420 and the acquisition position of the ultrasonic sub-image 430 acquired by the scanning probe can be determined by acquiring the motion information between the ultrasonic sub-image 420 and the ultrasonic sub-image 430, and then the scanning trajectory of the scanning probe can be determined based on the relative positional relationship. By acquiring the relative positional relationship between any adjacent time series of ultrasonic sub-images in the first ultrasonic image sequence, the scanning trajectory of the scanning probe when acquiring the first ultrasonic image sequence can be obtained.
[0079] Among them, different scanning trajectories correspond to different image feature identification information; for example, see Figure 5 , when the scanning trajectory approximates a circle, the corresponding image feature identification information may be the outer contour boundary; for another example, see Figure 6 , when the scanning trajectory is a cross shape, the corresponding image feature identification information can be a biometric type (such as a blood vessel bifurcation point); for another example, see Figure 7 When the scanning trajectory is an S-shaped trajectory, the corresponding image feature identification information may be the internal contour boundary of the organ tissue. Specifically, the mapping relationship between different scanning trajectories and different image feature identification information may be saved in advance. After the scanning trajectory of the first ultrasound image sequence is acquired, the mapping relationship may be searched to determine the image feature identification information corresponding to the scanning trajectory of the first ultrasound image sequence, and the image feature identification information corresponding to the first ultrasound image sequence may be obtained.
[0080] S220: Acquire characteristic image information corresponding to the target object according to the image characteristic identification information and the image information in the first ultrasound image sequence.
[0081] Among them, the characteristic image information corresponding to the target object refers to the regional image containing the object features corresponding to the target object. For example, the target object is a body organ or physiological tissue, and the object features corresponding to the target object may refer to features such as the external contour boundary, internal contour boundary or blood vessel bifurcation point of the body organ or physiological tissue. The characteristic image information corresponding to the target object may refer to boundary image information containing the external contour boundary and / or the internal contour boundary, or biometric image information containing a blood vessel bifurcation point.
[0082] As described above, the image feature identification information is used to identify the type of object features of the target object in the first ultrasound image sequence; after the image feature identification information is obtained, the image information corresponding to the image feature identification information can be obtained from the first ultrasound image sequence based on the image feature identification information to obtain feature image information corresponding to the target object. Specifically, the feature image information corresponding to the target object may include image information corresponding to all ultrasound images in the first ultrasound image sequence, or may only include image information corresponding to some ultrasound images in the first ultrasound image sequence, or may only include image information of some of the ultrasound images in the first ultrasound image sequence.
[0083] For example, taking the object feature of the target object identified by the image feature identification information as the outer contour boundary as an example, an ultrasonic image whose image information contains the outer contour boundary corresponding to the target object can be obtained from the first ultrasonic image sequence as the feature image information corresponding to the target object; or a target ultrasonic image containing the outer contour boundary corresponding to the target object can be first obtained from the first ultrasonic image sequence, and a regional image of the area where the outer contour boundary corresponding to the target object is located can be extracted from each target ultrasonic image as the feature image information corresponding to the target object.
[0084] Furthermore, in one embodiment, the step of obtaining characteristic image information corresponding to the target object based on the image feature identification information and the image information in the first ultrasound image sequence includes: stitching the ultrasound images in the first ultrasound image sequence to obtain a first stitched image corresponding to the target object; and obtaining the characteristic image information corresponding to the target object from the first stitched image based on the image feature identification information.
[0085] As mentioned above, the image information collected in the target object by any adjacent time-series ultrasound images in the first ultrasound image sequence is continuous. Therefore, based on the order between the ultrasound images in the first ultrasound image sequence, the ultrasound images in the first ultrasound image sequence can be spliced one by one to obtain a first spliced image corresponding to the target object.
[0086] Specifically, stitching the ultrasonic images in the first ultrasonic image sequence may include extracting feature points from the first ultrasonic sub-image and the second ultrasonic sub-image of any adjacent time sequence in the first ultrasonic image sequence, aligning and matching the feature points extracted from the first ultrasonic sub-image and the second ultrasonic sub-image, and then performing image registration on the first ultrasonic sub-image and the second ultrasonic sub-image based on the aligned feature points, so as to stitch the ultrasonic images of any adjacent time sequence in the first ultrasonic image sequence and obtain a first stitched image corresponding to the first ultrasonic image. After obtaining the first stitched image, feature image information corresponding to the target object may be obtained from the first stitched image based on the image feature identification information.
[0087] By first splicing the ultrasonic images in the first ultrasonic image sequence, the first ultrasonic image sequence is spliced into a whole, so as to reduce the repeated image information between different ultrasonic images in the first ultrasonic image sequence, and the amount of data corresponding to the characteristic image information corresponding to the target object obtained from the spliced first spliced image is also greatly reduced, thereby improving the efficiency of subsequent comparison with the second ultrasonic image sequence.
[0088] S230, acquiring a second ultrasound image sequence of the target object again, and if the image information in the second ultrasound image sequence includes all characteristic image information, outputting the second ultrasound image sequence as the ultrasound image of the target object.
[0089] The second ultrasound image sequence refers to a plurality of ultrasound images or ultrasound video frames acquired at different acquisition times by medical scanning equipment such as ultrasound scanners. It can be understood that the first ultrasound image sequence and the second ultrasound image sequence are ultrasound image sequences acquired twice, the first ultrasound image sequence is the ultrasound image sequence acquired for the first time, and is mainly used to acquire characteristic image information, the second ultrasound image sequence is the ultrasound image sequence acquired for the second time, and the second ultrasound image sequence can be used as the ultrasound image finally output to the user.
[0090] Specifically, the characteristic image information corresponding to the target object can be used as reference information of the second ultrasonic image sequence. After obtaining the second ultrasonic image sequence of the target object, the image information in the second ultrasonic image sequence can be matched with the characteristic image information. When the image information in the second ultrasonic image sequence can be matched to all the characteristic image information corresponding to the target object, that is, the image information in the second ultrasonic image sequence includes all the characteristic image information, and the ultrasonic images in the second ultrasonic image sequence cover all or most of the object features of the target object, then it can be considered that the second ultrasonic image sequence contains the complete scanning data of the target object, and the second ultrasonic image sequence can be output as the ultrasonic image of the target object.
[0091] In one embodiment, the second ultrasonic image sequence may include multiple continuous ultrasonic sub-images; if the image information in the second ultrasonic image sequence includes all characteristic image information, the step of outputting the second ultrasonic image sequence as the ultrasonic image of the target object includes: acquiring in real time the image coverage rate of the image information of the ultrasonic sub-images in the second ultrasonic image sequence covering the characteristic image information; if the image coverage rate is greater than a preset coverage rate threshold, outputting the second ultrasonic image sequence as the ultrasonic image of the target object.
[0092] The second ultrasound image sequence includes a plurality of ultrasound sub-images acquired during a continuous acquisition period, and the plurality of ultrasound sub-images are acquired by the ultrasound scanner continuously scanning the target object according to a certain scanning trajectory.
[0093] Specifically, in the process of acquiring the second ultrasonic image sequence (i.e., each ultrasonic sub-image), the image coverage rate of the image information of the acquired ultrasonic sub-image covering the characteristic image information is acquired in real time; for example, after acquiring the first ultrasonic sub-image, the same image information between the first ultrasonic sub-image and the characteristic image information is acquired, and the proportion of the same image information in the characteristic image information is calculated, and the proportion is determined as the image coverage rate; after acquiring the second ultrasonic sub-image, the proportion of the same image information between the second ultrasonic sub-image and the characteristic image information in the characteristic image information is also calculated, and then the sum of the proportion of the same image information between the first ultrasonic sub-image and the characteristic image information in the characteristic image information and the proportion of the same image information between the second ultrasonic sub-image and the characteristic image information in the characteristic image information is determined as the new image coverage rate, and so on, the image coverage rate of the second ultrasonic image sequence obtained by scanning covering the characteristic image information is fed back in real time, and when the image coverage rate is greater than a certain coverage rate threshold, it is determined that the second ultrasonic image sequence can completely cover the object features of the target object, the ultrasonic scanning is stopped, and the scanned ultrasonic image sequence is output as a complete ultrasonic image sequence of the target object.
[0094] In order to reduce the amount of calculation of image coverage, in one embodiment, if the image information in the second ultrasonic image sequence includes all characteristic image information, the step of outputting the second ultrasonic image sequence as the ultrasonic image of the target object includes: splicing the ultrasonic sub-images in the second ultrasonic image sequence to obtain a second spliced image; obtaining the image coverage of the image information of the second spliced image covering the characteristic image information; if the image coverage is greater than a preset coverage threshold, outputting the second ultrasonic image sequence as the ultrasonic image of the target object.
[0095] Among them, the specific process of splicing the ultrasonic sub-images in the second ultrasonic image sequence to obtain the second stitched image can refer to the specific description of splicing the ultrasonic images in the first ultrasonic image sequence to obtain the first stitched image. It can be understood that the method of splicing the ultrasonic sub-images in the second ultrasonic image sequence is the same as the method of splicing the ultrasonic images in the first ultrasonic sequence, except that the data processing objects are different.
[0096] Specifically, after acquiring a whole continuous second ultrasound image sequence, the second ultrasound image sequence is spliced to obtain a second spliced image, and image information data identical to the characteristic image information in the image information of the second spliced image is obtained, and the proportion is determined as the image coverage rate; when the image coverage rate is greater than a certain coverage rate threshold, it is determined that the second ultrasound image sequence can completely cover the object features of the target object. By first splicing the ultrasound sub-images in the second ultrasound image sequence, the second ultrasound image sequence is spliced into a whole to reduce the repeated image information between different ultrasound sub-images in the second ultrasound image sequence, and then the image coverage rate of the characteristic image information is calculated based on the spliced second spliced image, the calculation amount of the image coverage rate calculation is reduced, and the efficiency of image information comparison is improved.
[0097] Furthermore, the above-mentioned step of obtaining in real time the image coverage ratio of the image information of the ultrasonic sub-images covering the characteristic image information in the second ultrasonic image sequence, or obtaining the image coverage ratio of the image information of the second stitched image covering the characteristic image information, can be specifically implemented by calculating the mutual information between the image information and the characteristic image information of the ultrasonic sub-images or the second stitched image in the second ultrasonic image sequence. For example, in one embodiment, the step of obtaining the image coverage ratio of the image information of the second stitched image covering the characteristic image information includes: calculating the mutual information between the image information of the second stitched image and the characteristic image information; and determining the image coverage ratio of the image information of the second stitched image covering the characteristic image information according to the mutual information.
[0098] Among them, mutual information refers to the amount of information of characteristic image information contained in the image information of the second stitched image; after obtaining the second stitched image, the mutual information between the second stitched image and the characteristic image information can be calculated, the smaller the value of the mutual information is, the less the image information in the second stitched image covers the characteristic image information, and the image information in the second ultrasound image sequence does not include all the characteristic image information, and the larger the value of the mutual information is, the more comprehensive the image information in the second stitched image covers the characteristic image information; after obtaining the second stitched image, the mutual information between the image information and the characteristic image information of the second stitched image is calculated and determined, and when the mutual information is greater than a preset mutual information threshold, it can be confirmed that the image information in the second ultrasound image sequence includes all the characteristic image information, and the second ultrasound image sequence is output as the ultrasound image of the target object.
[0099] In addition, the second ultrasound image sequence may also include multiple non-continuous ultrasound image subsequences; in one embodiment, the step of obtaining the image coverage rate of the image information covering the characteristic image information of the second stitched image includes: stitching the ultrasound image subsequences to obtain the target image sequence; obtaining the image coverage rate of the image information covering the characteristic image information in the target image sequence; if the image coverage rate is greater than a preset coverage rate threshold, outputting the second ultrasound image sequence as the ultrasound image of the target object.
[0100] The second ultrasound image sequence includes multiple ultrasound image subsequences, which can be obtained by scanning the target object multiple times with an ultrasound scanner. The starting position of each scan may be continuous with the ending position of the previous scan, or may be discontinuous, which is not specifically limited here.
[0101] Specifically, multiple ultrasound image subsequences are spliced to obtain a target image sequence; then, the image coverage rate of the image information in the target image sequence covering the characteristic image information is obtained. When the image coverage rate is greater than a certain coverage rate threshold, it is determined that the second ultrasound image sequence can completely cover the object features of the target object, and the ultrasound scanning is stopped, and the ultrasound image sequence obtained by the scan is output as a complete ultrasound image sequence of the target object.
[0102] Among them, the step of obtaining the image coverage rate of the image information in the target image sequence covering the characteristic image information can be to obtain the image information that is the same between the image information of each image in the target image sequence and the characteristic image information, so as to calculate the proportion of the image information in the characteristic image information and obtain the image coverage rate; or it can be to first splice each image in the target image sequence, and based on the image information that is the same between the spliced image and the characteristic image information, calculate the proportion of the image information in the characteristic image information and obtain the image coverage rate.
[0103] Furthermore, in one embodiment, after the step of acquiring the second ultrasound image sequence of the target object again, the step further includes: if the image information in the second ultrasound image sequence does not include all the characteristic image information, continuing to acquire the second ultrasound image sequence of the target object. Specifically, the image information in the second ultrasound image sequence is matched with the characteristic image information. When all the characteristic image information corresponding to the target object cannot be obtained from the image information of the second ultrasound image sequence, that is, the ultrasound images in the second ultrasound image sequence fail to completely cover the object features of the target object, it can be considered that the second ultrasound image sequence does not contain complete scanning data of the target object, and the ultrasound image output of the scanning of the target object can continue at this time.
[0104] In the process of performing a secondary scan on the target object to acquire a second ultrasound image sequence, automatic scanning can be specifically achieved by controlling a scanning probe of a medical scanning device; specifically, in one embodiment, the step of acquiring a second ultrasound image sequence of the target object again includes: identifying an object type of the target object based on characteristic image information; determining scanning parameters according to the object type of the target object; and controlling the scanning probe to scan the target object with the scanning parameters to obtain a second ultrasound image sequence.
[0105] Among them, scanning parameters refer to parameters such as scanning angle, scanning pressure, scanning trajectory, etc. when scanning the target object; it can be understood that the scanning parameters for scanning target objects of different object types are different. After obtaining the object type of the target object, the scanning parameters of the scanning probe of the medical scanning device can be determined according to the object type, and then the scanning probe can be controlled to scan the target object with the scanning parameters.
[0106] In the above-mentioned ultrasonic image acquisition method, a first ultrasonic image sequence of the target object is acquired, and image feature identification information corresponding to the first ultrasonic image sequence of the ultrasonic image acquisition is acquired; characteristic image information corresponding to the target object is acquired according to the image feature identification information and the image information in the first ultrasonic image sequence of the ultrasonic image acquisition; a second ultrasonic image sequence of the target object is acquired again, and if the image information in the second ultrasonic image sequence of the ultrasonic image acquisition includes all the characteristic image information of the ultrasonic image acquisition, the second ultrasonic image sequence of the ultrasonic image acquisition is output as the ultrasonic image of the target object. By acquiring the characteristic image information corresponding to the target object from the first ultrasonic image sequence based on the image feature identification information, the characteristic image information corresponding to the target object is used as reference information, and when a formal ultrasonic scan is performed later, it is determined whether the second ultrasonic image sequence obtained by scanning can fully cover the characteristic image information, so as to determine whether there is a missed scan of the target object in the second ultrasonic image sequence, avoid the occurrence of missed scans, and improve the efficiency of ultrasonic image acquisition.
[0107] In order to better implement the ultrasonic image acquisition method provided in the embodiment of the present application, on the basis of the ultrasonic image acquisition method provided in the embodiment of the present application, an ultrasonic image acquisition device is also provided in the embodiment of the present application, such as Figure 8 As shown, the ultrasonic image acquisition device 800 includes:
[0108] A first scanning module 810 is used to obtain a first ultrasound image sequence of a target object and obtain image feature identification information corresponding to the first ultrasound image sequence;
[0109] The feature acquisition module 820 is used to acquire feature image information corresponding to the target object according to the image feature identification information and the image information in the first ultrasound image sequence;
[0110] The second scanning module 830 is used to obtain a second ultrasound image sequence of the target object again, and when the image information in the second ultrasound image sequence includes all characteristic image information, output the second ultrasound image sequence as the ultrasound image of the target object.
[0111] In some embodiments of the present application, the second scanning module is further configured to continue acquiring a second ultrasound image sequence of the target object when the image information in the second ultrasound image sequence does not include all characteristic image information.
[0112] In some embodiments of the present application, the feature acquisition module is specifically used to stitch together the ultrasound images in the first ultrasound image sequence to obtain a first stitched image corresponding to the target object; based on the image feature identification information, characteristic image information corresponding to the target object is acquired from the first stitched image.
[0113] In some embodiments of the present application, the second ultrasonic image sequence includes multiple continuous ultrasonic sub-images; the second scanning module is specifically used to obtain in real time the image coverage rate of the image information covering characteristic image information of the ultrasonic sub-images in the second ultrasonic image sequence; if the image coverage rate is greater than a preset coverage rate threshold, the second ultrasonic image sequence is output as the ultrasonic image of the target object.
[0114] In some embodiments of the present application, the second ultrasonic image sequence includes multiple continuous ultrasonic sub-images; the second scanning module is specifically used to stitch the ultrasonic sub-images in the second ultrasonic image sequence to obtain a second stitched image; obtain the image coverage rate of the image information of the second stitched image covering the characteristic image information; if the image coverage rate is greater than a preset coverage rate threshold, the second ultrasonic image sequence is output as the ultrasonic image of the target object.
[0115] In some embodiments of the present application, the second scanning module is specifically used to calculate the mutual information between the image information and the feature image information of the second stitched image; and determine the image coverage ratio of the image information of the second stitched image covering the feature image information according to the mutual information.
[0116] In some embodiments of the present application, the second ultrasound image sequence includes multiple non-continuous ultrasound image subsequences; the second scanning module is specifically used to splice the ultrasound image subsequences to obtain a target image sequence; obtain the image coverage rate of the image information of each ultrasound sub-image in the target image sequence covering the characteristic image information; if the image coverage rate is greater than a preset coverage rate threshold, the second ultrasound image sequence is output as the ultrasound image of the target object.
[0117] In some embodiments of the present application, the second scanning module is specifically used to stitch together the individual ultrasound images in the second ultrasound image sequence to obtain a second stitched image; calculate the mutual information between the image information and the feature image information of the second stitched image; when the mutual information is greater than a preset mutual information threshold, determine that the image information in the second ultrasound image sequence includes all the feature image information, and output the second ultrasound image sequence as the ultrasound image of the target object.
[0118] In some embodiments of the present application, the feature image information includes boundary image information and / or biometric feature image information.
[0119] In some embodiments of the present application, the first scanning module is specifically used to obtain, for any adjacent first ultrasonic sub-image and second ultrasonic sub-image in the first ultrasonic image sequence, a relative position relationship between the first ultrasonic sub-image and the second ultrasonic sub-image according to motion information between the first ultrasonic sub-image and the second ultrasonic sub-image; obtain a scanning trajectory corresponding to the first ultrasonic image sequence based on the relative position relationship between the first ultrasonic sub-image and the second ultrasonic sub-image; and determine image feature identification information corresponding to the first ultrasonic image sequence based on the scanning trajectory.
[0120] In some embodiments of the present application, the second scanning module is specifically used to identify the object type of the target object based on characteristic image information; determine scanning parameters according to the object type of the target object; and control the scanning probe to scan the target object with the scanning parameters to obtain a second ultrasound image sequence.
[0121] For the specific definition of the ultrasonic image acquisition device, please refer to the definition of the ultrasonic image acquisition method above, which will not be repeated here. Each module in the above-mentioned ultrasonic image acquisition device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
[0122] In some embodiments of the present application, the ultrasound image acquisition device 800 may be implemented in the form of a computer program. The computer program may be implemented in a computer program such as Fig. 9 The computer device shown in the figure is run on the computer device. The memory of the computer device can store various program modules constituting the ultrasonic image acquisition device 800, for example, Figure 8 The first scanning module 810, the feature acquisition module 820 and the second scanning module 830 are shown. The computer program composed of various program modules enables the processor to execute the steps of the ultrasound image acquisition method of each embodiment of the present application described in this specification.
[0123] For example, Fig. 9 The computer device shown can be Figure 8 The first scanning module 810 in the ultrasonic image acquisition device 800 shown in the figure performs step S210. The computer device can perform step S220 through the feature acquisition module 820. The computer device can perform step S230 through the second scanning module 830. The computer device includes a processor, a memory and a network interface connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external computer device through a network connection. When the computer program is executed by the processor, an ultrasonic image acquisition method is implemented.
[0124] Those skilled in the art will understand that Fig. 9 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0125] In some embodiments of the present application, a medical scanning device is provided, comprising one or more processors; a memory; and one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor in the steps of the ultrasound image acquisition method. The steps of the ultrasound image acquisition method here may be the steps in the ultrasound image acquisition method of each of the above embodiments.
[0126] In some embodiments of the present application, a computer-readable storage medium is provided, which stores a computer program, and the computer program is loaded by a processor, so that the processor executes the steps of the above-mentioned ultrasound image acquisition method. The steps of the ultrasound image acquisition method here can be the steps in the ultrasound image acquisition method of each of the above-mentioned embodiments.
[0127] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Any reference to memory, storage, database or other media used in the embodiments provided in this application may include at least one of non-volatile and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, etc. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).
[0128] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0129] The above is a detailed introduction to an ultrasonic image acquisition method, device, medical scanning equipment and storage medium provided in the embodiments of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as limiting the present invention.
Claims
1. An ultrasonic image acquisition method, applied to a client, characterized in that: include: Acquire a first ultrasound image sequence of the target object, and acquire image feature identification information corresponding to the first ultrasound image sequence; splicing the ultrasound images in the first ultrasound image sequence to obtain a first spliced image corresponding to the target object, and acquiring feature image information corresponding to the target object from the first spliced image based on the image feature identification information, wherein the image feature identification information is used to identify a type of an object feature of the target object in the first ultrasound image sequence, and the feature image information corresponding to the target object refers to a regional image containing the object feature corresponding to the target object; A second ultrasound image sequence of the target object is acquired again, and if the image information in the second ultrasound image sequence includes all the characteristic image information, the second ultrasound image sequence is output as the ultrasound image of the target object.
2. The method according to claim 1, characterized in that After the step of reacquiring a second ultrasound image sequence of the target object, the method further includes: If the image information in the second ultrasound image sequence does not include all of the characteristic image information, continue to acquire a second ultrasound image sequence of the target object.
3. The method according to claim 1, characterized in that The second ultrasound image sequence includes a plurality of continuous ultrasound sub-images; If the image information in the second ultrasound image sequence includes all the characteristic image information, the step of outputting the second ultrasound image sequence as the ultrasound image of the target object comprises: Acquire in real time an image coverage rate of the image information of the ultrasound sub-images in the second ultrasound image sequence covering the characteristic image information; If the image coverage is greater than a preset coverage threshold, the second ultrasound image sequence is output as an ultrasound image of the target object.
4. The method according to claim 1, characterized in that: The second ultrasound image sequence includes a plurality of continuous ultrasound sub-images; If the image information in the second ultrasound image sequence includes all the characteristic image information, the step of outputting the second ultrasound image sequence as the ultrasound image of the target object comprises: splicing the ultrasonic sub-images in the second ultrasonic image sequence to obtain a second spliced image; Obtaining an image coverage ratio of the image information of the second stitched image covering the characteristic image information; If the image coverage is greater than a preset coverage threshold, the second ultrasound image sequence is output as an ultrasound image of the target object.
5. The method according to claim 4, characterized in that The step of obtaining the image coverage ratio of the image information of the second stitched image covering the characteristic image information comprises: Calculating mutual information between the image information of the second stitched image and the feature image information; An image coverage ratio of the image information of the second stitched image covering the characteristic image information is determined according to the mutual information.
6. The method according to claim 1, characterized in that The second ultrasound image sequence includes a plurality of non-continuous ultrasound image subsequences; If the image information in the second ultrasound image sequence includes all the characteristic image information, the step of outputting the second ultrasound image sequence as the ultrasound image of the target object comprises: splicing the ultrasound image subsequences to obtain a target image sequence; Acquire an image coverage ratio of the image information of each ultrasonic sub-image in the target image sequence covering the characteristic image information; If the image coverage is greater than a preset coverage threshold, the second ultrasound image sequence is output as an ultrasound image of the target object.
7. The method according to any one of claims 1 to 6, characterized in that: The characteristic image information includes boundary image information and / or biometric characteristic image information.
8. The method according to any one of claims 1 to 6, characterized in that: The step of acquiring image feature identification information corresponding to the first ultrasound image sequence includes: For any adjacent first ultrasonic sub-image and second ultrasonic sub-image in the first ultrasonic image sequence, acquiring a relative position relationship between the first ultrasonic sub-image and the second ultrasonic sub-image according to motion information between the first ultrasonic sub-image and the second ultrasonic sub-image; Based on the relative position relationship between the first ultrasonic sub-image and the second ultrasonic sub-image, acquiring a scanning trajectory corresponding to the first ultrasonic image sequence; Image feature identification information corresponding to the first ultrasound image sequence is determined based on the scanning trajectory.
9. The method according to any one of claims 1 to 5, characterized in that: The step of reacquiring a second ultrasound image sequence of the target object comprises: identifying an object type of the target object based on the characteristic image information; determining scanning parameters according to the object type of the target object; The scanning probe is controlled to scan the target object with the scanning parameters to obtain a second ultrasound image sequence.
10. An ultrasonic image acquisition device, characterized in that: The device comprises: A first scanning module, used to obtain a first ultrasound image sequence of a target object, and obtain image feature identification information corresponding to the first ultrasound image sequence; a feature acquisition module, configured to stitch together the ultrasound images in the first ultrasound image sequence to obtain a first stitched image corresponding to the target object, and based on the image feature identification information, to acquire feature image information corresponding to the target object from the first stitched image, wherein the image feature identification information is used to identify a type of an object feature of the target object in the first ultrasound image sequence, and the feature image information corresponding to the target object refers to a regional image containing the object feature corresponding to the target object; The second scanning module is used to obtain a second ultrasound image sequence of the target object again, and when the image information in the second ultrasound image sequence includes all the characteristic image information, output the second ultrasound image sequence as the ultrasound image of the target object.
11. A medical scanning device, characterized in that: The medical scanning device comprises: one or more processors; Memory; and One or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the processor to implement the ultrasound image acquisition method according to any one of claims 1 to 9.
12. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps in the ultrasound image acquisition method according to any one of claims 1 to 9.
Citation Information
Patent Citations
Ultrasonic imaging range adjusting method and related equipment
CN111281424A
Ultrasonic imaging method and system
CN112401934A