Convex array probe automatic fitting method and device for ultrasonic robot scanning

By calculating ultrasonic image data and contact force information in real time, the movement of the ultrasonic convex array probe is solved, and the problem of insufficient fit between the probe and the skin in ultrasonic robot scanning is improved, and image quality and scanning accuracy are improved.

CN118924341AActive Publication Date: 2024-11-12武汉库柏特科技股份有限公司

Patent Information

Application Number
CN202411108659.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-13
Publication Date
2024-11-12
Estimated Expiration
2044-08-13

AI Technical Summary

Technical Problem

During the automatic scanning process of ultrasonic robots, the ultrasonic convex array probe is not fit enough to the human skin, resulting in a decrease in the quality of ultrasonic images and serious missed diagnosis problems. It is difficult for the existing technology to effectively solve this problem.

Method used

By calculating the image center of gravity inclination and window saturation of the ultrasonic image in real time, the rotation offset and contact force movement displacement of the ultrasonic convex array probe are planned, so as to achieve a close fit between the probe and the skin, and adjust the rotation and contact force using the PID controller. Data to improve fitting effect.

Benefits of technology

It effectively improves the quality of ultrasonic robot scanning images, ensures full contact between the probe and the skin, and reduces the risk of missed diagnosis.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118924341A_ABST
    Figure CN118924341A_ABST
Patent Text Reader

Abstract

The invention relates to a convex array probe automatic fitting method and device for ultrasonic robot scanning, and the method comprises the steps: calculating the gradient of the gravity center of an image based on an ultrasonic image obtained in real time in the automatic scanning process of an ultrasonic robot; if the image gravity center gradient does not meet a first preset condition, planning a rotation offset of the ultrasonic convex array probe around a first coordinate axis of the tool coordinate system based on the image gravity center gradient and a preset image gravity center gradient expected value; calculating the ultrasonic window saturation of the ultrasonic image after the ultrasonic convex array probe moves according to the rotation offset; and if the ultrasonic window saturation does not meet a second preset condition, planning the movement displacement of the ultrasonic convex array probe along a second coordinate axis of the tool coordinate system based on the ultrasonic window saturation, the contact force data and a preset contact force expected value. The ultrasonic image and the contact force data are fused, the ultrasonic convex array probe is controlled to be tightly attached to the skin, and the automatic scanning image quality of the ultrasonic robot is effectively improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to an automatic laminating method and device for a convex array probe used for ultrasonic robot scanning. Background Art

[0002] In ultrasound examination, ultrasound convex array probes are often used for organs that are deep from the body surface, such as the liver, kidneys, lungs, abdomen, pelvis, and chest. During the automatic scanning process of the ultrasound robot, the ultrasound convex array probe needs to fit the human skin fully, otherwise it will seriously affect the imaging quality of the ultrasound image, miss a lot of key ultrasound section information, and lead to missed diagnosis. Therefore, in order to improve the imaging quality of the ultrasound robot using the convex array probe for automatic scanning, it is urgent to provide a method to control the ultrasound convex array probe to fit closely with the skin. Summary of the invention

[0003] In order to control the close fitting of the ultrasonic convex array probe to the skin and effectively improve the ultrasonic scanning image quality of the ultrasonic robot, the present invention proposes a method and device for automatically fitting the convex array probe for ultrasonic robot scanning. The technical solution proposed by the present invention is as follows:

[0004] In a first aspect, the present invention provides a method for automatically attaching a convex array probe for ultrasonic robot scanning, comprising:

[0005] During the entire movement of the ultrasonic robot, the image center of gravity inclination is calculated based on the real-time acquired ultrasonic image;

[0006] If the image center of gravity inclination does not meet the first preset condition, then planning the rotation offset of the ultrasonic convex array probe around the first coordinate axis of the tool coordinate system based on the image center of gravity inclination and a preset expected value of the image center of gravity inclination;

[0007] Acquire an ultrasonic image after the ultrasonic convex array probe moves according to the rotation offset, and calculate the ultrasonic window saturation;

[0008] If the ultrasonic window saturation does not meet the second preset condition, the contact force data of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system is obtained, and the movement displacement of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system is planned based on the ultrasonic window saturation, the contact force data and the preset expected contact force value.

[0009] In one or some embodiments, the image center of gravity inclination is determined by:

[0010] Segmenting the ultrasound image according to a preset number of segmentations to obtain an image sequence, and calculating the image grayscale mean of all sub-images in the image sequence to obtain an image grayscale mean sequence;

[0011] Binarizing the image grayscale mean sequence to obtain a binarized sequence;

[0012] The maximum angle of the ultrasound window is obtained, and the inclination of the image center of gravity is calculated based on the maximum angle of the ultrasound window and the binarization sequence by the following formula:

[0013]

[0014] Where θ is the inclination of the image center of gravity, α is the maximum angle of the ultrasound window, s(j) is the binarization value of the jth sub-image in the binarization sequence, and n is the number of segmentations.

[0015] In one or some embodiments, ultrasound window saturation is determined by:

[0016] The ultrasound window saturation is calculated based on the number of segmentations and the binary sequence by the following formula:

[0017]

[0018] Where ω is the ultrasound window saturation.

[0019] In one or some embodiments, if the image center of gravity inclination does not meet the first preset condition, planning the rotation offset of the ultrasonic convex array probe around the first coordinate axis of the tool coordinate system based on the image center of gravity inclination and a preset expected value of the image center of gravity inclination includes:

[0020] If the image center of gravity inclination does not meet the first preset condition, calculating the image center of gravity inclination deviation based on the image center of gravity inclination and a preset image center of gravity inclination expected value;

[0021] According to the preset planning parameters and the image center of gravity inclination deviation, the rotation offset of the ultrasonic convex array probe around the first coordinate axis of the tool coordinate system is planned and obtained.

[0022] In one or some embodiments, the planning to obtain the rotation offset of the ultrasonic convex array probe around the first coordinate axis of the tool coordinate system according to the preset planning parameters and the image gravity center inclination deviation includes:

[0023] According to the preset planning parameters and the inclination deviation of the center of gravity of the image, the rotation offset of the convex array probe around the first coordinate axis of the tool coordinate system is calculated by the following formula; wherein the preset planning parameters include proportional link parameters, integral link parameters, and differential link parameters;

[0024]

[0025] Where Δθ(t) is the image center of gravity inclination deviation at the tth moment, rotx(t) is the rotation offset of the ultrasonic convex array probe around the first coordinate axis of the tool coordinate system at the tth moment, and k p , ki , k d They are respectively the proportional link parameters, integral link parameters, and differential link parameters.

[0026] In one or some embodiments, if the ultrasonic window saturation does not meet the second preset condition, obtaining contact force data of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system, and planning the movement displacement of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system based on the ultrasonic window saturation, the contact force data and a preset expected contact force value, including:

[0027] If the ultrasonic window saturation does not meet the second preset condition, then obtaining the contact force data of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system and multiple parameters of the ultrasonic robot; wherein the multiple parameters include a mass coefficient, a damping coefficient and an ultrasonic window saturation coefficient;

[0028] Substituting the multiple parameters, the ultrasonic window saturation, the contact force data of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system and the preset expected contact force value into the following formula, the movement displacement of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system is obtained:

[0029]

[0030] Where, ΔF z (t) is the contact force deviation at the tth moment, F z (t) is the contact force data of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system at the tth moment, F 0 is the expected value of contact force, K w is the ultrasonic window saturation coefficient, ω(t) is the ultrasonic window saturation at the tth moment, ΔX z is the displacement of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system, is the movement speed of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system, is the motion acceleration of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system, M is the mass coefficient, and B is the damping coefficient.

[0031] In a second aspect, the present invention provides a convex array probe automatic bonding device for ultrasonic robot scanning, comprising:

[0032] The first calculation module is used to calculate the inclination of the center of gravity of the image based on the real-time acquired ultrasonic image during the entire movement process of the ultrasonic robot;

[0033] A first planning module, configured to plan a rotation offset of the ultrasonic convex array probe around a first coordinate axis of a tool coordinate system based on the image center of gravity inclination and a preset expected value of the image center of gravity inclination if the image center of gravity inclination does not meet a first preset condition;

[0034] A second calculation module is used to obtain an ultrasonic image after the ultrasonic convex array probe moves according to the rotation offset, and calculate the ultrasonic window saturation;

[0035] The second planning module is used to obtain the contact force data of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system if the ultrasonic window saturation does not meet the second preset condition, and plan the movement displacement of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system based on the ultrasonic window saturation, the contact force data and the preset contact force expected value.

[0036] In a third aspect, the present invention provides a computer program product, comprising a computer program / instruction, which, when executed by a processor, implements the steps of the method for automatic fitting of a convex array probe for ultrasonic robot scanning as described in the first aspect.

[0037] In a fourth aspect, the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the method for automatic bonding of a convex array probe for ultrasonic robot scanning as described in the first aspect.

[0038] In a fifth aspect, the present invention provides an electronic device, comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus;

[0039] Memory, used to store computer programs;

[0040] The processor is used to implement the steps of the automatic bonding method of the convex array probe for ultrasonic robot scanning as described in the first aspect when executing the program stored in the memory.

[0041] Based on the above technical solution, the beneficial effects of the present invention compared with the prior art are as follows:

[0042] The present invention provides an automatic fitting method for a convex array probe for ultrasonic robot scanning. During the entire movement process of the ultrasonic robot, the image center of gravity inclination is calculated based on the real-time acquired ultrasonic image. If the image center of gravity inclination does not meet the first preset condition, it means that one side of the ultrasonic convex array probe is not in contact with the skin. Then, based on the image center of gravity inclination and the preset expected value of the image center of gravity inclination, the rotation offset of the ultrasonic convex array probe around the first coordinate axis of the tool coordinate system is planned; then, an ultrasonic image after the ultrasonic convex array probe moves according to the rotation offset is obtained, and the ultrasonic window saturation is calculated; if the ultrasonic window saturation does not meet the second preset condition, it means that the ultrasonic convex array probe is not in full contact with the skin, then the contact force data of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system is obtained, and the movement displacement of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system is planned in real time based on the ultrasonic window saturation, the contact force data and the preset expected contact force value. The present invention integrates the ultrasonic image and the contact force data, controls the ultrasonic convex array probe to fit closely to the skin, and effectively improves the ultrasonic scanning image quality of the ultrasonic robot.

[0043] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention are realized and obtained by the structures particularly pointed out in the description, claims and drawings.

[0044] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0046] Figure 1 It is a schematic flow chart of a method for automatically fitting a convex array probe for ultrasonic robot scanning provided by an embodiment of the present invention;

[0047] Figure 2 is a schematic diagram of abdominal scanning by an ultrasonic robot provided in an embodiment of the present invention;

[0048] Figure 3 It is a schematic diagram of convex array arc-shaped ultrasonic image averaging provided by an embodiment of the present invention;

[0049] Figure 4 It is a schematic diagram of the lamination control by rotating around the X-axis of the tool coordinate system provided by an embodiment of the present invention;

[0050] Figure 5 It is a schematic diagram of fully fitting control by moving downward along the Z-axis of the tool coordinate system provided by an embodiment of the present invention;

[0051] Figure 6 It is a structural schematic diagram of an automatic bonding device for a convex array probe for ultrasonic robot scanning provided by an embodiment of the present invention;

[0052] Figure 7 It is a schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0053] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0054] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0055] The inventor found in his work that the existing methods mainly focus on the fitting of linear array probes, and the posture of the linear array probe is adjusted by external cameras, image confidence maps and other methods to achieve adaptive fitting. Unlike linear array probes, the surface of convex array probes is a curved surface, which makes it impossible to achieve tight fitting simply by adjusting the posture, and the imaging is fan-shaped, which makes the calculation of the missing fitting area complicated and cannot meet the inventor's expectations. To this end, the inventor has further researched and developed a method and device for automatic fitting of convex array probes for ultrasonic robot scanning. This method can be used for automatic fitting control of convex array probes during ultrasonic scanning, such as convex array probe fitting control when an ultrasonic robot automatically scans abdominal organs. This method does not require an external camera. By fusing ultrasonic images and contact force data, the ultrasonic convex array probe is controlled to fit tightly to the skin, effectively improving the ultrasonic scanning image quality of the ultrasonic robot.

[0056] Embodiment 1

[0057] The embodiment of the present invention provides a method for automatically fitting a convex array probe for ultrasonic robot scanning, referring to Figure 1 As shown, including:

[0058] S101. During the entire movement of the ultrasonic robot, the image center of gravity inclination is calculated based on the ultrasonic image acquired in real time.

[0059] When the ultrasonic robot drives the ultrasonic convex array probe to scan the part to be scanned, such as the abdominal area, it is necessary to evaluate the degree of fit between the ultrasonic convex array probe and the skin in order to determine whether the ultrasonic convex array probe is fully fitted to the skin. During the entire movement process of the ultrasonic robot, the present invention analyzes the ultrasonic image and calculates the image center of gravity inclination θ and the ultrasonic window saturation ω in real time to evaluate whether the ultrasonic convex array probe is fully fitted to the skin. If the image center of gravity inclination θ does not meet the first preset condition, or the ultrasonic window saturation ω does not meet the second preset condition, or the image center of gravity inclination θ does not meet the first preset condition and the ultrasonic window saturation ω does not meet the second preset condition, it means that the ultrasonic convex array probe is not fully fitted to the skin, and it is necessary to control the ultrasonic convex array probe to perform fitting movement on the part to be scanned.

[0060] S102: If the image center of gravity inclination does not meet a first preset condition, planning a rotation offset of the ultrasonic convex array probe around a first coordinate axis of a tool coordinate system based on the image center of gravity inclination and a preset expected value of the image center of gravity inclination.

[0061] When the ultrasonic convex array probe contacts the skin, the image center of gravity inclination of the ultrasonic image is calculated. Determine whether the image center of gravity inclination meets the first preset condition. If the image center of gravity inclination does not meet the first preset condition, it means that one side of the ultrasonic convex array probe is not in contact with the skin. At this time, it is necessary to control the ultrasonic convex array probe to rotate around the first coordinate axis of the tool coordinate system. Based on the image center of gravity inclination and the preset expected value of the image center of gravity inclination, the rotation offset of the ultrasonic convex array probe around the first coordinate axis of the tool coordinate system is planned, so that the ultrasonic convex array probe rotates around the first coordinate axis of the tool coordinate system according to the above rotation offset to achieve fitting control. If the image center of gravity inclination meets the first preset condition, the ultrasonic convex array probe does not need to rotate at this time.

[0062] S103, obtaining an ultrasonic image after the ultrasonic convex array probe moves according to the rotation offset, and calculating the ultrasonic window saturation;

[0063] If the inclination of the image center of gravity meets the first preset condition, since there is no need for the ultrasonic convex array probe to rotate, the ultrasonic image after the movement according to the rotation offset is the ultrasonic image in the above S101, and the ultrasonic window saturation of the ultrasonic image is calculated. If the inclination of the image center of gravity does not meet the first preset condition, when the ultrasonic convex array probe rotates around the first coordinate axis of the tool coordinate system according to the above rotation offset, the ultrasonic convex array probe and the skin are initially attached. Obtain the ultrasonic image after the ultrasonic convex array probe moves according to the rotation offset, and calculate the ultrasonic window saturation of the ultrasonic image.

[0064] S104. If the ultrasonic window saturation does not meet the second preset condition, the contact force data of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system is obtained, and the movement displacement of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system is planned based on the ultrasonic window saturation, the contact force data and the preset expected contact force value.

[0065] Determine whether the ultrasonic window saturation of the ultrasonic image meets the second preset condition. If the ultrasonic window saturation meets the second preset condition, it means that the ultrasonic convex array probe acoustic window surface is in full contact with the skin. At this time, the ultrasonic image quality has reached the expected level and no further adjustment is required. If the ultrasonic window saturation does not meet the second preset condition, it means that the ultrasonic convex array probe acoustic window surface is not in full contact with the skin. It is necessary to increase the contact force between the ultrasonic convex array probe and the skin surface so that the skin fully wraps the ultrasonic convex array probe and the ultrasonic convex array probe reaches a full contact state with the skin. Based on the above ultrasonic window saturation, the above contact force data and the preset contact force expected value, plan the movement displacement of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system. Then control the ultrasonic convex array probe to move downward along the second coordinate axis of the tool coordinate system according to the planned movement displacement, so that the ultrasonic convex array probe acoustic window surface is in full contact with the skin. The contact force data of the above ultrasonic convex array probe along the second coordinate axis of the tool coordinate system can be collected by a force sensor installed on the mechanical arm of the ultrasonic robot.

[0066] The embodiment of the present invention provides an automatic fitting method for a convex array probe for ultrasonic robot scanning. During the entire movement process of the ultrasonic robot, the ultrasonic image is analyzed and calculated in real time to obtain the inclination θ of the center of gravity of the ultrasonic image and the saturation ω of the ultrasonic window, so as to evaluate whether the ultrasonic convex array probe is fully fitted to the skin. The ultrasonic convex array probe is controlled in real time to perform fitting movement on the part to be scanned according to the planned rotation offset and motion displacement. The ultrasonic convex array probe is controlled to fit closely to the skin by fusing the ultrasonic image and contact force data, thereby effectively improving the ultrasonic scanning image quality of the ultrasonic robot.

[0067] In an optional embodiment, the inclination of the center of gravity of the image in the present invention is determined by the following method:

[0068] S201 . Segment an ultrasound image according to a preset number of segmentations to obtain an image sequence, and calculate the image grayscale mean of all sub-images in the image sequence to obtain an image grayscale mean sequence.

[0069] Reference Figure 3As shown, for a convex array arc-shaped ultrasound image, starting from the arc center O and the central axis U, the image is divided into 2n equal parts on both sides at a fixed angle Δθ. The image sequence after equal division is recorded as A = [x(-n), x(-(n-1)), …, x(-1), x(1), …, x(n-1), x(n)]. Then, the image grayscale mean value of all sub-images in the image sequence A is calculated as follows:

[0070]

[0071] In the formula, is the grayscale mean of the sub-image, m is the number of pixels in the sub-image, x i is the gray value of the i-th pixel in the sub-image. After calculating the mean of the image sequence A, the image gray mean sequence is obtained

[0072] The angle Δθ can be set according to actual segmentation needs. For example, the angle Δθ can be set to 0.005 rad, and n is calculated based on the maximum angle α of the ultrasound window and the angle Δθ.

[0073] S202: the image grayscale mean sequence Binarization is performed, and the binarization method is as follows:

[0074]

[0075] Where ε is the pixel mean threshold, which can be set according to the actual binarization needs, such as 20.

[0076] Image grayscale mean sequence After binarization, the binary sequence C = [s(-n), s(-(n-1)), ..., s(-1), s(1), ..., s(n-1), s(n)] is obtained.

[0077] S203, obtaining the maximum angle of the ultrasound window, and calculating the image center of gravity inclination based on the maximum angle α of the ultrasound window and the binarization sequence C by the following formula:

[0078]

[0079] In the formula, θ is the inclination of the image center of gravity, α is the maximum angle of the ultrasound window, s(j) is the binarization value of the jth sub-image in the binarization sequence C, and n is the number of segmentations. The above-mentioned maximum angle of the ultrasound window α is related to the ultrasound equipment and parameters, refer to Figure 3 As shown, the maximum angle α of the ultrasound window is the angle between the rays from x(-n) to x(n), which can be

[0080] In an optional embodiment, the ultrasound window saturation in the present invention is determined by the following method:

[0081] The ultrasonic window saturation is calculated based on the segmentation number n and the binary sequence C by the following formula:

[0082]

[0083] Where ω is the ultrasound window saturation.

[0084] The present invention controls the ultrasonic convex array probe to refer to Figure 2 The tool coordinate system {T} shown in FIG. 1 is moved in a fitting manner on the part to be scanned. The tool coordinate system mentioned above refers to the tool coordinate system along the end of the robot arm. The first coordinate axis and the second coordinate axis correspond to Figure 2 The X-axis and Z-axis in.

[0085] In an optional embodiment, if the inclination of the image center of gravity does not meet the first preset condition, it means that one side of the ultrasonic convex array probe is not in contact with the skin. In this case, the ultrasonic convex array probe needs to be controlled to rotate around the X-axis of the tool coordinate system (refer to Figure 4 As shown), based on the image center of gravity inclination and the preset expected value of the image center of gravity inclination, the rotation offset of the ultrasonic convex array probe around the X-axis of the tool coordinate system is planned, so that the ultrasonic convex array probe is rotated around the X-axis of the tool coordinate system according to the above rotation offset to achieve fitting control.

[0086] The first preset condition can be set to the image center of gravity inclination being less than or equal to a preset angle threshold, or the image center of gravity inclination being within a preset angle range, or the image center of gravity inclination θ=0. The preset angle threshold and the preset angle range can be set according to the requirements of the ultrasound image quality. Taking the first preset condition setting the image center of gravity inclination θ=0 as an example, when the image center of gravity inclination θ≠0, it means that one side of the ultrasound convex array probe is not in contact with the skin, and at this time, it is necessary to control the ultrasound convex array probe to rotate around the X-axis of the tool coordinate system.

[0087] In the above S102, if the image center of gravity inclination does not meet the first preset condition, then planning the rotation offset of the ultrasonic convex array probe around the X-axis of the tool coordinate system based on the image center of gravity inclination and a preset expected value of the image center of gravity inclination specifically includes the following steps:

[0088] S1021. If the image center of gravity inclination does not meet the first preset condition, the image center of gravity inclination deviation is calculated based on the image center of gravity inclination and a preset expected value of the image center of gravity inclination by the following formula:

[0089] Δθ(t)=θ(t)-θ d , Formula 5

[0090] Where θ(t) is the image center of gravity inclination at the tth moment, Δθ(t) is the image center of gravity inclination deviation at the tth moment, and θ d is the expected value of the image center of gravity inclination. d It can be set according to the requirement for ultrasound image quality, for example, it can be 0.

[0091] S1022: According to preset planning parameters and the image center of gravity inclination deviation, a rotation offset of the ultrasonic convex array probe around the X-axis of the tool coordinate system is obtained by planning.

[0092] The above-mentioned preset planning parameters refer to the PID controller parameters that control the rotation of the ultrasonic robot. The PID controller achieves precise control of the output deviation by adjusting the parameters of the three links of proportion, integration and differentiation. A function for determining the rotation offset of the ultrasonic convex array probe around the X-axis of the tool coordinate system is constructed based on the preset planning parameters of the ultrasonic robot and the image center of gravity inclination deviation. After the function is constructed, the image center of gravity inclination deviation determined by S1021 above is input into the function to obtain the rotation offset of the ultrasonic convex array probe around the X-axis of the tool coordinate system. After determining the rotation offset, the planned rotation offset is converted into a control instruction and sent to the control system of the ultrasonic robot. After receiving the instruction, the control system drives the ultrasonic convex array probe to rotate around the X-axis of the tool coordinate system.

[0093] In an optional embodiment, the planning to obtain the rotation offset of the ultrasonic convex array probe around the X-axis of the tool coordinate system according to the preset planning parameters and the image gravity center inclination deviation includes:

[0094] According to the preset planning parameters and the inclination deviation of the center of gravity of the image, the rotation offset of the ultrasonic convex array probe around the X-axis of the tool coordinate system is calculated by the following formula; wherein the preset planning parameters include proportional link parameters, integral link parameters, and differential link parameters;

[0095]

[0096] Where rotx(t) is the rotation offset of the ultrasonic convex array probe around the X-axis of the tool coordinate system at the tth moment, k p , k i , k d They are respectively the proportional link parameters, integral link parameters, and differential link parameters.

[0097] In the process of controlling the deflection of the ultrasonic robot, the parameters of the three links of proportion, integration and differentiation, namely the k p , k i , k d , to achieve precise control of the output deviation. It can be set according to the rotation performance and stability requirements of the ultrasonic robot, k p, k i , k d It can be set to 0.01, 0.001, and 0.02 respectively.

[0098] In an optional embodiment, the second preset condition may be set to an ultrasound window saturation that is less than or equal to a preset saturation threshold, or an ultrasound window saturation that is within a preset saturation range, or an ultrasound window saturation ω=1. The preset saturation threshold and preset saturation range may be set according to ultrasound image quality requirements. Taking the second preset condition being set to an ultrasound window saturation ω=1 as an example, when the ultrasound window saturation ω≠1, it means that the acoustic window surface of the ultrasound convex array probe is not in full contact with the skin, and it is necessary to increase the contact force between the ultrasound convex array probe and the skin surface so that the skin fully wraps the ultrasound convex array probe to achieve full contact. Reference Figure 5 As shown, at this time, the tool moves downward along the Z axis of the tool coordinate system according to the planned movement displacement, so that the acoustic window surface of the ultrasonic convex array probe is in full contact with the skin.

[0099] In the above S104, if the ultrasonic window saturation does not meet the second preset condition, the contact force data of the ultrasonic convex array probe along the Z axis of the tool coordinate system is obtained, and the movement displacement of the ultrasonic convex array probe along the Z axis of the tool coordinate system is planned based on the ultrasonic window saturation, the contact force data and the preset expected contact force value, which specifically includes the following steps:

[0100] S1041. If the ultrasonic window saturation does not meet the second preset condition, the contact force data of the ultrasonic convex array probe along the Z axis of the tool coordinate system and multiple parameters of the ultrasonic robot are obtained; wherein the multiple parameters include the mass coefficient M, the damping coefficient B and the ultrasonic window saturation coefficient K w .

[0101] S1042, substituting the multiple parameters, the ultrasonic window saturation, the contact force data of the ultrasonic convex array probe along the Z axis of the tool coordinate system, and the preset expected contact force value into the following formula to obtain the movement displacement of the ultrasonic convex array probe along the Z axis of the tool coordinate system:

[0102]

[0103] Where, ΔF z (t) is the contact force deviation at the tth moment, F z (t) is the contact force data of the ultrasonic convex array probe along the Z axis of the tool coordinate system at the tth moment, F 0 is the expected value of contact force, K w is the ultrasonic window saturation coefficient, ω(t) is the ultrasonic window saturation at the tth moment, ΔX z is the displacement of the ultrasonic convex array probe along the Z axis of the tool coordinate system, is the moving speed of the ultrasonic convex array probe along the Z axis of the tool coordinate system, is the motion acceleration of the ultrasonic convex array probe along the Z axis of the tool coordinate system, M is the mass coefficient, and B is the damping coefficient.

[0104] The above F 0 , K w , M, B are fixed parameters, and the above ultrasound window saturation coefficient K w It can be obtained from the technical manual of the ultrasonic robot, or set according to actual needs, such as 10. The above contact force expected value F 0 Under the premise of ensuring the patient's experience, it can be set according to the specific part to be scanned, such as 10N.

[0105] The mass coefficient M directly affects the interaction between the ultrasonic robot and the human skin, thereby affecting the control of the contact force. The mass coefficient M can be set according to actual needs to ensure the accuracy of the contact. The damping coefficient B determines the magnitude of the damping force between the ultrasonic robot and the human skin, which affects the stability of the ultrasonic robot's movement and the control of the contact force. A larger damping coefficient B can increase stability, enable the ultrasonic robot to stop or slow down movement faster, and reduce oscillation and overshoot. However, an excessively large damping coefficient B may also cause the robot to move unsmoothly, affecting the flexibility of operation. In human-machine collaborative tasks, the setting of the damping coefficient B needs to take into account the operating habits and feelings of the doctor or operator. A smaller damping coefficient B can make it easier for the operator to control the robot, but it may reduce the stability of the system. Therefore, the mass coefficient M and the damping coefficient can be set according to the requirements for the ultrasonic robot's contact force control, such as the mass coefficient M can be 50 and the damping coefficient B can be 5.

[0106] The present invention takes the first preset condition as being set to the image center of gravity inclination θ=0, and the second preset condition as being set to the ultrasound window saturation ω=1 as an example to illustrate the process of controlling the ultrasound convex array probe to perform fitting movement on the part to be scanned:

[0107] During the entire movement of the ultrasonic robot, the image gravity center inclination θ of the ultrasonic image is calculated in real time. It is determined whether the image gravity center inclination θ is 0.

[0108] If the image gravity center inclination θ=0, the ultrasound window saturation ω of the ultrasound image is calculated to determine whether the ultrasound window saturation ω is equal to 1. If the ultrasound window saturation ω≠1, it means that the ultrasound convex array probe acoustic window surface is not in full contact with the skin, and it is necessary to increase the contact force between the ultrasound convex array probe and the skin surface so that the skin fully wraps the ultrasound convex array probe to achieve full contact. Based on the calculated ultrasound window saturation ω and the obtained contact force data F z(t) and the expected contact force are calculated by the above formula 7 to calculate the displacement ΔX of the ultrasonic convex array probe along the Z axis of the tool coordinate system. z After the movement displacement is determined, move downward along the Z axis of the tool coordinate system according to the movement displacement (refer to Figure 5 As shown in the figure, the ultrasonic convex array probe acoustic window surface is in full contact with the skin. If the ultrasonic window saturation ω=1, it means that the ultrasonic convex array probe acoustic window surface is fully in contact with the skin.

[0109] If the image center of gravity inclination θ≠0, it means that one side of the ultrasonic convex array probe is not in contact with the skin, and the ultrasonic convex array probe needs to be controlled to rotate around the X-axis of the tool coordinate system. First, based on the image center of gravity inclination and the preset expected value of the image center of gravity inclination, the rotation offset rotx(t) of the ultrasonic convex array probe around the X-axis of the tool coordinate system is planned through equations 5 and 6. Then the ultrasonic convex array probe is controlled to rotate around the X-axis of the tool coordinate system according to the rotation offset (refer to Figure 4 ). Obtain an ultrasound image after the ultrasound convex array probe moves according to the rotation offset, calculate the ultrasound window saturation ω of the ultrasound image, and determine whether the ultrasound window saturation ω is equal to 1. If the ultrasound window saturation ω≠1, it means that the ultrasound window surface of the ultrasound convex array probe is not in full contact with the skin, and it is necessary to increase the contact force between the ultrasound convex array probe and the skin surface so that the skin fully wraps the ultrasound convex array probe to achieve a full contact state. Based on the ultrasound window saturation ω and the contact force data F z (t) and the expected contact force are calculated by the above formula 7 to calculate the displacement ΔX of the ultrasonic convex array probe along the Z axis of the tool coordinate system. z Then according to the planned movement displacement ΔX z Move downward along the Z axis of the tool coordinate system (refer to Figure 5 As shown in the figure, the ultrasonic convex array probe acoustic window surface is in full contact with the skin. If the ultrasonic window saturation ω=1, it means that the ultrasonic convex array probe acoustic window surface is fully in contact with the skin.

[0110] Embodiment 2

[0111] The embodiment of the present invention provides a convex array probe automatic bonding device for ultrasonic robot scanning, referring to Figure 6 As shown, including:

[0112] The first calculation module 301 is used to calculate the image gravity center inclination based on the real-time acquired ultrasonic image during the entire movement process of the ultrasonic robot;

[0113] A first planning module 302 is used to plan a rotation offset of the ultrasonic convex array probe around a first coordinate axis of a tool coordinate system based on the image center of gravity inclination and a preset expected value of the image center of gravity inclination if the image center of gravity inclination does not meet a first preset condition;

[0114] A second calculation module 303 is used to obtain an ultrasonic image after the ultrasonic convex array probe moves according to the rotation offset, and calculate the ultrasonic window saturation;

[0115] The second planning module 304 is used to obtain the contact force data of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system if the ultrasonic window saturation does not meet the second preset condition, and plan the movement displacement of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system based on the ultrasonic window saturation, the contact force data and the preset contact force expected value.

[0116] The implementation principle and technical effect of the automatic bonding device for convex array probes for ultrasonic robot scanning provided in the embodiment of the present invention are similar to those of the aforementioned method embodiment, and will not be repeated here.

[0117] Embodiment 3

[0118] An embodiment of the present invention provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements the steps of the method for automatic fitting of a convex array probe for ultrasonic robot scanning as described in the aforementioned method embodiment.

[0119] Embodiment 4

[0120] An embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon. When the program is executed by a processor, the steps of the method for automatic bonding of a convex array probe for ultrasonic robot scanning as described in the aforementioned method embodiment are implemented.

[0121] The computer-readable storage medium may be included in the device / apparatus described in the above embodiment; or it may exist independently without being assembled into the device / apparatus. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present invention is implemented.

[0122] According to an embodiment of the present invention, the computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present invention, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, apparatus, or device.

[0123] Embodiment 5

[0124] An embodiment of the present invention provides an electronic device, referring to Figure 7 As shown, it includes a processor 111, a communication interface 112, a memory 113 and a communication bus 114, wherein the processor 111, the communication interface 112 and the memory 113 communicate with each other through the communication bus 114;

[0125] Memory 113, used for storing computer programs;

[0126] The processor 111 is used to implement the steps of the automatic fitting method of the convex array probe for ultrasonic robot scanning as described in the above method embodiment when executing the program stored in the memory 113.

[0127] The implementation principle and technical effect of the electronic device provided by the embodiment of the present invention are similar to those of the aforementioned method embodiment, and will not be described in detail here.

[0128] The above-mentioned memory 113 can be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk or a ROM. The memory 113 has a storage space for program codes for executing any method steps in the above-mentioned method. For example, the storage space for program codes may include various program codes for implementing various steps in the above method respectively. These program codes can be read from or written into one or more computer program products. These computer program products include program code carriers such as hard disks, compact disks (CDs), memory cards or floppy disks. Such computer program products are usually portable or fixed storage units. The storage unit may have a storage segment or storage space arranged similarly to the memory 113 in the above-mentioned electronic device. The program code can be compressed, for example, in an appropriate form. Generally, the storage unit includes a program for executing the method steps according to an embodiment of the present invention, that is, a code that can be read by, for example, a processor 111, and when these codes are run by an electronic device, the electronic device performs the various steps in the method described above.

[0129] In this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that includes a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article, or apparatus.

[0130] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. It should be noted that the embodiments of the present invention and the features in the embodiments can be combined with each other without conflict. The present invention is not limited to any single aspect, any single embodiment, or any combination and / or permutation of these aspects and / or embodiments. Each aspect and / or embodiment of the present invention can be used alone, or in combination with one or more other aspects and / or other embodiments.

[0131] Those skilled in the art will appreciate that the embodiments of the present disclosure may be provided as methods, systems, or computer program products. Therefore, the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present disclosure may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer-usable program code.

[0132] The present disclosure is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present disclosure. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0133] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0134] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1The steps for the functions specified in one or more boxes.

[0135] Finally, it should be noted that the above-described embodiments are only specific implementations of the present invention, which are used to illustrate the technical solutions of the present invention, rather than to limit them. The protection scope of the present invention is not limited thereto. Although the present invention is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed by the present invention, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A method for automatically fitting a convex array probe for ultrasonic robot scanning, characterized in that: include: During the entire movement of the ultrasonic robot, the image center of gravity inclination is calculated based on the real-time acquired ultrasonic image; If the image center of gravity inclination does not meet the first preset condition, then planning the rotation offset of the ultrasonic convex array probe around the first coordinate axis of the tool coordinate system based on the image center of gravity inclination and a preset expected value of the image center of gravity inclination; Acquire an ultrasonic image after the ultrasonic convex array probe moves according to the rotation offset, and calculate the ultrasonic window saturation; If the ultrasonic window saturation does not meet the second preset condition, the contact force data of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system is obtained, and the movement displacement of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system is planned based on the ultrasonic window saturation, the contact force data and the preset expected contact force value.

2. The method for automatically attaching a convex array probe for ultrasonic robot scanning according to claim 1, characterized in that: The image center of gravity tilt is determined as follows: Segmenting the ultrasound image according to a preset number of segmentations to obtain an image sequence, and calculating the image grayscale mean of all sub-images in the image sequence to obtain an image grayscale mean sequence; Binarizing the image grayscale mean sequence to obtain a binarized sequence; The maximum angle of the ultrasound window is obtained, and the inclination of the image center of gravity is calculated based on the maximum angle of the ultrasound window and the binarization sequence by the following formula: Where θ is the inclination of the image center of gravity, α is the maximum angle of the ultrasound window, s(j) is the binarization value of the jth sub-image in the binarization sequence, and n is the number of segmentations.

3. The method for automatically attaching a convex array probe for ultrasonic robot scanning according to claim 2, characterized in that: Ultrasound window saturation is determined as follows: The ultrasound window saturation is calculated based on the number of segmentations and the binary sequence by the following formula: Where ω is the ultrasound window saturation.

4. The method for automatically attaching a convex array probe for ultrasonic robot scanning according to claim 1, characterized in that: If the image center of gravity inclination does not meet the first preset condition, planning the rotation offset of the ultrasonic convex array probe around the first coordinate axis of the tool coordinate system based on the image center of gravity inclination and a preset expected value of the image center of gravity inclination includes: If the image center of gravity inclination does not meet the first preset condition, calculating the image center of gravity inclination deviation based on the image center of gravity inclination and a preset image center of gravity inclination expected value; According to the preset planning parameters and the image center of gravity inclination deviation, the rotation offset of the ultrasonic convex array probe around the first coordinate axis of the tool coordinate system is planned and obtained.

5. The method for automatically attaching a convex array probe for ultrasonic robot scanning according to claim 4, characterized in that: The step of planning and obtaining the rotation offset of the ultrasonic convex array probe around the first coordinate axis of the tool coordinate system according to the preset planning parameters and the image gravity center inclination deviation includes: According to the preset planning parameters and the inclination deviation of the center of gravity of the image, the rotation offset of the ultrasonic convex array probe around the first coordinate axis of the tool coordinate system is calculated by the following formula; wherein the preset planning parameters include proportional link parameters, integral link parameters, and differential link parameters; Where Δθ(t) is the image center of gravity inclination deviation at the tth moment, rotx(t) is the rotation offset of the ultrasonic convex array probe around the first coordinate axis of the tool coordinate system at the tth moment, and k p , k i , k d They are respectively the proportional link parameters, integral link parameters, and differential link parameters.

6. The method for automatically attaching a convex array probe for ultrasonic robot scanning according to claim 1, characterized in that: If the ultrasonic window saturation does not meet the second preset condition, obtaining contact force data of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system, and planning the movement displacement of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system based on the ultrasonic window saturation, the contact force data and a preset expected contact force value, including: If the ultrasonic window saturation does not meet the second preset condition, then obtaining the contact force data of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system and multiple parameters of the ultrasonic robot; wherein the multiple parameters include a mass coefficient, a damping coefficient and an ultrasonic window saturation coefficient; Substituting the multiple parameters, the ultrasonic window saturation, the contact force data of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system and the preset expected contact force value into the following formula, the movement displacement of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system is calculated: Where, ΔF z (t) is the contact force deviation at the tth moment, F z (t) is the contact force data of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system at the tth moment, F0 is the expected value of the contact force, K w is the ultrasonic window saturation coefficient, ω(t) is the ultrasonic window saturation at the tth moment, ΔX z is the displacement of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system, is the movement speed of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system, is the motion acceleration of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system, M is the mass coefficient, and B is the damping coefficient.

7. An automatic bonding device for a convex array probe used for ultrasonic robot scanning, characterized in that: include: The first calculation module is used to calculate the inclination of the center of gravity of the image based on the real-time acquired ultrasonic image during the entire movement process of the ultrasonic robot; A first planning module, configured to plan a rotation offset of the ultrasonic convex array probe around a first coordinate axis of a tool coordinate system based on the image center of gravity inclination and a preset expected value of the image center of gravity inclination if the image center of gravity inclination does not meet a first preset condition; A second calculation module is used to obtain an ultrasonic image after the ultrasonic convex array probe moves according to the rotation offset, and calculate the ultrasonic window saturation; The second planning module is used to obtain the contact force data of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system if the ultrasonic window saturation does not meet the second preset condition, and plan the movement displacement of the ultrasonic convex array probe along the second coordinate axis of the tool coordinate system based on the ultrasonic window saturation, the contact force data and the preset contact force expected value.

8. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instruction is executed by the processor, the steps of the method for automatic fitting of a convex array probe for ultrasonic robot scanning as described in any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method for automatically fitting a convex array probe for ultrasonic robot scanning as described in any one of claims 1 to 6 are implemented.

10. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; Memory, used to store computer programs; The processor is used to implement the steps of the automatic bonding method of the convex array probe for ultrasonic robot scanning as described in any one of claims 1 to 6 when executing the program stored in the memory.

Citation Information

Patent Citations

  • Ultrasonic probe automatic pressure regulating method and device based on image deformation

    CN112472129A

  • Ultrasonic probe fitting control method, device and equipment and storage medium

    CN117257348A

  • Self-adaptive force control method for breast ultrasonic autonomous scanning robot

    CN118285841A

  • Thyroid transverse cutting-to-longitudinal cutting scanning method and device for ultrasonic robot

    CN118319362A

  • Ultrasonic measurement device, ultrasonic imaging device and control method of ultrasonic measurement device

    JP2015054006A

Cited By

  • Autonomous scanning method and system of breast ultrasonic robot

    CN119970090A