Medical image fusion data processing method and system

Abstract

The present invention provides a medical image fusion data processing method and system, which respond to the image fusion demand of the physician end, obtain a CT three-dimensional image of a target person and an ultrasonic dynamic video of a lesion area, wherein the ultrasonic dynamic video has multiple video frames, and the video frames have corresponding acquisition angles; determine the corresponding video frame in the ultrasonic dynamic video as a mapping frame based on the number of mapping intervals and a frame selection strategy, obtain the acquisition angle corresponding to the mapping frame as the mapping angle, and determine the lesion mapping area in the CT three-dimensional image according to the mapping angle; map the lesion mapping area to a preset combined mapping surface to obtain multiple mapping contours corresponding to the lesion area, and generate fusion display data corresponding to each mapping contour according to the contour interception strategy and the ultrasonic dynamic video; receive trigger information of the mapping contour from the physician end, use the corresponding mapping contour as the trigger contour based on the trigger information, retrieve the fusion display data corresponding to the trigger contour and send it to the physician end.

Description

Technical Field

[0001] The present invention relates to data processing technology, and in particular to a medical image fusion data processing method and system. Background Art

[0002] Medical imaging refers to the technology and process of obtaining images of internal tissues of the human body or a part of the human body in a non-invasive manner for the purpose of medical treatment or medical research. By interacting with the human body with the help of some medium (such as X-rays, electromagnetic fields, ultrasound, etc.), the structure and density of internal tissues and organs of the human body are displayed in the form of images, so that diagnostic physicians can make judgments based on the information provided by the images.

[0003] Currently, medical image fusion technology is relatively poor, resulting in inaccurate image analysis results, which can cause large errors when checking the diagnosis and seriously affect the image diagnosis results.

[0004] Therefore, how to integrate and display multiple medical images to facilitate personnel's viewing and thus improve personnel's diagnostic efficiency has become an urgent problem that needs to be solved. Summary of the invention

[0005] The present invention provides a medical image fusion data processing method and system, which can fuse and display multiple medical images to facilitate personnel's viewing, thereby improving personnel's diagnostic efficiency.

[0006] A first aspect of the present invention provides a medical image fusion data processing method, comprising:

[0007] In response to the image fusion requirements of the physician, a CT three-dimensional image of the target person and an ultrasound dynamic video of the lesion area are obtained, wherein the ultrasound dynamic video has a plurality of video frames, and each video frame has a corresponding acquisition angle;

[0008] Based on the number of mapping intervals and the frame selection strategy, a corresponding video frame in the ultrasound dynamic video is determined as a mapping frame, an acquisition angle corresponding to the mapping frame is obtained as a mapping angle, and a lesion mapping area in the CT three-dimensional image is determined according to the mapping angle;

[0009] Mapping the lesion mapping area to a preset combined mapping surface to obtain a plurality of mapping contours corresponding to the lesion area, and generating fusion display data corresponding to each of the mapping contours according to a contour interception strategy and the ultrasound dynamic video;

[0010] The trigger information of the mapping contour from the physician end is received, the corresponding mapping contour is used as a trigger contour based on the trigger information, and the fusion display data corresponding to the trigger contour is retrieved and sent to the physician end.

[0011] Optionally, in a possible implementation manner of the first aspect, before the step of determining a corresponding video frame in the ultrasound dynamic video as a mapping frame based on the number of mapping intervals and the frame selection strategy, acquiring an acquisition angle corresponding to the mapping frame as a mapping angle, and determining a lesion mapping area in the CT three-dimensional image according to the mapping angle, the method includes:

[0012] Obtaining the video duration corresponding to the ultrasound dynamic video, and counting the number of video frames within the video duration to obtain a total number of video frames;

[0013] According to the ratio of the total video frames to the video duration, an ultrasound frame rate corresponding to the ultrasound dynamic video is obtained, and according to the ratio of the ultrasound frame rate to a preset frame rate, a frame rate adjustment coefficient is obtained;

[0014] Retrieving a display comparison table, and obtaining a display level sent by the physician end, and determining a preset number of intervals in the display comparison table as an initial number of intervals based on the display level, wherein the display comparison table includes a one-to-one correspondence between preset levels and preset numbers of intervals;

[0015] The number of mapping intervals is obtained based on the product of the frame rate adjustment coefficient and the number of initial intervals.

[0016] Optionally, in a possible implementation manner of the first aspect, determining a corresponding video frame in the ultrasound dynamic video as a mapping frame based on the number of mapping intervals and a frame selection strategy, acquiring an acquisition angle corresponding to the mapping frame as a mapping angle, and determining a lesion mapping area in the CT three-dimensional image according to the mapping angle includes:

[0017] Selecting the first video frame in the ultrasound dynamic video as the initial video frame, and obtaining the last video frame in the ultrasound dynamic video as the termination video frame;

[0018] Determining a corresponding video frame in the ultrasound dynamic video as a mapping frame according to the initial video frame, the number of mapping intervals and the termination video frame;

[0019] An acquisition angle corresponding to the mapping frame is acquired as a mapping angle, a CT slice image in the CT three-dimensional image is determined according to the mapping angle, and a lesion mapping area of ​​the CT slice image is extracted.

[0020] Optionally, in a possible implementation manner of the first aspect, determining, according to the initial video frame, the number of mapping intervals and the termination video frame, a corresponding video frame in the ultrasound dynamic video as a mapping frame includes:

[0021] Based on the number of mapping intervals, determine the corresponding video frame in the ultrasound dynamic video as the selected video frame with the initial video frame as the starting point;

[0022] Acquire the acquisition angle corresponding to the initial video frame as the initial angle, and the acquisition angle corresponding to the selected video frame as the selected angle;

[0023] Determine the lesion mapping area in the corresponding CT slice image as the initial mapping area according to the initial angle, and retrieve the lesion mapping area in the corresponding CT slice image as the selected mapping area based on the selected angle;

[0024] Constructing a region comparison plane, mapping the initial mapping region and the selected mapping region into the region comparison plane, and obtaining an initial mapping contour corresponding to the initial mapping region and a selected mapping contour corresponding to the selected mapping region;

[0025] Obtaining an actual contour similarity value according to the initial mapping contour and the selected mapping contour;

[0026] When it is determined that the actual contour similarity value is less than the preset contour similarity value, based on the mapping interval number, the corresponding video frame in the ultrasound dynamic video is determined as the current selected video frame with the selected video frame as the starting point, and the mapping interval number is sequentially accumulated to obtain the cumulative interval number, and the above step of obtaining the actual contour similarity value is repeated;

[0027] until the actual contour similarity value is greater than or equal to the preset contour similarity value, or the accumulated interval number is greater than or equal to the maximum interval number, the currently selected video frame is used as the current initial video frame;

[0028] When it is determined that the actual contour similarity value is greater than or equal to the preset contour similarity value, the selected video frame is used as the current initial video frame;

[0029] When it is determined that the current initial video frame is not the termination video frame, the above steps are repeated until the current initial video frame is in the termination video frame, and all the initial video frames are used as mapping frames.

[0030] Optionally, in a possible implementation manner of the first aspect, obtaining an actual contour similarity value according to the initial mapping contour and the selected mapping contour includes:

[0031] Obtaining the center point of the regional comparison surface as the comparison midpoint, and constructing a comparison coordinate system with the comparison midpoint as the coordinate origin;

[0032] Calculating contour coordinate points in the selected mapped contour according to the comparison coordinate system to obtain a selected contour coordinate set corresponding to the selected mapped contour;

[0033] Obtain the minimum horizontal coordinate, the maximum horizontal coordinate, the minimum vertical coordinate and the maximum vertical coordinate in the selected contour coordinate set;

[0034] Calculate the horizontal distance based on the maximum horizontal coordinate and the minimum horizontal coordinate, calculate the vertical distance based on the maximum vertical coordinate and the minimum vertical coordinate, and determine the distance based on the absolute value of the difference between the horizontal distance and the vertical distance;

[0035] When it is determined that the judgment distance is greater than a preset difference value, a similarity evaluation rectangle is constructed according to the maximum horizontal coordinate, the minimum horizontal coordinate, the maximum vertical coordinate and the minimum vertical coordinate, and an actual contour similarity value between the initial mapping contour and the selected mapping contour is determined based on the similarity evaluation rectangle;

[0036] When it is determined that the judgment distance is less than or equal to the preset difference, a similarity evaluation circle is constructed according to the maximum horizontal coordinate, the minimum horizontal coordinate, the maximum vertical coordinate and the minimum vertical coordinate, and an actual contour similarity value of the initial mapping contour and the selected mapping contour is determined based on the similarity evaluation circle.

[0037] Optionally, in a possible implementation manner of the first aspect, when determining that the judgment distance is greater than a preset difference value, constructing a similarity evaluation rectangle according to the maximum horizontal coordinate, the minimum horizontal coordinate, the maximum vertical coordinate, and the minimum vertical coordinate, and determining an actual contour similarity value between the initial mapping contour and the selected mapping contour based on the similarity evaluation rectangle includes:

[0038] When it is determined that the judgment distance is greater than the preset difference, constructing a first vertical line according to the maximum horizontal coordinate, and constructing a second vertical line based on the minimum horizontal coordinate;

[0039] constructing a first horizontal line according to the maximum vertical coordinate, constructing a second horizontal line based on the minimum vertical coordinate, and generating a similarity evaluation rectangle based on the first vertical line, the second vertical line, the first horizontal line, and the second horizontal line;

[0040] Connecting the diagonal lines of the similarity evaluation rectangle to obtain two evaluation lines, obtaining a first evaluation intersection point between the evaluation line and the initial mapping contour, and obtaining a second evaluation intersection point between the corresponding evaluation line and the selected mapping contour;

[0041] The coordinates of the first evaluation intersection point and the second evaluation intersection point located on the same side of the evaluation line are calculated to obtain a line segment evaluation distance, and the line segment evaluation distance is averaged to obtain an actual contour similarity value between the initial mapping contour and the selected mapping contour.

[0042] Optionally, in a possible implementation manner of the first aspect, when determining that the judgment distance is less than or equal to a preset difference, constructing a similarity evaluation circle according to the maximum abscissa, the minimum abscissa, the maximum ordinate, and the minimum ordinate, and determining an actual contour similarity value between the initial mapping contour and the selected mapping contour based on the similarity evaluation circle includes:

[0043] When it is determined that the judgment distance is less than or equal to the preset difference, obtaining the central horizontal coordinate based on the average value of the maximum horizontal coordinate and the minimum horizontal coordinate;

[0044] Obtaining a central ordinate according to an average value of the maximum ordinate and the minimum ordinate;

[0045] Based on the central abscissa and the central ordinate, obtaining a central coordinate point corresponding to the selected mapping contour;

[0046] Determine the maximum distance between the contour coordinate point in the selected contour coordinate set and the center coordinate point as a construction radius;

[0047] Generate a similarity evaluation circle according to the central coordinate point and the construction radius;

[0048] Determine an intersection of the similarity evaluation circle and the selected mapping contour as an initial positioning point, determine a positioning diameter in the similarity evaluation circle based on the initial positioning point, rotate the positioning diameter in sequence based on a preset rotation direction and a preset rotation angle to obtain a plurality of rotation diameters, and count the rotation diameters and the positioning diameters to obtain a plurality of evaluation diameters;

[0049] Obtaining a third evaluation intersection point between the evaluation diameter and the initial mapping contour, and obtaining a fourth evaluation intersection point between the corresponding evaluation diameter and the selected mapping contour;

[0050] The coordinates of the third evaluation intersection point and the fourth evaluation intersection point located on the same side of the evaluation diameter are calculated to obtain a diameter evaluation distance, and the diameter evaluation distance is averaged to obtain an actual contour similarity value between the initial mapping contour and the selected mapping contour.

[0051] Optionally, in a possible implementation of the first aspect, the method further includes:

[0052] Acquire an actual contour similarity value adjacent to the mapped contour, and when it is determined that the actual contour similarity value is less than a preset contour similarity value, use the corresponding mapped contour as a similar contour;

[0053] An auxiliary trigger mark is constructed at the similar contour, and a corresponding distinguishing pixel value is configured for each of the mapped contours.

[0054] Optionally, in a possible implementation manner of the first aspect, generating fusion display data corresponding to each of the mapping contours according to the contour interception strategy and the ultrasound dynamic video includes:

[0055] Acquire the lesion area in the ultrasound dynamic video, and select the lesion contour with the largest lesion area in the ultrasound dynamic video as the interception contour based on OpenCV;

[0056] Intercepting a plurality of video frames in the ultrasound dynamic video according to the interception contour to obtain interception display data;

[0057] Acquire the playback time of the mapping frame corresponding to each of the mapping contours, and determine the playback time period corresponding to each of the mapping contours based on the playback time;

[0058] Based on the playing period, the corresponding intercepted display data is retrieved and bound with the corresponding mapping outline to obtain fused display data corresponding to each mapping outline.

[0059] A second aspect of an embodiment of the present invention provides a medical image fusion data processing system, including:

[0060] An acquisition module, used to respond to the image fusion requirements of the physician end, and acquire the CT three-dimensional image of the target person and the ultrasound dynamic video of the lesion area, wherein the ultrasound dynamic video has multiple video frames, and the video frames have corresponding acquisition angles;

[0061] a determination module, configured to determine a corresponding video frame in the ultrasound dynamic video as a mapping frame based on the number of mapping intervals and a frame selection strategy, obtain an acquisition angle corresponding to the mapping frame as a mapping angle, and determine a lesion mapping area in the CT three-dimensional image according to the mapping angle;

[0062] A generating module, used for mapping the lesion mapping area to a preset combined mapping surface, obtaining a plurality of mapping contours corresponding to the lesion area, and generating fusion display data corresponding to each of the mapping contours according to a contour interception strategy and the ultrasound dynamic video;

[0063] The sending module is used to receive the trigger information of the mapping contour from the physician end, take the corresponding mapping contour as the trigger contour based on the trigger information, retrieve the fusion display data corresponding to the trigger contour and send it to the physician end.

[0064] According to a third aspect of the present invention, there is provided an electronic device, comprising: a memory, a processor and a computer program, wherein the computer program is stored in the memory, and the processor runs the computer program to execute the first aspect of the present invention and various methods that may be involved in the first aspect.

[0065] According to a fourth aspect of the present invention, a storage medium is provided, in which a computer program is stored. When the computer program is executed by a processor, it is used to implement the first aspect of the present invention and various methods that may be involved in the first aspect.

[0066] The beneficial effects of the present invention are as follows:

[0067] 1. The present invention can fuse and display a variety of medical images, which is convenient for personnel to view, thereby improving the diagnostic efficiency of personnel. First, the present invention can obtain the CT three-dimensional image of the target person and the ultrasound dynamic video of the lesion area according to the image fusion requirements of the physician end, so as to fuse the CT image of the corresponding lesion area with the ultrasound dynamic video according to the requirements, thereby realizing the rapid viewing of personnel, wherein the present invention can select the mapping frame in the ultrasound dynamic video according to the number of mapping intervals, and can determine the lesion mapping area in the CT three-dimensional image according to the mapping angle corresponding to the mapping frame, so that in the fusion display process, the data processing amount can be reduced while ensuring that the information can be intuitively displayed after data fusion, which is convenient for personnel to quickly, secondly, the present invention can map the determined lesion mapping area at the preset combined mapping surface, thereby obtaining multiple mapping contours, and the corresponding fusion display data is associated, so that personnel can quickly retrieve the corresponding fusion display data for display by triggering the corresponding mapping contour, saving personnel's viewing time, thereby improving personnel's diagnostic efficiency.

[0068] 2. The present invention can adopt different judgment methods according to the difference in the horizontal and vertical distances of the selected mapping contour, so as to obtain accurate actual contour similarity values, thereby determining the corresponding lesion mapping area for mapping, so that there are obvious differences between different mapping contours, which reduces the amount of data processing and facilitates rapid viewing of data triggered by the mapping contour. Among them, the present invention can calculate the judgment distance of the corresponding contour through the obtained selected contour set, so as to determine the similar shape of the selected mapping contour, so as to judge the actual contour similarity value. When the judgment distance is greater than the preset difference, it can be explained that the difference between the corresponding distance in the horizontal direction and the distance in the vertical direction in the selected mapping contour is large, and a similarity evaluation rectangle can be constructed, so as to quickly and accurately determine the actual contour similarity value of the initial mapping contour and the selected mapping contour. When the judgment distance is less than or equal to the preset difference, it can be explained that the difference between the distance in the horizontal direction and the vertical direction of the selected mapping contour is not large, and a similarity evaluation circle can be used to accurately calculate the actual contour similarity value of the initial mapping contour and the selected mapping contour, so as to select the corresponding mapping frames with obvious differences between the contours, so as to determine the corresponding lesion mapping area for mapping, so as to facilitate the subsequent information viewing of the personnel, thereby improving the diagnosis efficiency of the personnel.

[0069] 3. The present invention can construct an auxiliary trigger mark on the mapping contour and configure a corresponding distinguishing pixel value for each mapping contour, so that personnel can clearly determine the information of the mapping contour that needs to be viewed, and quickly trigger the corresponding mapping contour for information viewing. Among them, the present invention configures a corresponding distinguishing pixel value for each mapping contour, so that personnel can clearly distinguish the mapping contour of the lesion mapping area of ​​different CT slice images mapped on the preset combined mapping surface, thereby facilitating accurate triggering by medical staff, so as to view the corresponding fusion display data, so as to improve diagnostic efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] Figure 1 A flowchart of a medical image fusion data processing method provided by the present invention;

[0071] Figure 2 A schematic diagram of a first evaluation point and a second evaluation point provided by the present invention;

[0072] Figure 3 A schematic diagram of a third evaluation point and a fourth evaluation point provided by the present invention;

[0073] Figure 4 A schematic diagram of the structure of a medical image fusion data processing system provided by the present invention;

[0074] Figure 5 A schematic diagram of the hardware structure of an electronic device provided by the present invention. DETAILED DESCRIPTION

[0075] The technical solution of the present invention is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0076] like Figure 1 As shown, the present invention provides a flow chart of a medical image fusion data processing method, the medical image fusion data processing method comprising:

[0077] S1, responding to the image fusion requirements of the physician, obtaining a CT three-dimensional image of the target person and an ultrasound dynamic video of the lesion area, wherein the ultrasound dynamic video has multiple video frames, and each video frame has a corresponding acquisition angle.

[0078] It should be noted that personnel usually perform CT examinations and B-ultrasound examinations when conducting physical diagnosis and treatment. Since the CT test results can clearly display the test images, but can only display static images, while the B-ultrasound test can display images from different test angles in real time, but the images are not clear, medical staff are required to observe and diagnose by repeatedly viewing the CT images and B-ultrasound images, which requires a lot of viewing time and seriously reduces the efficiency of image diagnosis. Therefore, the CT images and B-ultrasound images can be fused and displayed to achieve clear viewing of the lesion images and dynamic video images, so as to facilitate personnel's viewing of medical images and thus improve personnel's diagnostic efficiency.

[0079] It is understandable that when the physician needs to fuse the images for viewing, the server can obtain the corresponding target person's CT three-dimensional image and the ultrasound dynamic video of the lesion area to facilitate subsequent information fusion, thereby facilitating the medical staff's viewing.

[0080] Among them, the physician end is an information terminal for medical staff to view information, such as a computer, a mobile phone, etc. The image fusion requirement is the requirement information for image fusion, the target person is a person undergoing a physical examination, the CT three-dimensional image is a three-dimensional CT image, the lesion area is the area of ​​the body where the lesion occurs, and the ultrasound dynamic video is a detection video for ultrasound examination. In addition, the ultrasound dynamic video has multiple video frames, which are video data composed of video frame images. At the same time, when performing an ultrasound examination, the detection instrument will be moved for multi-angle inspection. Therefore, each video frame in the obtained ultrasound dynamic video has a corresponding acquisition angle, wherein the acquisition angle is the inspection angle during the ultrasound examination.

[0081] S2, based on the number of mapping intervals and the frame selection strategy, determine the corresponding video frame in the ultrasound dynamic video as the mapping frame, obtain the acquisition angle corresponding to the mapping frame as the mapping angle, and determine the lesion mapping area in the CT three-dimensional image according to the mapping angle.

[0082] It is understandable that there are a large number of video frames in the ultrasound dynamic video, among which there may be multiple consecutive video frames with the same lesion area. In order to reduce the amount of data processing, the mapping frames can be selected in the ultrasound dynamic video according to the number of mapping intervals, and the lesion mapping area in the CT three-dimensional image can be determined according to the mapping angle corresponding to the mapping frame, so as to facilitate the subsequent fusion and display of the ultrasound dynamic video and the CT three-dimensional image for personnel to view.

[0083] Among them, the number of mapping intervals is the number of intervals for image mapping, for example, it can be 5, 10, etc., the mapping frame is the video frame for disease image mapping, the mapping angle is the acquisition angle corresponding to the mapping frame, and the lesion mapping area is the image area in the CT three-dimensional image that indicates the occurrence of the lesion.

[0084] In some embodiments, before the steps of determining the corresponding video frame in the ultrasound dynamic video as the mapping frame based on the mapping interval number and the frame selection strategy, acquiring the acquisition angle corresponding to the mapping frame as the mapping angle, and determining the lesion mapping area in the CT three-dimensional image according to the mapping angle, a specific implementation method includes:

[0085] A1, obtaining the video duration corresponding to the ultrasound dynamic video, and counting the number of video frames within the video duration to obtain a total number of video frames.

[0086] It should be noted that due to the large number of video frames in the video, the image information displayed in multiple video frames may be the same. At the same time, there may be finer image details in a large number of different video frames. Therefore, in order to better retain the image detail information in the video frames, while making the contour of the lesion mapping area displayed after mapping have obvious changes and reducing the amount of data processing, the corresponding video frames in the ultrasound dynamic video can be selected as mapping frames according to the number of mapping intervals.

[0087] It can be understood that the video duration is the duration corresponding to the ultrasound dynamic video, such as 10 seconds, and the total video frames are the number of video frames within the video duration, such as 100 frames.

[0088] Through the above implementation, the present invention can obtain the video duration and the corresponding total video frames, so as to subsequently determine the corresponding number of mapping intervals, thereby selecting appropriate mapping frames.

[0089] A2, according to the ratio of the total video frames and the video duration, obtain the ultrasound frame rate corresponding to the ultrasound dynamic video, and according to the ratio of the ultrasound frame rate and the preset frame rate, obtain the frame rate adjustment coefficient.

[0090] It is understandable that the number of video frames in the same time period corresponding to different video frame rates is different, and thus the image information observed in the corresponding video frames may also be different. When the video frame rate is higher, the number of video frames corresponding to the same time period is higher, and thus the image information in the video frames is more detailed. When the video frame rate is lower, the number of video frames corresponding to the same time period is lower, and thus when adjacent video frames of the same length are selected for viewing, the difference in the corresponding image information will be greater.

[0091] Therefore, the ultrasound frame rate corresponding to the ultrasound dynamic video can be obtained according to the ratio of the total video frames to the video duration, and then the frame rate adjustment coefficient can be obtained, so as to automatically determine the corresponding number of mapping intervals according to the needs of the physician.

[0092] Among them, the ultrasound frame rate is the video frame rate of the ultrasound dynamic video, that is, the ultrasound frame rate is obtained by the ratio of the total video frames and the video duration, and the frame rate adjustment coefficient is the coefficient value for adjusting the video frame rate, that is, the ratio of the ultrasound frame rate to the preset frame rate, wherein the preset frame rate is a preset video frame rate, which can be manually preset according to actual conditions.

[0093] A3, retrieve the display comparison table, and obtain the display level sent by the physician, and determine the preset interval number in the display comparison table as the initial interval number based on the display level, wherein the display comparison table includes a one-to-one correspondence between the preset level and the preset interval number.

[0094] It can be understood that the display comparison table is a display table for selecting preset levels and preset interval numbers of video frames, wherein the display comparison table includes preset levels and preset interval numbers, and the preset levels and preset interval numbers are one-to-one corresponding, and the preset levels are preset display levels, for example, they can be high, medium and low, and the preset interval number is the preset number of intervals of video frames, for example, 10, 5, 1, etc., so that when the preset level in the display comparison table is high, the corresponding preset interval number is 10, when the preset level is medium, the corresponding preset interval number is 5, and when the preset level is low, the corresponding preset interval number is 1.

[0095] It is easy to understand that the display level is the clarity level of the video frames sent by the physician end for display, and the initial interval number is the preset interval number corresponding to the display level in the display comparison table.

[0096] For example, when the display level sent by the physician is a medium level, and the preset number of intervals corresponding to the medium level in the display comparison table is 5, the corresponding initial number of intervals is 5.

[0097] A4, obtaining the number of mapping intervals based on the product of the frame rate adjustment coefficient and the number of initial intervals.

[0098] It can be understood that the product obtained by multiplying the frame rate adjustment coefficient and the initial interval number is the mapping interval number.

[0099] Through the above implementation, the present invention can obtain the number of mapping intervals, so that the video frames of the ultrasound dynamic video can be automatically selected according to the calculated number of mapping intervals according to the needs of different physicians, so as to obtain mapping frames.

[0100] In some embodiments, the specific implementation of step S2 (determining the corresponding video frame in the ultrasound dynamic video as the mapping frame based on the mapping interval number and the frame selection strategy, acquiring the acquisition angle corresponding to the mapping frame as the mapping angle, and determining the lesion mapping area in the CT three-dimensional image according to the mapping angle) includes:

[0101] S21, selecting the first video frame in the ultrasound dynamic video as the initial video frame, and obtaining the last video frame in the ultrasound dynamic video as the termination video frame.

[0102] It can be understood that the initial video frame is the first video frame in the ultrasound dynamic video, and the termination video frame is the last video frame in the ultrasound dynamic video.

[0103] Through the above implementation, the present invention can obtain the initial video frame and the end video frame, so as to determine the mapping frame later, thereby determining the lesion mapping area in the CT three-dimensional image according to the mapping frame, and mapping the lesion mapping area.

[0104] S22: Determine a corresponding video frame in the ultrasound dynamic video as a mapping frame according to the initial video frame, the mapping interval number and the termination video frame.

[0105] It can be understood that, according to the initial video frame, the number of mapping intervals and the termination video frame, it is determined to select the video frame that meets the requirements from the ultrasonic dynamic video as the mapping frame, so as to obtain the corresponding fusion display data later.

[0106] In some embodiments, the specific implementation of step S22 (determining the corresponding video frame in the ultrasound dynamic video as the mapping frame according to the initial video frame, the number of mapping intervals and the termination video frame) includes:

[0107] S221: Determine the corresponding video frame in the ultrasound dynamic video as a selected video frame based on the number of mapping intervals and taking the initial video frame as a starting point.

[0108] It can be understood that, based on the number of mapping intervals, the initial video frame is used as a starting point, and the corresponding video frame in the ultrasound dynamic video is used as the selected video frame.

[0109] For example, when the number of mapping intervals is 5, the selected video frame is a video frame that is 5 frames apart from the initial video frame and corresponds to the sixth frame in the ultrasound dynamic video.

[0110] S222, obtaining a capture angle corresponding to the initial video frame as an initial angle, and a capture angle corresponding to the selected video frame as a selected angle.

[0111] It can be understood that the initial angle is the acquisition angle corresponding to the initial video frame, and the selected angle is the acquisition angle corresponding to the selected video frame.

[0112] Through the above implementation, the present invention can obtain the initial angle and the selected angle, so as to subsequently determine the lesion mapping area in the corresponding CT slice image according to the initial angle and the selected angle.

[0113] S223, determining a lesion mapping area in the corresponding CT slice image as an initial mapping area according to the initial angle, and retrieving a lesion mapping area in the corresponding CT slice image as a selected mapping area based on the selected angle.

[0114] It should be noted that the CT slice image is an image obtained by segmenting the CT three-dimensional image at multiple angles, so that the corresponding CT slice image in the CT three-dimensional image can be determined according to the corresponding angle, so as to determine the lesion mapping area in the CT slice image, thereby facilitating the subsequent mapping of the lesion area.

[0115] It can be understood that the initial mapping area is the lesion mapping area in the CT slice image corresponding to the initial angle, and the selected mapping area is the lesion mapping area in the CT slice image corresponding to the selected angle as the selected mapping area.

[0116] S224, constructing a region comparison plane, mapping the initial mapping region and the selected mapping region into the region comparison plane, and obtaining an initial mapping contour corresponding to the initial mapping region and a selected mapping contour corresponding to the selected mapping region.

[0117] It can be understood that the area comparison plane is a plane for comparing the lesion area, which can be preset manually and used to obtain the contour of the corresponding lesion mapping area.

[0118] The initial mapping contour is the area contour of the region corresponding to the initial mapping region, and the selected mapping contour is the area contour of the region corresponding to the selected mapping region.

[0119] S225: Obtaining an actual contour similarity value according to the initial mapping contour and the selected mapping contour.

[0120] It can be understood that the contour sizes of the initial mapping contour and the selected mapping contour are compared to obtain the actual contour similarity value, so as to determine the mapping contour that can be subsequently mapped on the preset combined mapping surface, and then, to facilitate the associated display of the corresponding fusion display data, so as to facilitate personnel to trigger viewing.

[0121] In some embodiments, the specific implementation of step S225 (obtaining the actual contour similarity value according to the initial mapping contour and the selected mapping contour) includes:

[0122] S2251, obtaining the center point of the comparison surface of the area as the comparison midpoint, and constructing a comparison coordinate system with the comparison midpoint as the coordinate origin.

[0123] It can be understood that the comparison midpoint is the center point of the area comparison surface, and the comparison coordinate system is the coordinate system in the area comparison surface.

[0124] It is not difficult to understand that a comparison coordinate system is constructed in the regional comparison plane to facilitate subsequent comparison calculation of the initial mapping contour and the selected mapping contour, thereby obtaining the actual contour similarity value.

[0125] S2252: Calculate contour coordinate points in the selected mapped contour according to the comparison coordinate system to obtain a selected contour coordinate set corresponding to the selected mapped contour.

[0126] It can be understood that the contour coordinate point is a position coordinate point corresponding to the mapped contour, and the selected contour coordinate set is a set of all contour coordinate points of the selected mapped contour.

[0127] Through the above implementation, the present invention can obtain a selected contour coordinate set, so as to subsequently determine the corresponding actual contour similarity value, thereby performing mapping display.

[0128] S2253, obtaining the minimum horizontal coordinate, the maximum horizontal coordinate, the minimum vertical coordinate and the maximum vertical coordinate in the selected contour coordinate set.

[0129] It can be understood that the minimum horizontal coordinate is the minimum horizontal coordinate value in the selected contour coordinate set, the maximum horizontal coordinate is the maximum horizontal coordinate value in the selected contour coordinate set, the minimum vertical coordinate is the minimum vertical coordinate value in the selected contour coordinate set, and the maximum vertical coordinate is the maximum vertical coordinate value in the selected contour coordinate set.

[0130] It is not difficult to understand that the minimum horizontal coordinate, the maximum horizontal coordinate, the minimum vertical coordinate and the maximum vertical coordinate are obtained in the selected contour coordinate set, so that the corresponding judgment method can be adopted later to obtain the actual contour similarity value.

[0131] S2254, calculate based on the maximum horizontal coordinate and the minimum horizontal coordinate to obtain the horizontal distance, calculate based on the maximum vertical coordinate and the minimum vertical coordinate to obtain the vertical distance, and obtain the judgment distance according to the absolute value of the difference between the horizontal distance and the vertical distance.

[0132] It should be noted that in order to determine the contour shape of the selected mapping contour, the corresponding judgment distance can be obtained through the horizontal distance and the vertical distance, so as to obtain the similar shape of the selected mapping contour, thereby judging the actual contour similarity value.

[0133] It can be understood that the horizontal distance is the difference between the maximum horizontal coordinate and the minimum horizontal coordinate, the vertical distance is the difference between the maximum vertical coordinate and the minimum vertical coordinate, and the judgment distance is the absolute value of the difference between the horizontal distance and the vertical distance.

[0134] S2255: When it is determined that the judgment distance is greater than a preset difference, a similarity evaluation rectangle is constructed according to the maximum horizontal coordinate, the minimum horizontal coordinate, the maximum vertical coordinate and the minimum vertical coordinate, and an actual contour similarity value between the initial mapping contour and the selected mapping contour is determined based on the similarity evaluation rectangle.

[0135] It can be understood that when the distance is judged to be greater than the preset difference, it can be explained that the difference between the corresponding distance in the horizontal direction and the distance in the vertical direction in the selected mapping contour is large, and the corresponding selected mapping contour is approximately a rectangle, so that a similarity evaluation rectangle can be constructed, so that the actual contour similarity value between the initial mapping contour and the selected mapping contour can be quickly and accurately determined.

[0136] Among them, the preset difference is a preset benchmark difference between the horizontal distance and the vertical distance, which can be preset manually, and the similarity evaluation rectangle is a rectangle used to determine the actual contour similarity value, and the actual contour similarity value is a numerical value for comparing the similarity between the initial mapping contour and the selected mapping contour.

[0137] It is not difficult to understand that the corresponding straight line segments are constructed according to the maximum horizontal coordinate, the minimum horizontal coordinate, the maximum vertical coordinate and the minimum vertical coordinate, so that the rectangle enclosed by the four straight line segments is the similarity evaluation rectangle.

[0138] In some embodiments, the specific implementation of step S2255 (when determining that the judgment distance is greater than a preset difference, constructing a similarity evaluation rectangle according to the maximum horizontal coordinate, the minimum horizontal coordinate, the maximum vertical coordinate and the minimum vertical coordinate, and determining the actual contour similarity value of the initial mapping contour and the selected mapping contour based on the similarity evaluation rectangle) includes:

[0139] S22551: When it is determined that the judgment distance is greater than a preset difference, a first vertical line is constructed according to the maximum horizontal coordinate, and a second vertical line is constructed based on the minimum horizontal coordinate.

[0140] It can be understood that when the judgment distance is greater than the preset difference, it can be explained that the difference of the corresponding selected mapping contour in the horizontal and vertical directions is large, so that the first vertical line can be constructed according to the maximum horizontal coordinate and the second vertical line can be constructed according to the minimum horizontal coordinate, so as to obtain the corresponding similarity evaluation rectangle subsequently.

[0141] The first vertical line is a straight line perpendicular to the horizontal axis and whose horizontal coordinate value is the maximum horizontal coordinate, and the second vertical line is a straight line perpendicular to the horizontal axis and whose horizontal coordinate value is the minimum horizontal coordinate.

[0142] S22552: construct a first horizontal line based on the maximum vertical coordinate, construct a second horizontal line based on the minimum vertical coordinate, and generate a similarity evaluation rectangle based on the first vertical line, the second vertical line, the first horizontal line, and the second horizontal line.

[0143] It can be understood that the first horizontal line is a straight line perpendicular to the vertical axis and whose vertical coordinate value is the maximum vertical coordinate, and the second horizontal line is a straight line perpendicular to the vertical axis and whose vertical coordinate value is the minimum vertical coordinate. Therefore, a similarity evaluation rectangle can be obtained based on the first vertical line, the second vertical line, the first horizontal line and the second horizontal line, so as to obtain the actual contour similarity value later.

[0144] S22553, connecting the diagonals of the similarity evaluation rectangle to obtain two evaluation lines, obtaining a first evaluation intersection point between the evaluation line and the initial mapping contour, and obtaining a second evaluation intersection point between the corresponding evaluation line and the selected mapping contour.

[0145] It should be noted that in order to accurately calculate the actual contour similarity value of the initial mapping contour and the selected mapping contour, the diagonals of the similarity evaluation rectangle can be connected to obtain the evaluation line, so that the corresponding line segment evaluation distance can be obtained according to the intersection of the initial mapping contour and the evaluation line and the intersection of the selected mapping contour and the evaluation line, and the actual contour similarity value can be calculated according to the line segment evaluation distance. The closer the corresponding line segment evaluation distance is, the more similar the initial mapping contour is to the selected mapping contour, and vice versa.

[0146] It can be understood that the evaluation line is the diagonal line of the similarity evaluation rectangle, the first evaluation intersection point is the intersection point of the evaluation line and the initial mapping contour, and the second evaluation intersection point is the intersection point of the evaluation line and the selected mapping contour.

[0147] For example: Figure 2 As shown, the first evaluation intersection point is obtained by intersecting the initial mapping contour with the evaluation line, and the second evaluation intersection point is obtained by intersecting the selected mapping contour with the evaluation line.

[0148] S22554, calculating the coordinates of the first evaluation intersection point and the second evaluation intersection point located on the same side of the evaluation line to obtain a line segment evaluation distance, performing mean processing on the line segment evaluation distance to obtain an actual contour similarity value between the initial mapping contour and the selected mapping contour.

[0149] It can be understood that the line segment evaluation distance is the distance between the first evaluation intersection point and the second evaluation intersection point located on the same side of the evaluation line. Figure 2 As shown, the distance between the first evaluation intersection point and the second evaluation intersection point adjacent to each other on the same evaluation line is the line segment evaluation distance.

[0150] It is not difficult to understand that through the similarity evaluation rectangle, four corresponding line segment evaluation distances can be obtained, and then the corresponding line segment evaluation distances are averaged to obtain the actual contour similarity value. For example, when the four line segment evaluation distances obtained are 0.1mm, 0.2mm, 0.3mm, and 0.2mm respectively, the actual contour similarity value is (0.1+0.2+0.3+0.2) / 4=0.2.

[0151] S2256, when it is determined that the judgment distance is less than or equal to the preset difference, a similarity evaluation circle is constructed according to the maximum horizontal coordinate, the minimum horizontal coordinate, the maximum vertical coordinate and the minimum vertical coordinate, and an actual contour similarity value between the initial mapping contour and the selected mapping contour is determined based on the similarity evaluation circle.

[0152] It can be understood that when the distance is judged to be less than or equal to the preset difference, it can be explained that the distance difference between the horizontal direction and the vertical direction of the selected mapping contour is not large, and it can be explained that the selected mapping contour is approximately a circle, so that a circle can be constructed based on the selected mapping contour to determine the actual contour similarity value between the initial mapping contour and the selected mapping contour.

[0153] The similarity evaluation circle is a circle used to evaluate the actual contour similarity value between the initial mapping contour and the selected mapping contour.

[0154] In some embodiments, the specific implementation of step S2256 (when determining that the judgment distance is less than or equal to a preset difference value, constructing a similarity evaluation circle according to the maximum horizontal coordinate, the minimum horizontal coordinate, the maximum vertical coordinate and the minimum vertical coordinate, and determining the actual contour similarity value of the initial mapping contour and the selected mapping contour based on the similarity evaluation circle) includes:

[0155] S22561: When it is determined that the judgment distance is less than or equal to a preset difference, a central horizontal coordinate is obtained based on an average value of the maximum horizontal coordinate and the minimum horizontal coordinate.

[0156] It can be understood that when the distance is judged to be less than or equal to the preset difference, the central horizontal coordinate can be obtained according to the maximum horizontal coordinate and the minimum horizontal coordinate, so as to subsequently construct a similarity evaluation circle, thereby determining the actual contour similarity value of the corresponding initial mapping contour and the selected mapping contour.

[0157] The central horizontal coordinate is the average value of the maximum horizontal coordinate and the minimum horizontal coordinate. For example, when the maximum horizontal coordinate is 10 and the minimum horizontal coordinate is 2, the corresponding central horizontal coordinate is (10+2) / 2=6.

[0158] S22562: Obtain the central ordinate according to the average value of the maximum ordinate and the minimum ordinate.

[0159] It can be understood that the central ordinate is the average of the maximum ordinate and the minimum ordinate. For example, when the maximum ordinate is 8 and the minimum ordinate is 2, the corresponding central ordinate is (8+2) / 2=5.

[0160] Through the above implementation, the present invention can obtain the central vertical coordinate, so as to determine the corresponding central coordinate point according to the central horizontal coordinate, thereby obtaining the center point of the similarity evaluation circle.

[0161] S22563: Based on the central horizontal coordinate and the central vertical coordinate, obtain a central coordinate point corresponding to the selected mapping contour.

[0162] It can be understood that the center coordinate point is the center point corresponding to the selected mapping contour. For example, when the center horizontal coordinate is 6 and the center vertical coordinate is 5, the center coordinate point can be obtained as the position point corresponding to the coordinate (6,5).

[0163] Through the above implementation, the present invention can obtain the center coordinate point, so as to determine the construction radius later, thereby constructing the corresponding similarity evaluation circle.

[0164] S22564, determining the maximum distance between the contour coordinate point in the selected contour coordinate set and the center coordinate point as the construction radius.

[0165] It can be understood that the construction radius is the maximum distance between the contour coordinate point and the center coordinate point in the selected contour coordinate set.

[0166] It is not difficult to understand that by selecting the maximum distance as the construction radius, the corresponding selected mapping contours can be completely included in the similarity evaluation circle constructed subsequently, so as to calculate the accurate actual contour similarity value and perform contour mapping.

[0167] S22565: Generate a similarity evaluation circle based on the central coordinate point and the construction radius.

[0168] It can be understood that, by taking the central coordinate point as the center of the circle and the construction radius as the radius of the circle, a corresponding similarity evaluation circle can be obtained, so as to subsequently determine the actual contour similarity value of the corresponding initial mapping contour and the selected mapping contour.

[0169] S22566, determining the intersection of the similarity evaluation circle and the selected mapping contour as the initial positioning point, determining the positioning diameter in the similarity evaluation circle based on the initial positioning point, rotating the positioning diameter in sequence based on a preset rotation direction and a preset rotation angle to obtain multiple rotation diameters, and counting the rotation diameters and the positioning diameters to obtain multiple evaluation diameters.

[0170] It should be noted that since the construction radius is obtained through the center coordinate point and the contour coordinate point in the contour coordinate set of the selected mapping contour, the constructed similarity evaluation circle must have an intersection with the selected mapping contour. Therefore, in order to make the subsequent calculated actual contour similarity value more accurate, the intersection can be used as the initial positioning point to facilitate the subsequent determination of the corresponding evaluation diameter, and then the diameter evaluation distance is obtained to calculate the actual contour similarity value.

[0171] It can be understood that the initial positioning point is the intersection of the similarity evaluation circle and the selected mapping contour, the positioning diameter is the diameter in the similarity evaluation circle with the initial positioning point as the endpoint, the preset rotation direction is the preset direction of rotation of the positioning diameter, such as clockwise, the preset rotation angle is the preset rotation angle, such as 45°, and the rotation diameter is the diameter of the positioning diameter after the rotation, for example. Figure 3 As shown, when the positioning diameter is rotated 45° in a clockwise direction, a rotation diameter can be obtained, and a second rotation diameter can be obtained by rotating 45° again until the similarity evaluation circle is evenly divided.

[0172] The evaluation diameter is the diameter for calculating the actual contour similarity value, including the rotation diameter and the positioning diameter.

[0173] S22567, obtaining a third evaluation intersection point between the evaluation diameter and the initial mapping contour, and obtaining a fourth evaluation intersection point between the corresponding evaluation diameter and the selected mapping contour.

[0174] It can be understood that the third evaluation intersection point is the intersection point of the evaluation diameter and the corresponding initial mapping contour, and the fourth evaluation intersection point is the intersection point of the evaluation diameter and the corresponding selected mapping contour.

[0175] like Figure 3As shown, the third evaluation intersection point is obtained by intersecting the evaluation diameter with the initial mapping contour, and the fourth evaluation intersection point is obtained by intersecting the evaluation diameter with the selected mapping contour.

[0176] Through the above implementation, the present invention can obtain the third evaluation intersection point and the fourth evaluation intersection point, so as to obtain the corresponding diameter evaluation distance subsequently, thereby calculating the corresponding actual contour similarity value.

[0177] S22568, calculating the coordinates of the third evaluation intersection point and the fourth evaluation intersection point located on the same side of the evaluation diameter to obtain the diameter evaluation distance, performing mean processing on the diameter evaluation distance to obtain the actual contour similarity value between the initial mapping contour and the selected mapping contour.

[0178] It can be understood that the diameter evaluation distance is the distance between the third evaluation intersection point and the fourth evaluation intersection point adjacent to each other on the evaluation diameter.

[0179] It is not difficult to understand that by averaging multiple diameter evaluation distances, the actual contour similarity value of the initial mapping contour and the selected mapping contour can be obtained, so that the corresponding video frames can be selected for display based on the actual contour similarity value, so as to facilitate intuitive viewing by personnel.

[0180] It should be noted that, according to the actual convex shape of the selected mapping contour, the corresponding angles are determined to adaptively divide the similarity evaluation circle, which can improve the accuracy of subsequent calculation of the actual contour similarity value. Therefore, in some embodiments, it also includes:

[0181] The convex point corresponding to the selected mapping contour is obtained, and the corresponding convex diameter is determined based on the convex point.

[0182] It can be understood that the raised point is the vertex of the selected mapping contour raised position, and the raised diameter is the diameter in the similarity evaluation circle determined based on the raised point. The raised diameter can be obtained by connecting and extending the raised point and the center point of the similarity evaluation circle and intersecting with the similarity evaluation circle respectively.

[0183] Through the above implementation, the present invention can obtain the protrusion diameter, so as to obtain the positioning angle according to the protrusion diameter, thereby determining the preset rotation angle.

[0184] The corresponding positioning angles are obtained based on the adjacent protrusion diameters, and the smallest positioning angle is selected as the preset rotation angle.

[0185] It can be understood that the positioning angle is the angle between adjacent protrusion diameters, so the positioning angle with the smallest angle value can be selected as the preset rotation angle.

[0186] For example, when the acquired positioning angles are 30°, 45°, and 105°, since 30°<45°<105°, 30° can be used as the preset rotation angle.

[0187] It is not difficult to understand that by selecting the minimum positioning angle as the preset rotation angle, so as to facilitate the subsequent rotation of the corresponding positioning diameter to obtain the rotation diameter, the corresponding similarity evaluation circle can be divided as much as possible to improve the accuracy of the actual contour similarity value.

[0188] It is worth mentioning that when there is only one raised point, a raised diameter can be obtained in the corresponding similarity evaluation circle. Therefore, the corresponding positioning angle is 180°, and the corresponding preset rotation angle can be 180°, that is, the corresponding raised diameter and the positioning diameter are the same diameter, so there is no need to rotate the positioning diameter, and the similarity evaluation circle can be divided into 180°.

[0189] S226, when it is determined that the actual contour similarity value is less than the preset contour similarity value, the corresponding video frame in the ultrasound dynamic video is determined as the current selected video frame based on the mapping interval number and taking the selected video frame as the starting point, and the mapping interval number is successively accumulated to obtain the cumulative interval number, and the above steps of obtaining the actual contour similarity value are repeated.

[0190] It can be understood that when the actual contour similarity value is less than the preset contour similarity value, it can be explained that the difference between the corresponding initial mapping contour and the selected mapping contour is small, and the two contours are extremely similar. Therefore, in order to enable the subsequent mapping contours on the preset combined mapping surface to be clearly distinguished, the selected video frame can be used as the starting point for selection, and the corresponding video frame is determined as the current selected video frame according to the interval mapping interval number, and the mapping interval number is accumulated to obtain the cumulative interval number, and the above steps of obtaining the actual contour similarity value are repeated to facilitate the subsequent determination of the corresponding video frame, thereby mapping the lesion mapping area, so as to perform a fusion display of the data and facilitate intuitive viewing by personnel.

[0191] Among them, the preset contour similarity value is a preset benchmark value for judging the degree of contour similarity, which can be preset manually. The currently selected video frame is determined based on the mapping interval number with the selected video frame as the starting point to determine the corresponding video frame in the ultrasound dynamic video. The cumulative interval number is the value after the mapping interval number is accumulated in sequence. For example, when the mapping interval number is 5, the accumulated mapping interval number after one accumulation is 5+5=10.

[0192] For example: when the number of mapping intervals is 5, after determining that the actual contour similarity value between the initial mapping contour in the first frame and the selected mapping contour corresponding to the 6th frame is less than the preset contour similarity value, the 6th frame is taken as the starting point, and the interval of 5 frames is continued to be backward, and the 11th frame is determined as the current selected video frame, and the number of mapping intervals is accumulated to obtain the accumulated interval number of 10, and then the process of determining the actual contour similarity values ​​of the contours corresponding to the 6th frame and the 11th frame is repeated to obtain the corresponding actual contour similarity values.

[0193] S227: until the actual contour similarity value is greater than or equal to the preset contour similarity value, or the accumulated interval number is greater than or equal to the maximum interval number, the currently selected video frame is used as the current initial video frame.

[0194] It can be understood that when the actual contour similarity value is greater than or equal to the preset contour similarity value or the cumulative number of intervals is greater than or equal to the maximum number of intervals, it can be explained that the contour of the lesion area in the corresponding selected video frame has obvious differences and can be viewed intuitively and clearly, so that the currently selected video frame can be used as the current initial video frame to facilitate the subsequent mapping frame to perform contour mapping on the corresponding lesion area, or when the accumulated number of intervals is greater than or equal to the maximum number of intervals, it can be explained that the number of interval video frames has reached a certain value. In order to ensure the accuracy of the fusion display data for subsequent data display and to ensure that personnel view a certain amount of image information, the corresponding currently selected video frame can be used as the current initial video frame.

[0195] The maximum interval number is the maximum value of the mapping interval number, which may be manually preset, for example, the maximum interval number may be 10.

[0196] S228: When it is determined that the actual contour similarity value is greater than or equal to the preset contour similarity value, the selected video frame is used as the current initial video frame.

[0197] It can be understood that when the actual contour similarity value is greater than or equal to the preset contour similarity value, it can be explained that there is an obvious difference between the lesion contour in the corresponding selected video frame and the initial video frame, so that the corresponding selected video frame can be directly used as the current initial video frame to facilitate the subsequent mapping of the corresponding lesion mapping area.

[0198] S229, when it is determined that the current initial video frame is not the termination video frame, repeat the above steps until the current initial video frame is in the termination video frame, and use all the initial video frames as mapping frames.

[0199] It can be understood that when the initial video frame is not the termination video frame, it can be said that the selection of the ultrasound dynamic video has not been completed, so the above-mentioned implementation process of selecting the current initial video frame will be repeated, so that the current initial video frame is in the termination video frame, that is, the selection of the ultrasound dynamic video is completed, so that all the initial video frames in the selection process are used as mapping frames, so as to facilitate the subsequent contour mapping of the corresponding lesion mapping area in the mapping frame, so as to facilitate the subsequent association of the corresponding fusion display data with the corresponding mapping contour, and then facilitate personnel to quickly view the corresponding fusion display data through the triggering of the mapping contour, thereby improving the diagnosis and treatment efficiency of personnel.

[0200] S23, acquiring an acquisition angle corresponding to the mapping frame as a mapping angle, determining a CT slice image in the CT three-dimensional image according to the mapping angle, and extracting a lesion mapping area of ​​the CT slice image.

[0201] It should be noted that when personnel conduct inspections, ultrasonic dynamic video is obtained by changing the acquisition angle, wherein each acquisition angle has a corresponding video frame image, and different position angles have corresponding CT slice images in the CT three-dimensional image. Therefore, the CT slice image in the CT three-dimensional image can be determined according to the mapping angle.

[0202] It can be understood that the mapping angle is the acquisition angle corresponding to the mapping frame, the CT slice image is the slice image in the CT three-dimensional image, and the lesion mapping area is the mapping image area corresponding to the lesion area in the CT slice image.

[0203] Through the above implementation, the present invention can obtain the lesion mapping area corresponding to the CT slice image, so as to facilitate subsequent mapping of the lesion mapping area.

[0204] S3, mapping the lesion mapping area to a preset combined mapping surface to obtain a plurality of mapping contours corresponding to the lesion area, and generating fusion display data corresponding to each of the mapping contours according to a contour interception strategy and the ultrasound dynamic video.

[0205] It can be understood that the lesion mapping area in the selected CT slice image is mapped within the preset combined mapping surface, so as to obtain multiple mapping contours corresponding to the lesion area in the ultrasound dynamic video, and generate fusion display data corresponding to each mapping contour, so as to associate the fusion display data with the corresponding mapping contour, so that when subsequent personnel click on each mapping contour, the corresponding fusion display data can be intuitively displayed, which is convenient for personnel to view, saves medical staff time in repeatedly viewing multiple detection images, and thus improves observation and diagnosis efficiency.

[0206] Among them, the preset combined mapping surface is a preset mapping surface, which is a plane with the same specifications and parallel to the CT slice image, so that the outline of the lesion mapping area in the CT slice image can be mapped on the preset combined mapping surface, which is convenient for personnel to trigger and view. The mapping outline is the outline of the lesion mapping area, and the fused display data is the video data displayed after the corresponding ultrasound dynamic video is intercepted according to the outline of the lesion mapping area in the CT three-dimensional image.

[0207] In some embodiments, the specific implementation of step S3 (generating fusion display data corresponding to each of the mapping contours according to the contour interception strategy and the ultrasound dynamic video) includes:

[0208] S31, obtaining the lesion area in the ultrasound dynamic video, and selecting the lesion contour with the largest lesion area in the ultrasound dynamic video as the interception contour based on OpenCV.

[0209] It can be understood that the lesion area is the area of ​​the lesion region, the intercepted contour is the lesion contour corresponding to the largest lesion area, and the lesion contour is the contour of the lesion region in the ultrasound dynamic video.

[0210] Through the above implementation, the present invention can obtain a cut-off contour, so as to subsequently cut off the image of the lesion area in the ultrasound dynamic video frame according to the cut-off contour, so as to facilitate subsequent intuitive display.

[0211] S32, intercepting multiple video frames in the ultrasound dynamic video according to the interception outline to obtain interception display data.

[0212] It can be understood that the intercepted display data is video data obtained by intercepting the video frames in the ultrasound dynamic video by intercepting the contour.

[0213] It is not difficult to understand that by intercepting the image in the video frame by cutting out the outline, redundant image information in the video frame can be reduced, so that personnel can intuitively view the lesion information of the corresponding lesion area.

[0214] S33, obtaining the playback time of the mapping frame corresponding to each of the mapping contours, and determining the playback time period corresponding to each of the mapping contours based on the playback time.

[0215] It can be understood that the playback time is the time corresponding to the mapping frame when playing the ultrasonic dynamic video, for example, the 1st second, the 3rd second, and the playback period is the video playback time period of the data associated with the corresponding mapping contour. For example, when the playback time of the mapping frame corresponding to the mapping contour is the 1st second, then in the corresponding video, it is necessary to display and play the continuous video within the playback period 0-1s; when the playback time of the mapping frame corresponding to the mapping contour is the 2nd second, then in the corresponding video, it is necessary to display and play the continuous video within the playback period 1-2s, and so on.

[0216] Through the above implementation, the present invention can obtain the playback time period corresponding to the mapping profile, so as to associate and bind the corresponding intercepted display data with the corresponding mapping profile according to the playback time period, so as to facilitate quick viewing by personnel.

[0217] S34, based on the playing period, the corresponding intercepted display data is retrieved and bound with the corresponding mapping outline to obtain fused display data corresponding to each mapping outline.

[0218] It can be understood that the corresponding intercepted display data is bound to the corresponding mapping outline according to the playback period, so as to obtain fused display data corresponding to each mapping outline, so that subsequent personnel can quickly view the corresponding dynamic fused display data by triggering the mapping outline, thereby improving the diagnostic efficiency of medical staff.

[0219] It should be noted that, since multiple mapping contours mapped on the preset combined mapping surface may be very close, when personnel trigger different mapping contours to view relevant information, they may not be able to accurately trigger the mapping contour they need to view. Therefore, an auxiliary trigger mark can be constructed and configured with a corresponding pixel value, so that personnel can clearly view and accurately trigger the corresponding mapping contour, and realize the rapid viewing of the corresponding fusion display data, thereby, also including:

[0220] B1, obtaining an actual contour similarity value adjacent to the mapped contour, and when it is determined that the actual contour similarity value is less than a preset contour similarity value, taking the corresponding mapped contour as a similar contour.

[0221] It is understandable that when the actual contour similarity value of adjacent mapped contours is less than the preset contour similarity value, it can be explained that the distance between adjacent mapped contours is very small and it is not easy to distinguish and trigger, so the adjacent mapped contours can be regarded as similar contours.

[0222] The similar contour is the corresponding adjacent mapping contour when the actual contour similarity value is less than the preset contour similarity value.

[0223] B2, constructing an auxiliary trigger mark at the similar contour, and configuring a corresponding distinguishing pixel value for each of the mapped contours.

[0224] It can be understood that in order for personnel to clearly determine the information of the mapping contour that needs to be viewed and quickly trigger the corresponding mapping contour for information viewing, an auxiliary trigger mark can be constructed at a similar contour to facilitate personnel to click and trigger, and configure corresponding distinguishing pixel values ​​for each mapping contour so that personnel can clearly distinguish the mapping contours of the lesion mapping areas of different CT slice images mapped on the preset combined mapping surface.

[0225] Among them, the auxiliary trigger mark is a mark for assisting personnel to click and trigger. For example, a raised triangle mark can be added to the corresponding mapping outline so that personnel can trigger the corresponding triangle mark, thereby determining the fusion display data associated with the selected mapping outline for display, and distinguishing pixel values. Different mapping outlines correspond to different pixel values, for example, red, yellow, blue, etc.

[0226] S4, receiving trigger information of the mapping contour from the physician end, taking the corresponding mapping contour as a trigger contour based on the trigger information, retrieving fusion display data corresponding to the trigger contour and sending it to the physician end.

[0227] It can be understood that when medical staff trigger the mapping contour that needs to be viewed on the corresponding physician end, the server will use the corresponding triggered mapping contour as the triggering contour, thereby retrieving the fusion display data associated with the triggering contour and sending it to the physician end, so that the corresponding medical staff can view it intuitively to improve the diagnosis efficiency.

[0228] The trigger information is the operation information for triggering a click, for example, a person clicks on a mapping outline displayed on the physician side to display the corresponding fusion display data, and the trigger outline is the mapping outline that triggers the click.

[0229] See also Figure 4 , is a schematic diagram of the structure of a medical image fusion data processing system provided by an embodiment of the present invention, the medical image fusion data processing system comprising:

[0230] The acquisition module is used to respond to the image fusion requirements of the physician side and acquire the CT three-dimensional image of the target person and the ultrasound dynamic video of the lesion area, wherein the ultrasound dynamic video has multiple video frames, and the video frames have corresponding acquisition angles.

[0231] A determination module is used to determine the corresponding video frame in the ultrasound dynamic video as a mapping frame based on the number of mapping intervals and the frame selection strategy, obtain the acquisition angle corresponding to the mapping frame as a mapping angle, and determine the lesion mapping area in the CT three-dimensional image according to the mapping angle.

[0232] A generation module is used to map the lesion mapping area to a preset combined mapping surface, obtain multiple mapping contours corresponding to the lesion area, and generate fusion display data corresponding to each of the mapping contours according to a contour interception strategy and the ultrasound dynamic video.

[0233] The sending module is used to receive the trigger information of the mapping contour from the physician end, take the corresponding mapping contour as the trigger contour based on the trigger information, retrieve the fusion display data corresponding to the trigger contour and send it to the physician end.

[0234] See also Figure 5 , is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present invention, the electronic device 50 includes: a processor 51, a memory 52 and a computer program; wherein

[0235] The memory 52 is used to store the computer program, and the memory may also be a flash memory. The computer program is, for example, an application program, a functional module, etc. for implementing the above method.

[0236] The processor 51 is used to execute the computer program stored in the memory to implement each step performed by the device in the above method. For details, please refer to the relevant description in the above method embodiment.

[0237] Optionally, the memory 52 may be independent or integrated with the processor 51 .

[0238] When the memory 52 is a device independent of the processor 51, the device may further include:

[0239] The bus 53 is used to connect the memory 52 and the processor 51 .

[0240] The present invention also provides a readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, it is used to implement the methods provided by the various embodiments described above.

[0241] Among them, the readable storage medium can be a computer storage medium or a communication medium. The communication medium includes any medium that facilitates the transmission of a computer program from one place to another. The computer storage medium can be any available medium that can be accessed by a general-purpose or special-purpose computer. For example, a readable storage medium is coupled to a processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can be located in an application-specific integrated circuit (Application Specific Integrated Circuits, referred to as: ASIC). In addition, the ASIC can be located in a user device. Of course, the processor and the readable storage medium can also exist in a communication device as discrete components. The readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, etc.

[0242] The present invention also provides a program product, which includes an execution instruction, which is stored in a readable storage medium. At least one processor of a device can read the execution instruction from the readable storage medium, and at least one processor executes the execution instruction so that the device implements the methods provided in the above various embodiments.

[0243] In the embodiments of the above-mentioned devices, it should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in the present invention may be directly implemented as being executed by a hardware processor, or may be executed by a combination of hardware and software modules in the processor.

[0244] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A medical image fusion data processing method, characterized in that: include: In response to the image fusion requirements of the physician, a CT three-dimensional image of the target person and an ultrasound dynamic video of the lesion area are obtained, wherein the ultrasound dynamic video has a plurality of video frames, and each video frame has a corresponding acquisition angle; Determine a corresponding video frame in the ultrasound dynamic video as a mapping frame based on the number of mapping intervals and the frame selection strategy, obtain an acquisition angle corresponding to the mapping frame as a mapping angle, and determine a lesion mapping area in the CT three-dimensional image according to the mapping angle; Mapping the lesion mapping area to a preset combined mapping surface to obtain a plurality of mapping contours corresponding to the lesion area, and generating fusion display data corresponding to each of the mapping contours according to a contour interception strategy and the ultrasound dynamic video; receiving trigger information of the mapping profile from the physician end, taking the corresponding mapping profile as a trigger profile based on the trigger information, retrieving fusion display data corresponding to the trigger profile and sending it to the physician end; Before the step of determining the corresponding video frame in the ultrasound dynamic video as the mapping frame based on the mapping interval number and the frame selection strategy, acquiring the acquisition angle corresponding to the mapping frame as the mapping angle, and determining the lesion mapping area in the CT three-dimensional image according to the mapping angle, the method includes: Obtaining the video duration corresponding to the ultrasound dynamic video, and counting the number of video frames within the video duration to obtain a total number of video frames; According to the ratio of the total video frames to the video duration, an ultrasound frame rate corresponding to the ultrasound dynamic video is obtained, and according to the ratio of the ultrasound frame rate to a preset frame rate, a frame rate adjustment coefficient is obtained; Retrieving a display comparison table, and obtaining a display level sent by the physician end, and determining a preset number of intervals in the display comparison table as an initial number of intervals based on the display level, wherein the display comparison table includes a one-to-one correspondence between preset levels and preset numbers of intervals; Obtaining a mapping interval number based on a product of the frame rate adjustment coefficient and the initial interval number; The method of determining a corresponding video frame in the ultrasound dynamic video as a mapping frame based on the number of mapping intervals and a frame selection strategy, acquiring an acquisition angle corresponding to the mapping frame as a mapping angle, and determining a lesion mapping area in the CT three-dimensional image according to the mapping angle includes: Selecting the first video frame in the ultrasound dynamic video as the initial video frame, and obtaining the last video frame in the ultrasound dynamic video as the termination video frame; Determining, according to the initial video frame, the number of mapping intervals and the termination video frame, a corresponding video frame in the ultrasound dynamic video as a mapping frame; Acquiring an acquisition angle corresponding to the mapping frame as a mapping angle, determining a CT slice image in the CT three-dimensional image according to the mapping angle, and extracting a lesion mapping area of ​​the CT slice image; The step of determining, according to the initial video frame, the number of mapping intervals and the termination video frame, a corresponding video frame in the ultrasound dynamic video as a mapping frame comprises: Based on the number of mapping intervals, determine the corresponding video frame in the ultrasound dynamic video as the selected video frame with the initial video frame as the starting point; Acquire the acquisition angle corresponding to the initial video frame as the initial angle, and the acquisition angle corresponding to the selected video frame as the selected angle; Determine the lesion mapping area in the corresponding CT slice image as the initial mapping area according to the initial angle, and retrieve the lesion mapping area in the corresponding CT slice image as the selected mapping area based on the selected angle; Constructing a region comparison plane, mapping the initial mapping region and the selected mapping region into the region comparison plane, and obtaining an initial mapping contour corresponding to the initial mapping region and a selected mapping contour corresponding to the selected mapping region; Obtaining an actual contour similarity value according to the initial mapping contour and the selected mapping contour; When it is determined that the actual contour similarity value is less than the preset contour similarity value, based on the mapping interval number, the corresponding video frame in the ultrasound dynamic video is determined as the current selected video frame with the selected video frame as the starting point, and the mapping interval number is sequentially accumulated to obtain the cumulative interval number, and the above step of obtaining the actual contour similarity value is repeated; until the actual contour similarity value is greater than or equal to the preset contour similarity value, or the accumulated interval number is greater than or equal to the maximum interval number, the currently selected video frame is used as the current initial video frame; When it is determined that the actual contour similarity value is greater than or equal to the preset contour similarity value, the selected video frame is used as the current initial video frame; When it is determined that the current initial video frame is not the termination video frame, the above steps are repeated until the current initial video frame is in the termination video frame, and all the initial video frames are used as mapping frames.

2. The method according to claim 1, characterized in that The obtaining of the actual contour similarity value according to the initial mapping contour and the selected mapping contour comprises: Obtaining the center point of the regional comparison surface as the comparison midpoint, and constructing a comparison coordinate system with the comparison midpoint as the coordinate origin; Calculating contour coordinate points in the selected mapped contour according to the comparison coordinate system to obtain a selected contour coordinate set corresponding to the selected mapped contour; Obtain the minimum horizontal coordinate, the maximum horizontal coordinate, the minimum vertical coordinate and the maximum vertical coordinate in the selected contour coordinate set; Calculate the horizontal distance based on the maximum horizontal coordinate and the minimum horizontal coordinate, calculate the vertical distance based on the maximum vertical coordinate and the minimum vertical coordinate, and determine the distance based on the absolute value of the difference between the horizontal distance and the vertical distance; When it is determined that the judgment distance is greater than a preset difference value, a similarity evaluation rectangle is constructed according to the maximum horizontal coordinate, the minimum horizontal coordinate, the maximum vertical coordinate and the minimum vertical coordinate, and an actual contour similarity value between the initial mapping contour and the selected mapping contour is determined based on the similarity evaluation rectangle; When it is determined that the judgment distance is less than or equal to the preset difference, a similarity evaluation circle is constructed according to the maximum horizontal coordinate, the minimum horizontal coordinate, the maximum vertical coordinate and the minimum vertical coordinate, and an actual contour similarity value of the initial mapping contour and the selected mapping contour is determined based on the similarity evaluation circle.

3. The method according to claim 2, characterized in that When determining that the judgment distance is greater than a preset difference, constructing a similarity evaluation rectangle according to the maximum horizontal coordinate, the minimum horizontal coordinate, the maximum vertical coordinate, and the minimum vertical coordinate, and determining an actual contour similarity value between the initial mapping contour and the selected mapping contour based on the similarity evaluation rectangle, including: When it is determined that the judgment distance is greater than the preset difference, constructing a first vertical line according to the maximum horizontal coordinate, and constructing a second vertical line based on the minimum horizontal coordinate; constructing a first horizontal line according to the maximum vertical coordinate, constructing a second horizontal line based on the minimum vertical coordinate, and generating a similarity evaluation rectangle based on the first vertical line, the second vertical line, the first horizontal line, and the second horizontal line; Connecting the diagonal lines of the similarity evaluation rectangle to obtain two evaluation lines, obtaining a first evaluation intersection point between the evaluation line and the initial mapping contour, and obtaining a second evaluation intersection point between the corresponding evaluation line and the selected mapping contour; The coordinates of the first evaluation intersection point and the second evaluation intersection point located on the same side of the evaluation line are calculated to obtain a line segment evaluation distance, and the line segment evaluation distance is averaged to obtain an actual contour similarity value between the initial mapping contour and the selected mapping contour.

4. The method according to claim 2, characterized in that: When it is determined that the judgment distance is less than or equal to the preset difference value, a similarity evaluation circle is constructed according to the maximum horizontal coordinate, the minimum horizontal coordinate, the maximum vertical coordinate and the minimum vertical coordinate, and an actual contour similarity value between the initial mapping contour and the selected mapping contour is determined based on the similarity evaluation circle, including: When it is determined that the judgment distance is less than or equal to the preset difference, obtaining the central horizontal coordinate based on the average value of the maximum horizontal coordinate and the minimum horizontal coordinate; Obtaining a central ordinate according to an average value of the maximum ordinate and the minimum ordinate; Based on the central abscissa and the central ordinate, obtaining a central coordinate point corresponding to the selected mapping contour; Determine the maximum distance between the contour coordinate point in the selected contour coordinate set and the center coordinate point as a construction radius; Generate a similarity evaluation circle according to the central coordinate point and the construction radius; Determine an intersection of the similarity evaluation circle and the selected mapping contour as an initial positioning point, determine a positioning diameter in the similarity evaluation circle based on the initial positioning point, rotate the positioning diameter in sequence based on a preset rotation direction and a preset rotation angle to obtain a plurality of rotation diameters, and count the rotation diameters and the positioning diameters to obtain a plurality of evaluation diameters; Obtaining a third evaluation intersection point between the evaluation diameter and the initial mapping contour, and obtaining a fourth evaluation intersection point between the corresponding evaluation diameter and the selected mapping contour; The coordinates of the third evaluation intersection point and the fourth evaluation intersection point located on the same side of the evaluation diameter are calculated to obtain a diameter evaluation distance, and the diameter evaluation distance is averaged to obtain an actual contour similarity value between the initial mapping contour and the selected mapping contour.

5. The method according to claim 4, characterized in that Also includes: Acquire an actual contour similarity value adjacent to the mapped contour, and when it is determined that the actual contour similarity value is less than a preset contour similarity value, use the corresponding mapped contour as a similar contour; An auxiliary trigger mark is constructed at the similar contour, and a corresponding distinguishing pixel value is configured for each of the mapped contours.

6. The method according to claim 5, characterized in that The step of generating fusion display data corresponding to each of the mapping contours according to the contour interception strategy and the ultrasound dynamic video includes: Acquire the lesion area in the ultrasound dynamic video, and select the lesion contour with the largest lesion area in the ultrasound dynamic video as the interception contour based on OpenCV; Intercepting a plurality of video frames in the ultrasound dynamic video according to the interception contour to obtain interception display data; Acquire the playback time of the mapping frame corresponding to each of the mapping contours, and determine the playback time period corresponding to each of the mapping contours based on the playback time; Based on the playing period, the corresponding intercepted display data is retrieved and bound with the corresponding mapping outline to obtain fused display data corresponding to each mapping outline.

7. A medical image fusion data processing system, characterized in that: include: An acquisition module, used to respond to the image fusion requirements of the physician end, and acquire the CT three-dimensional image of the target person and the ultrasound dynamic video of the lesion area, wherein the ultrasound dynamic video has multiple video frames, and the video frames have corresponding acquisition angles; a determination module, configured to determine a corresponding video frame in the ultrasound dynamic video as a mapping frame based on the number of mapping intervals and a frame selection strategy, obtain an acquisition angle corresponding to the mapping frame as a mapping angle, and determine a lesion mapping area in the CT three-dimensional image according to the mapping angle; A generating module, used for mapping the lesion mapping area to a preset combined mapping surface, obtaining a plurality of mapping contours corresponding to the lesion area, and generating fusion display data corresponding to each of the mapping contours according to a contour interception strategy and the ultrasound dynamic video; A sending module, used for receiving trigger information of the mapping profile from the physician end, taking the corresponding mapping profile as a trigger profile based on the trigger information, retrieving fusion display data corresponding to the trigger profile and sending it to the physician end; Before the step of determining the corresponding video frame in the ultrasound dynamic video as the mapping frame based on the mapping interval number and the frame selection strategy, acquiring the acquisition angle corresponding to the mapping frame as the mapping angle, and determining the lesion mapping area in the CT three-dimensional image according to the mapping angle, the method includes: Obtaining the video duration corresponding to the ultrasound dynamic video, and counting the number of video frames within the video duration to obtain a total number of video frames; According to the ratio of the total video frames to the video duration, an ultrasound frame rate corresponding to the ultrasound dynamic video is obtained, and according to the ratio of the ultrasound frame rate to a preset frame rate, a frame rate adjustment coefficient is obtained; Retrieving a display comparison table, and obtaining a display level sent by the physician end, and determining a preset number of intervals in the display comparison table as an initial number of intervals based on the display level, wherein the display comparison table includes a one-to-one correspondence between preset levels and preset numbers of intervals; Obtaining a mapping interval number based on a product of the frame rate adjustment coefficient and the initial interval number; The method of determining a corresponding video frame in the ultrasound dynamic video as a mapping frame based on the number of mapping intervals and a frame selection strategy, acquiring an acquisition angle corresponding to the mapping frame as a mapping angle, and determining a lesion mapping area in the CT three-dimensional image according to the mapping angle includes: Selecting the first video frame in the ultrasound dynamic video as the initial video frame, and obtaining the last video frame in the ultrasound dynamic video as the termination video frame; Determining, according to the initial video frame, the number of mapping intervals and the termination video frame, a corresponding video frame in the ultrasound dynamic video as a mapping frame; Acquiring an acquisition angle corresponding to the mapping frame as a mapping angle, determining a CT slice image in the CT three-dimensional image according to the mapping angle, and extracting a lesion mapping area of ​​the CT slice image; The step of determining, according to the initial video frame, the number of mapping intervals and the termination video frame, a corresponding video frame in the ultrasound dynamic video as a mapping frame comprises: Based on the number of mapping intervals, determine the corresponding video frame in the ultrasound dynamic video as the selected video frame with the initial video frame as the starting point; Acquire the acquisition angle corresponding to the initial video frame as the initial angle, and the acquisition angle corresponding to the selected video frame as the selected angle; Determine the lesion mapping area in the corresponding CT slice image as the initial mapping area according to the initial angle, and retrieve the lesion mapping area in the corresponding CT slice image as the selected mapping area based on the selected angle; Constructing a region comparison plane, mapping the initial mapping region and the selected mapping region into the region comparison plane, and obtaining an initial mapping contour corresponding to the initial mapping region and a selected mapping contour corresponding to the selected mapping region; Obtaining an actual contour similarity value according to the initial mapping contour and the selected mapping contour; When it is determined that the actual contour similarity value is less than the preset contour similarity value, based on the mapping interval number, the corresponding video frame in the ultrasound dynamic video is determined as the current selected video frame with the selected video frame as the starting point, and the mapping interval number is sequentially accumulated to obtain the cumulative interval number, and the above step of obtaining the actual contour similarity value is repeated; until the actual contour similarity value is greater than or equal to the preset contour similarity value, or the accumulated interval number is greater than or equal to the maximum interval number, the currently selected video frame is used as the current initial video frame; When it is determined that the actual contour similarity value is greater than or equal to the preset contour similarity value, the selected video frame is used as the current initial video frame; When it is determined that the current initial video frame is not the termination video frame, the above steps are repeated until the current initial video frame is in the termination video frame, and all the initial video frames are used as mapping frames.

Images